-- Logs begin at Thu 2022-07-28 16:46:52 UTC, end at Thu 2022-07-28 18:31:39 UTC. -- Jul 28 17:43:34.098994 dv-cinder-837543-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 28 17:43:34.106904 dv-cinder-837543-7-smb devstack@keystone.service[80407]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 28 17:43:34.110103 dv-cinder-837543-7-smb devstack@keystone.service[80407]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 17:43:34 2022] *** Jul 28 17:43:34.110103 dv-cinder-837543-7-smb devstack@keystone.service[80407]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 17:43:34.110103 dv-cinder-837543-7-smb devstack@keystone.service[80407]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 17:43:34.110103 dv-cinder-837543-7-smb devstack@keystone.service[80407]: nodename: dv-cinder-837543-7-smb Jul 28 17:43:34.110103 dv-cinder-837543-7-smb devstack@keystone.service[80407]: machine: x86_64 Jul 28 17:43:34.110103 dv-cinder-837543-7-smb devstack@keystone.service[80407]: clock source: unix Jul 28 17:43:34.110103 dv-cinder-837543-7-smb devstack@keystone.service[80407]: pcre jit disabled Jul 28 17:43:34.110103 dv-cinder-837543-7-smb devstack@keystone.service[80407]: detected number of CPU cores: 4 Jul 28 17:43:34.110103 dv-cinder-837543-7-smb devstack@keystone.service[80407]: current working directory: / Jul 28 17:43:34.110103 dv-cinder-837543-7-smb devstack@keystone.service[80407]: detected binary path: /usr/bin/uwsgi-core Jul 28 17:43:34.110652 dv-cinder-837543-7-smb devstack@keystone.service[80407]: your processes number limit is 47680 Jul 28 17:43:34.110652 dv-cinder-837543-7-smb devstack@keystone.service[80407]: your memory page size is 4096 bytes Jul 28 17:43:34.110652 dv-cinder-837543-7-smb devstack@keystone.service[80407]: detected max file descriptor number: 2048 Jul 28 17:43:34.110652 dv-cinder-837543-7-smb devstack@keystone.service[80407]: lock engine: pthread robust mutexes Jul 28 17:43:34.110652 dv-cinder-837543-7-smb devstack@keystone.service[80407]: thunder lock: enabled Jul 28 17:43:34.110652 dv-cinder-837543-7-smb devstack@keystone.service[80407]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 28 17:43:34.110652 dv-cinder-837543-7-smb devstack@keystone.service[80407]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 17:43:34.150721 dv-cinder-837543-7-smb devstack@keystone.service[80407]: Python main interpreter initialized at 0x5580ed2a69c0 Jul 28 17:43:34.150721 dv-cinder-837543-7-smb devstack@keystone.service[80407]: python threads support enabled Jul 28 17:43:34.150721 dv-cinder-837543-7-smb devstack@keystone.service[80407]: your server socket listen backlog is limited to 100 connections Jul 28 17:43:34.150721 dv-cinder-837543-7-smb devstack@keystone.service[80407]: your mercy for graceful operations on workers is 90 seconds Jul 28 17:43:34.155649 dv-cinder-837543-7-smb devstack@keystone.service[80407]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 17:43:34.155649 dv-cinder-837543-7-smb devstack@keystone.service[80407]: *** Operational MODE: preforking *** Jul 28 17:43:34.155649 dv-cinder-837543-7-smb devstack@keystone.service[80407]: *** uWSGI is running in multiple interpreter mode *** Jul 28 17:43:34.155649 dv-cinder-837543-7-smb devstack@keystone.service[80407]: spawned uWSGI master process (pid: 80407) Jul 28 17:43:34.155649 dv-cinder-837543-7-smb devstack@keystone.service[80407]: spawned uWSGI worker 1 (pid: 80420, cores: 1) Jul 28 17:43:34.155649 dv-cinder-837543-7-smb devstack@keystone.service[80407]: spawned uWSGI worker 2 (pid: 80421, cores: 1) Jul 28 17:43:34.155649 dv-cinder-837543-7-smb devstack@keystone.service[80407]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 17:43:34.151630 dv-cinder-837543-7-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 28 17:43:39.777666 dv-cinder-837543-7-smb devstack@keystone.service[80420]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:43:39.777666 dv-cinder-837543-7-smb devstack@keystone.service[80420]: from cryptography.utils import int_from_bytes Jul 28 17:43:39.778447 dv-cinder-837543-7-smb devstack@keystone.service[80421]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:43:39.778447 dv-cinder-837543-7-smb devstack@keystone.service[80421]: from cryptography.utils import int_from_bytes Jul 28 17:43:39.778889 dv-cinder-837543-7-smb devstack@keystone.service[80420]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:43:39.778889 dv-cinder-837543-7-smb devstack@keystone.service[80420]: from cryptography.utils import int_from_bytes Jul 28 17:43:39.779279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:43:39.779279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: from cryptography.utils import int_from_bytes Jul 28 17:43:39.828774 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 17:43:39.828955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 17:43:39.829110 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] command line args: [] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 17:43:39.829381 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 17:43:39.829466 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 17:43:39.829551 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ================================================================================ {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 17:43:39.829627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 17:43:39.829799 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] admin_token = **** {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.829883 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] command line args: [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 17:43:39.830047 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] config_dir = [] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.830131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 17:43:39.830235 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.830312 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ================================================================================ {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 17:43:39.830417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] config_source = [] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.830494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] admin_token = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.830594 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] debug = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.830719 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] config_dir = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.830800 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.831044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.831107 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] config_source = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.831163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.831228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] debug = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.831369 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.831451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.831574 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.831646 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.831811 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.831896 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.832043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] list_limit = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.832126 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.832234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] log_config_append = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.832308 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.832411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.832514 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.832590 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] log_dir = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.832692 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_config_append = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.832822 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] log_file = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.832892 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.833008 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.833080 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_dir = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.833218 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_file = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.833307 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.833455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.833530 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.833700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.833778 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.833898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.833978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.834048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.834189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.834278 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.834355 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.834513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.834591 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.834747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.834834 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.834980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.835061 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.835211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.835295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.835441 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.835523 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.835676 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.835781 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.835941 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.836031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.836192 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.836275 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.836438 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.836704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.75/identity {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.836813 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.836937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] publish_errors = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.837144 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.837221 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.75/identity {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.837375 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.837464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] publish_errors = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.837555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.837630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.837799 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.837874 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.837989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.838076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.838235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.838311 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] standard_threads = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.838469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.838551 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.838702 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] standard_threads = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.838777 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.838896 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.838968 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.839037 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] use_journal = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.839161 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.839243 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] use_json = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.839338 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.839414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] use_stderr = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.839514 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] use_journal = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.839589 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] use_syslog = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.839730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] use_json = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.839808 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.839883 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] use_stderr = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.839987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.840068 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] use_syslog = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.840227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.840317 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.840481 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.840560 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.840719 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.840821 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.840997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.841084 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.841236 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.841310 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.841482 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.841561 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.841716 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.841799 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.841963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.842038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.842199 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.842273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.842448 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.842530 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.842682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.842757 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.842929 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.843004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.843181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.843271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.843396 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.843479 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.843634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.843710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.843870 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.843952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.844123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.844197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.844362 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.844437 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.844608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.844682 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.844869 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.844948 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.845128 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.845204 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.845350 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.845426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.845604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.845679 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.845866 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.845946 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.846097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.846173 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.846330 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.846406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.846560 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.846641 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.846796 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.846872 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.847027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.847107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.847264 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.847339 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.847495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.847571 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.847727 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.847803 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.847971 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.848044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.848204 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.848284 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.848439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.848519 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.848687 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.848807 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.848949 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.849026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.849187 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.849294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.849418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.849493 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.849645 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.849720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.849877 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.849981 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.850108 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.850209 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.850336 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.850439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.850567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.850669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.850802 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.850922 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.851034 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.851120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.851254 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.851841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.851990 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.852105 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.852228 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.852315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.852460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.852536 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.852699 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.852808 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.852960 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.853048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.853194 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.853269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.853430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.853548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.853665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.853748 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.853896 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.853971 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.854131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.854210 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.854360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.854487 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.854593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.854669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.854824 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.854904 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.855057 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.855179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.855291 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.855367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.855527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.855603 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.855760 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.855851 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.855995 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.856070 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.856231 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.856313 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.856468 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.856556 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.856705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.856825 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.856970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.857048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.857226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.857371 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.857450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.857520 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.857696 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.857772 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.857932 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.858017 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.858168 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.858243 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.858401 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.858477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.858640 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.858779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.858871 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.858942 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.859103 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.859179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.859336 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.859418 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.859571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.859651 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.859806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.859891 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.860042 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.860118 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.860276 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.860353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.860509 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.860584 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.860745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.860839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.861022 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.861106 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.861261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.861336 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.861502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.861576 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.861737 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.861813 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.861971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.862045 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.862204 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.862279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.862433 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.862511 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.862665 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.862747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.862895 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.862970 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.863128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.863205 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.863355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.863432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.863588 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.863663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.863822 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.863898 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.864062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.864137 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.864297 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.864378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.864544 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.864620 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.864802 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.864883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.865059 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.865134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.865293 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] auth.external = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.865370 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.865525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.865608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.865771 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.external = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.865846 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.866006 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.866109 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.866261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] auth.password = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.866338 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.866493 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] auth.token = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.866570 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.866731 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.866807 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.password = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.866980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.token = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.867091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.867785 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.867870 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.868019 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.868096 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.868270 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.868354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.868519 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.868596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.868786 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.868867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.869007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] credential.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.869085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.869260 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.869337 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.869496 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.869571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.869747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.869825 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.869982 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.870064 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.870227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.870304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.870462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.870539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.870705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.870781 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.870943 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.871033 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.871196 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.871271 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.871450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.871527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.871687 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.871836 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.871944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.872021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.872217 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.872293 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.872464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.872548 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.872723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.872816 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.872986 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] federation.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.873064 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.873225 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.873311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.873483 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.873566 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.873711 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.873788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.873947 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.874031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.874196 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.874274 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.874428 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.874505 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.874677 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.874763 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.874913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.874988 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.875165 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.875241 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.875401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.875484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.875647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.875725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.875883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.875959 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.876133 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.876218 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.876372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.876448 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.876606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.876683 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.876868 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.876961 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.877119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.877194 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.877350 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.877425 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.877591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.877676 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.877824 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.877900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.878065 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.878141 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.878313 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.878402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.878545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.878622 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.878778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.878854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.879011 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.879096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.879245 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.879323 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.879492 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.879569 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.879744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.879829 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.879989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.880071 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.880246 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.880322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.880488 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.880564 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.880727 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.880866 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.880984 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.881061 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.881222 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.881301 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.881455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.881530 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.881690 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.881765 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.881920 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.881997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.882158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.882235 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.882400 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.882477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.882657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.882771 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.882906 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.883003 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.883143 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.883244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.883374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.883451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.883620 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.883696 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.883855 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.883931 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.884168 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.884261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.884334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.884405 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.884542 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.884620 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.884800 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.884882 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.885040 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.885117 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.885276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.885352 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.885512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.885590 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.885750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.885826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.885991 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.886068 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.886228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.886306 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.886459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.886535 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.886692 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.886768 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.886942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.887028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.887190 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.887267 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.887426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.887504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.887663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.887746 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.887899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.887976 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.888132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.888209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.888368 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.888445 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.888605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.888682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.888872 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.888950 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.889121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.889200 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.889357 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.889433 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.889607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.889683 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.889843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.889920 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.890076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.890158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.890312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.890389 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.890542 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.890625 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.890776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.890851 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.891008 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.891084 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.891244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.891322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.891477 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.891553 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.891724 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.891801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.891974 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.892078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.892221 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.892328 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.892564 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.892651 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.892837 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.892919 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.893073 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.893151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.893310 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.893386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.893548 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.893626 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.893784 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.893859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.894027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.894103 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.894265 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.894342 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.894499 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.894575 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.894748 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.894824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.894965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.895038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.895210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.895287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.895446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.895532 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.895682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.895759 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.895918 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.895994 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.896156 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.896240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.896395 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.896471 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.896628 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.896705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.896898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.896988 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.897134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.897210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] resource.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.897373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.897449 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.897617 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.897702 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.897852 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.897927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.898102 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.898178 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.898862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.898949 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.899100 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.899176 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.899353 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.899430 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.899588 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.899672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.899825 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.899901 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.900061 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] role.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.900138 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.900299 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.900383 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] role.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.900530 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.900605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] role.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.900798 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] role.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.900878 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.901035 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.901124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.901283 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.901358 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.901530 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.901607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.901777 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.901861 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.902021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.902097 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.902267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.902344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.902512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.902596 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.902742 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.902818 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.902988 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.903064 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.903221 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.903304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.903469 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.903544 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.903714 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.903791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.903963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.904374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.904454 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.904615 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.904891 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.904970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.905131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.905209 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.905384 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.905461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.905633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.905721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.905869 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.905950 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.906116 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.906191 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.906355 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.906437 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.906596 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.906673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.906829 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.906906 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.907062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.907139 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.907296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.907374 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.907527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.907603 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.907761 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.907838 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.908015 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.908094 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.908249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.908324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.908483 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.908560 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.908714 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.908810 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.908974 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] token.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.909051 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.909203 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.909279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.909442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.909521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.909679 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.909756 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.909931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.910008 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.910166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.910244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.910402 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.910478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.910647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.910724 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.910885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.910962 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.911129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.911207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.911384 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.911468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.911605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.911684 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.911840 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.911916 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.912079 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.912156 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.912316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.912394 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.912543 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.912619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.912807 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.912887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.913046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.913123 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.913291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.913368 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.connection = **** {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.913583 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.913669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.913832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.914447 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.connection = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.914607 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.914694 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.914850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.914928 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.915086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.915162 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.915307 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.915381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.915544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.915621 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.915780 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.915856 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.916018 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.916096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.916252 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.916328 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.916495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.916571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.916729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.916832 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.916995 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.917071 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.917230 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.917305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.917475 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.917555 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.917706 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.917783 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.917945 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.918022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.918174 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.918250 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.918340 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 17:43:39.918416 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.918637 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.918809 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 17:43:39.947471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:39.947695 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:39.947922 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:39.948134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:39.948368 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:39.948596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:39.957290 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:39.957545 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:39.988256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:39.988479 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:39.988583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:39.988786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.041439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.041745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.092692 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.092949 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.093239 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.093477 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.171217 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.171438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.171527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.171652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.171798 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.171882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.172031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.172111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.172254 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.172335 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.172474 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.172693 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.195413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.195592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.195696 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.195831 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.195912 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.196059 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.196137 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.196273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.196354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.196482 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.196561 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.196690 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.196805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.196931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.207872 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.208261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.221135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.221363 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.221447 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.221588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.221669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.221809 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.221888 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.222022 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.222102 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.222230 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.222310 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.222427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.222518 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.222657 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:43:40.240074 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.240282 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 17:43:40.240460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.240617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.240699 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 17:43:40.240846 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 17:43:40.241020 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.241100 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.241225 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 17:43:40.241356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.241494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.241610 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.241755 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.241862 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.242044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.242305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.251650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.251926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.252104 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.252185 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.252383 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.252463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.252713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.252971 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.259396 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.259934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.264163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.264446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.264712 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.264809 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.265015 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.265108 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.265294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.265371 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.265555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.265635 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.265824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.265904 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.266082 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.266159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.266350 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.266435 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.266618 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.266695 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.266883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.266961 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.267154 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.267421 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.290680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.291311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.292211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.292446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.292831 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.293113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.297101 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.297382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.297663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.297758 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.298021 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.298303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.304238 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.304539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.304967 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.305249 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.308693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.309032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.309324 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.309562 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.309658 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.309856 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.309938 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.310134 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.310214 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.310403 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.310485 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.310674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.310753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.310945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.311213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.311488 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.327145 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.327419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.327908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.328180 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.331367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.332138 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.334561 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.335085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.335360 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.335656 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.339328 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.340121 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.342544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.343415 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.345740 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.346039 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.346325 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.346618 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.346761 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.346897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.347038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.347184 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.347324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.347503 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.347790 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.348092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.363660 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.363942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.364213 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.364474 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.364635 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.364939 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.365203 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.365464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.371954 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.372933 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.373549 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.373824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.374479 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.374746 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.376650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.376955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.377253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.377544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.377689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.377822 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.377953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.378123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.378410 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.378708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.389316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.389594 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.389870 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.390144 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.390236 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.390421 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.390511 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.390692 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.390776 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.390974 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.391056 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.391255 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.391530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.391813 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.406854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.407721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.409837 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.410776 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.412801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.413769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.415830 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.416830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.417408 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.417690 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.417970 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.418453 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.418730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.419008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.424487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.425524 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.426105 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.427121 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.429050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.429338 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.430160 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.430435 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.430633 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.430923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.431205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.431487 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.438485 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.438772 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.439051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.440533 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.440844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.441136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.445951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.446230 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.446510 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.446785 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.447064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.447356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.447626 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.447899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.448025 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:43:40.448267 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.448401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.448557 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.448685 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.448843 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.448982 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.449110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.449243 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.449370 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.449493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.449619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.449743 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.449876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.450253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.450544 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.450828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.451093 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.451359 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.451630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:43:40.483316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580ed2a69c0 pid: 80421 (default app) Jul 28 17:43:40.485833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580ed2a69c0 pid: 80420 (default app) Jul 28 17:43:40.486667 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece51a1-0832-4258-97a1-7f3803a7c049 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:40.486962 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece51a1-0832-4258-97a1-7f3803a7c049 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:40.487240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece51a1-0832-4258-97a1-7f3803a7c049 None None] PATH_INFO: `/v3` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:40.491575 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1/1] 10.222.0.75 () {50 vars in 791 bytes} [Thu Jul 28 17:43:40 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:49.172352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91001f5c-fe0a-459c-99b4-55f965c7f0d5 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:49.172956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91001f5c-fe0a-459c-99b4-55f965c7f0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:49.172956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91001f5c-fe0a-459c-99b4-55f965c7f0d5 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:49.177454 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1/2] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:43:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:49.182840 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5e40-910b-4673-a946-2667504ca38c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:49.183264 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5e40-910b-4673-a946-2667504ca38c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:49.183396 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5e40-910b-4673-a946-2667504ca38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:49.254670 dv-cinder-837543-7-smb devstack@keystone.service[80421]: INFO dbcounter [None req-638e5e40-910b-4673-a946-2667504ca38c None None] Registered counter for database keystone Jul 28 17:43:49.275928 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG oslo_db.sqlalchemy.engines [None req-638e5e40-910b-4673-a946-2667504ca38c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:43:49.282319 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writer thread running {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:43:49.460119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG passlib.handlers.bcrypt [None req-638e5e40-910b-4673-a946-2667504ca38c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80421) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 17:43:49.461025 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG passlib.handlers.bcrypt [None req-638e5e40-910b-4673-a946-2667504ca38c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80421) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 17:43:49.515707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-638e5e40-910b-4673-a946-2667504ca38c None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:49.517381 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-638e5e40-910b-4673-a946-2667504ca38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:49.641596 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 2/3] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 28 17:43:49.790726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91001f5c-fe0a-459c-99b4-55f965c7f0d5 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:49.862008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: INFO dbcounter [None req-91001f5c-fe0a-459c-99b4-55f965c7f0d5 None None] Registered counter for database keystone Jul 28 17:43:49.881647 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG oslo_db.sqlalchemy.engines [None req-91001f5c-fe0a-459c-99b4-55f965c7f0d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:43:49.888635 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writer thread running {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:43:50.008775 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91001f5c-fe0a-459c-99b4-55f965c7f0d5 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:50.013273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54989d06-1266-47cd-a4d1-0120a9621c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:50.013925 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54989d06-1266-47cd-a4d1-0120a9621c97 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:50.014214 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54989d06-1266-47cd-a4d1-0120a9621c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:50.014496 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54989d06-1266-47cd-a4d1-0120a9621c97 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:50.023295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54989d06-1266-47cd-a4d1-0120a9621c97 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:50.076497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: WARNING keystone.common.rbac_enforcer.enforcer [None req-54989d06-1266-47cd-a4d1-0120a9621c97 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 17:43:50.076795 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54989d06-1266-47cd-a4d1-0120a9621c97 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:50.087490 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 2/4] 10.222.0.75 () {58 vars in 1324 bytes} [Thu Jul 28 17:43:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 17:43:50.093585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e5e40-910b-4673-a946-2667504ca38c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:50.108000 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e5e40-910b-4673-a946-2667504ca38c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:50.112521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7708fb2-16d6-42ca-ac5f-c739b67c916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:50.113663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7708fb2-16d6-42ca-ac5f-c739b67c916e admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:50.113955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7708fb2-16d6-42ca-ac5f-c739b67c916e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:50.114235 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7708fb2-16d6-42ca-ac5f-c739b67c916e admin admin] PATH_INFO: `/v3/projects/7ee435a1a9d946639c722d848ce39bd1` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:50.115757 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7708fb2-16d6-42ca-ac5f-c739b67c916e admin admin] RBAC: Authorizing `identity:get_project(project_id=7ee435a1a9d946639c722d848ce39bd1)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:50.167727 dv-cinder-837543-7-smb devstack@keystone.service[80421]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a7708fb2-16d6-42ca-ac5f-c739b67c916e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 17:43:50.168107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7708fb2-16d6-42ca-ac5f-c739b67c916e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:50.172833 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 3/5] 10.222.0.75 () {56 vars in 1207 bytes} [Thu Jul 28 17:43:50 2022] GET /identity/v3/projects/7ee435a1a9d946639c722d848ce39bd1 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:52.145075 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f59b64-5f80-4be6-86d5-19a3260ce22a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:52.145616 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f59b64-5f80-4be6-86d5-19a3260ce22a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:52.145712 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f59b64-5f80-4be6-86d5-19a3260ce22a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:52.150388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 3/6] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:43:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:43:52.156100 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20757652-af27-460b-bf0e-6313e08b07a1 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:52.156488 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20757652-af27-460b-bf0e-6313e08b07a1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:52.156660 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20757652-af27-460b-bf0e-6313e08b07a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:52.176898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-20757652-af27-460b-bf0e-6313e08b07a1 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:52.178402 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-20757652-af27-460b-bf0e-6313e08b07a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:52.186258 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 4/7] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 17:43:52.207829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f59b64-5f80-4be6-86d5-19a3260ce22a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:52.220368 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f59b64-5f80-4be6-86d5-19a3260ce22a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:52.224562 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f53f6c-136a-413b-886d-8a35c09959b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:52.225210 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f53f6c-136a-413b-886d-8a35c09959b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:52.225498 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f53f6c-136a-413b-886d-8a35c09959b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:52.226319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f53f6c-136a-413b-886d-8a35c09959b2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:52.238437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f53f6c-136a-413b-886d-8a35c09959b2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:52.240342 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f53f6c-136a-413b-886d-8a35c09959b2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:52.251067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 4/8] 10.222.0.75 () {58 vars in 1324 bytes} [Thu Jul 28 17:43:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 17:43:52.256726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20757652-af27-460b-bf0e-6313e08b07a1 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:52.265887 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20757652-af27-460b-bf0e-6313e08b07a1 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:52.270271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d17657-59dd-4812-a7ef-6cfacbc6993c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:52.270912 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d17657-59dd-4812-a7ef-6cfacbc6993c admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:52.271196 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d17657-59dd-4812-a7ef-6cfacbc6993c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:52.271476 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d17657-59dd-4812-a7ef-6cfacbc6993c admin admin] PATH_INFO: `/v3/users/f7723740b021455a9d6a17442f071bca` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:52.273378 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d17657-59dd-4812-a7ef-6cfacbc6993c admin admin] RBAC: Authorizing `identity:get_user(user_id=f7723740b021455a9d6a17442f071bca)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:52.275239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d17657-59dd-4812-a7ef-6cfacbc6993c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:52.276802 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 5/9] 10.222.0.75 () {56 vars in 1198 bytes} [Thu Jul 28 17:43:52 2022] GET /identity/v3/users/f7723740b021455a9d6a17442f071bca => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:54.355890 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a8851-78ce-4c69-b707-d4a58ce6befa None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:54.356376 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a8851-78ce-4c69-b707-d4a58ce6befa None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:54.356477 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a8851-78ce-4c69-b707-d4a58ce6befa None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:54.357844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 5/10] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:54.363723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06856c3c-c366-41d9-96ea-fd7cd2e428ea None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:54.364155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06856c3c-c366-41d9-96ea-fd7cd2e428ea None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:54.364413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06856c3c-c366-41d9-96ea-fd7cd2e428ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:54.383636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-06856c3c-c366-41d9-96ea-fd7cd2e428ea None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:54.384849 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-06856c3c-c366-41d9-96ea-fd7cd2e428ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:54.388379 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8a393-9d59-43f4-81aa-487b335959cb None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:54.388674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8a393-9d59-43f4-81aa-487b335959cb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:54.388989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8a393-9d59-43f4-81aa-487b335959cb None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:54.390319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 6/11] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:43:54.395494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a2638-9061-4f83-be81-b7544500bb7a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:54.395823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a2638-9061-4f83-be81-b7544500bb7a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:54.396107 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a2638-9061-4f83-be81-b7544500bb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:54.438956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG passlib.handlers.bcrypt [None req-946a2638-9061-4f83-be81-b7544500bb7a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80420) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 17:43:54.439382 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG passlib.handlers.bcrypt [None req-946a2638-9061-4f83-be81-b7544500bb7a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80420) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 17:43:54.466908 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 6/12] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:43:54.485367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-946a2638-9061-4f83-be81-b7544500bb7a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:54.486991 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-946a2638-9061-4f83-be81-b7544500bb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:54.489659 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06856c3c-c366-41d9-96ea-fd7cd2e428ea None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:54.512552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:54.588642 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 7/13] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:43:54.593874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06856c3c-c366-41d9-96ea-fd7cd2e428ea None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:54.610314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a2638-9061-4f83-be81-b7544500bb7a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:54.627859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421d62a-387f-4993-92bd-4affc292c702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:54.628514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421d62a-387f-4993-92bd-4affc292c702 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:54.628824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421d62a-387f-4993-92bd-4affc292c702 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:54.629110 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421d62a-387f-4993-92bd-4affc292c702 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:54.640712 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421d62a-387f-4993-92bd-4affc292c702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:43:54.650147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-a421d62a-387f-4993-92bd-4affc292c702 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:43:54.650147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:54.650147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:54.650147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:54.650147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:54.650147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:54.650147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:54.650147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:54.650147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:54.650147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:54.650147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:54.650147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:54.650147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:43:54.650147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:43:54.650147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:43:54.650147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:43:54.651064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:43:54.651064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:43:54.651064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:43:54.651064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:43:54.651064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:54.651064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:54.651064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:54.651064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:54.651064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:54.651064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:54.651064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:54.651064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:54.651064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:54.651064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:54.651064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:54.651064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:54.651963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:54.651963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:54.651963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:54.651963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:54.651963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:43:54.651963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:43:54.651963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:43:54.651963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:43:54.651963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:43:54.651963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:43:54.651963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:43:54.651963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:43:54.651963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 7/14] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:43:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:43:54.657605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421d62a-387f-4993-92bd-4affc292c702 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:54.733466 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a2638-9061-4f83-be81-b7544500bb7a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:54.735866 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:54.748492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:54.767516 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421d62a-387f-4993-92bd-4affc292c702 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:54.770244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79ebf3-7b07-4146-8253-a5928c0b82e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:54.771203 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79ebf3-7b07-4146-8253-a5928c0b82e9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:54.771548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79ebf3-7b07-4146-8253-a5928c0b82e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:54.771882 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79ebf3-7b07-4146-8253-a5928c0b82e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:54.801620 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e61ebb-32be-455a-b21d-fb08864c6e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:54.802246 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e61ebb-32be-455a-b21d-fb08864c6e6b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:54.802526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e61ebb-32be-455a-b21d-fb08864c6e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:54.802796 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e61ebb-32be-455a-b21d-fb08864c6e6b None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:54.803511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e61ebb-32be-455a-b21d-fb08864c6e6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:54.803821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e61ebb-32be-455a-b21d-fb08864c6e6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:54.805332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e61ebb-32be-455a-b21d-fb08864c6e6b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:54.817055 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 8/15] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:43:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:54.823097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e61ebb-32be-455a-b21d-fb08864c6e6b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:54.843572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79ebf3-7b07-4146-8253-a5928c0b82e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:54.845221 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79ebf3-7b07-4146-8253-a5928c0b82e9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:54.932946 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e61ebb-32be-455a-b21d-fb08864c6e6b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:54.942687 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 8/16] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:43:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:43:54.949219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79ebf3-7b07-4146-8253-a5928c0b82e9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:54.952405 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:55.056323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79ebf3-7b07-4146-8253-a5928c0b82e9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:55.075481 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae3ad6-3795-415b-a33e-3c98191e06be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:55.076136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae3ad6-3795-415b-a33e-3c98191e06be None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:55.076421 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae3ad6-3795-415b-a33e-3c98191e06be None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:55.076696 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae3ad6-3795-415b-a33e-3c98191e06be None admin] PATH_INFO: `/v3/users/f7723740b021455a9d6a17442f071bca` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:55.077908 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae3ad6-3795-415b-a33e-3c98191e06be None admin] RBAC: Authorizing `identity:get_user(user_id=f7723740b021455a9d6a17442f071bca)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:55.079370 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae3ad6-3795-415b-a33e-3c98191e06be None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:55.081154 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 9/17] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:43:54 2022] GET /identity/v3/users/f7723740b021455a9d6a17442f071bca => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:55.086625 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae3ad6-3795-415b-a33e-3c98191e06be None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:55.096955 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225ef0f-1004-4b03-a2ca-4f01fc298428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:55.097781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225ef0f-1004-4b03-a2ca-4f01fc298428 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:55.098073 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225ef0f-1004-4b03-a2ca-4f01fc298428 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:55.098352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225ef0f-1004-4b03-a2ca-4f01fc298428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:55.101352 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:55.117288 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225ef0f-1004-4b03-a2ca-4f01fc298428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:55.118766 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225ef0f-1004-4b03-a2ca-4f01fc298428 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:55.136763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-c225ef0f-1004-4b03-a2ca-4f01fc298428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:55.136763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:55.136763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:55.136763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:55.136763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:55.136763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:55.136763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:55.136763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:55.136763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:55.136763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:55.136763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:55.136763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:55.136763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:43:55.136763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:43:55.136763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:43:55.137577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:43:55.137577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:55.137577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:55.137577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:55.137577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:55.137577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:55.137577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:55.137577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:55.137577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:55.137577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:55.137577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:55.137577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:55.137577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:55.137577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:55.137577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:55.137577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:55.137577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:55.138365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:43:55.138365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:43:55.138365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:55.138365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:43:55.138365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 9/18] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:43:55.144661 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225ef0f-1004-4b03-a2ca-4f01fc298428 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:55.187522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae3ad6-3795-415b-a33e-3c98191e06be None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:55.201129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:55.221583 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5b6f0-6e39-4fec-8382-3f77bafcc345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:55.222235 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5b6f0-6e39-4fec-8382-3f77bafcc345 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:55.222512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5b6f0-6e39-4fec-8382-3f77bafcc345 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:55.222784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5b6f0-6e39-4fec-8382-3f77bafcc345 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:55.223934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5b6f0-6e39-4fec-8382-3f77bafcc345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:55.225645 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5b6f0-6e39-4fec-8382-3f77bafcc345 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:55.227417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 10/19] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:55.233162 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5b6f0-6e39-4fec-8382-3f77bafcc345 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:55.247744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225ef0f-1004-4b03-a2ca-4f01fc298428 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:55.281400 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04dde5-b554-4465-b920-8b553b487c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:55.282024 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04dde5-b554-4465-b920-8b553b487c85 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:55.282308 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04dde5-b554-4465-b920-8b553b487c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:55.282595 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04dde5-b554-4465-b920-8b553b487c85 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:55.283289 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04dde5-b554-4465-b920-8b553b487c85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:55.283597 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04dde5-b554-4465-b920-8b553b487c85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:55.285019 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04dde5-b554-4465-b920-8b553b487c85 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:55.302415 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 10/20] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:55.314422 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:55.335935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5b6f0-6e39-4fec-8382-3f77bafcc345 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:55.374496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff8a62-e1d0-4cb9-a0cc-e942dd85b13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:55.375154 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff8a62-e1d0-4cb9-a0cc-e942dd85b13e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:55.375324 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff8a62-e1d0-4cb9-a0cc-e942dd85b13e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:55.375580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff8a62-e1d0-4cb9-a0cc-e942dd85b13e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:55.376381 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff8a62-e1d0-4cb9-a0cc-e942dd85b13e None admin] RBAC: Adding query filter params (role.id=d371062e071845ffa4570a76d40dff88, scope.domain.id=default, user.id=f7723740b021455a9d6a17442f071bca) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:55.376693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff8a62-e1d0-4cb9-a0cc-e942dd85b13e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:55.378200 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff8a62-e1d0-4cb9-a0cc-e942dd85b13e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:55.386288 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 11/21] 10.222.0.75 () {56 vars in 1322 bytes} [Thu Jul 28 17:43:55 2022] GET /identity/v3/role_assignments?user.id=f7723740b021455a9d6a17442f071bca&scope.domain.id=default&role.id=d371062e071845ffa4570a76d40dff88 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:57.628273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6a312-7684-4779-9944-2928d6e383ab None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:57.629305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6a312-7684-4779-9944-2928d6e383ab None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:57.629785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6a312-7684-4779-9944-2928d6e383ab None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:57.631414 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 11/22] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:57.637092 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1148b-55fd-44e9-8d65-27e7497e08ed None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:57.637892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1148b-55fd-44e9-8d65-27e7497e08ed None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:57.638377 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1148b-55fd-44e9-8d65-27e7497e08ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:57.662231 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c1b1148b-55fd-44e9-8d65-27e7497e08ed None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:57.663804 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c1b1148b-55fd-44e9-8d65-27e7497e08ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:57.742286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 12/23] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:43:57.776917 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6a312-7684-4779-9944-2928d6e383ab None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:57.896678 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6a312-7684-4779-9944-2928d6e383ab None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:57.924610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:57.947042 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a07b4f-ebfe-441b-8b03-ec42d5b4a5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:57.947780 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a07b4f-ebfe-441b-8b03-ec42d5b4a5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:57.948065 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a07b4f-ebfe-441b-8b03-ec42d5b4a5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:57.948337 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a07b4f-ebfe-441b-8b03-ec42d5b4a5c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:57.964664 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a07b4f-ebfe-441b-8b03-ec42d5b4a5c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:57.966197 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a07b4f-ebfe-441b-8b03-ec42d5b4a5c3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:57.984695 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb4de2-0d24-4a00-b135-b6eb801ef896 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:57.985364 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb4de2-0d24-4a00-b135-b6eb801ef896 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:57.985842 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb4de2-0d24-4a00-b135-b6eb801ef896 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:57.987413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 13/24] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:43:57.989365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-55a07b4f-ebfe-441b-8b03-ec42d5b4a5c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:57.989365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:57.989365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:57.989365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:57.989365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:57.989365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:57.989365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:57.989365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:57.989365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:57.989365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:57.989365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:57.989365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:57.989365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:43:57.989365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:43:57.989365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:43:57.990128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:43:57.990128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:57.990128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:57.990128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:57.990128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:57.990128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:57.990128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:57.990128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:57.990128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:57.990128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:57.990128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:57.990128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:57.990128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:57.990128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:57.990128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:57.990128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:57.990128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:57.991469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:43:57.991469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:43:57.991469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:57.991469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:43:57.991469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 12/25] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:57.998061 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb4de2-0d24-4a00-b135-b6eb801ef896 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:58.002602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1bec6-32d3-4eaf-9a65-e1b8b8592ac1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:58.002890 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1bec6-32d3-4eaf-9a65-e1b8b8592ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:58.003162 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1bec6-32d3-4eaf-9a65-e1b8b8592ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:58.033803 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-16d1bec6-32d3-4eaf-9a65-e1b8b8592ac1 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:58.035088 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-16d1bec6-32d3-4eaf-9a65-e1b8b8592ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:58.109610 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:58.154566 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 13/26] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:43:58.155781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9f300-e3ea-4962-9d52-554703cd9140 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:58.156063 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9f300-e3ea-4962-9d52-554703cd9140 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:58.156342 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9f300-e3ea-4962-9d52-554703cd9140 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:58.157632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 14/27] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:58.163772 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb4de2-0d24-4a00-b135-b6eb801ef896 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:58.166561 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04b868-4fae-4090-a1bb-c5cb489074d9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:58.166848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04b868-4fae-4090-a1bb-c5cb489074d9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:58.167126 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04b868-4fae-4090-a1bb-c5cb489074d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:58.204784 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fa04b868-4fae-4090-a1bb-c5cb489074d9 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:58.206007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fa04b868-4fae-4090-a1bb-c5cb489074d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:58.224607 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba0f06-25fa-474a-953e-42100a26a67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:58.225327 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba0f06-25fa-474a-953e-42100a26a67c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:58.225621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba0f06-25fa-474a-953e-42100a26a67c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:58.225902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba0f06-25fa-474a-953e-42100a26a67c None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:58.226611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba0f06-25fa-474a-953e-42100a26a67c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:58.226925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba0f06-25fa-474a-953e-42100a26a67c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:58.228452 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba0f06-25fa-474a-953e-42100a26a67c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:58.247980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 14/28] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:58.252797 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba0f06-25fa-474a-953e-42100a26a67c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:58.362425 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba0f06-25fa-474a-953e-42100a26a67c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:58.412795 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 15/29] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:43:58.417149 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6b7e7-f1e5-43bd-9ca0-e7be1539deba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:58.417986 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6b7e7-f1e5-43bd-9ca0-e7be1539deba None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:58.418412 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6b7e7-f1e5-43bd-9ca0-e7be1539deba None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:58.418818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6b7e7-f1e5-43bd-9ca0-e7be1539deba None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:58.419673 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6b7e7-f1e5-43bd-9ca0-e7be1539deba None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:58.421282 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6b7e7-f1e5-43bd-9ca0-e7be1539deba None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:58.422367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5478bae-4639-4a80-8881-b381fd490580 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:58.422720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5478bae-4639-4a80-8881-b381fd490580 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:58.423072 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5478bae-4639-4a80-8881-b381fd490580 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:58.424456 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 16/30] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:58.425227 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5478bae-4639-4a80-8881-b381fd490580 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:58.430154 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:58.463675 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:58.540103 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5478bae-4639-4a80-8881-b381fd490580 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:58.580458 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482dacd-4a38-482c-bf0b-16d6ddd1e090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:58.581176 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482dacd-4a38-482c-bf0b-16d6ddd1e090 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:58.581458 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482dacd-4a38-482c-bf0b-16d6ddd1e090 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:58.581745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482dacd-4a38-482c-bf0b-16d6ddd1e090 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:58.583543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482dacd-4a38-482c-bf0b-16d6ddd1e090 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:58.585810 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482dacd-4a38-482c-bf0b-16d6ddd1e090 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:58.671300 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 15/31] 10.222.0.75 () {60 vars in 1131 bytes} [Thu Jul 28 17:43:58 2022] POST /identity/v3/roles => generated 219 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:43:58.676948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42025d9-5a47-45b4-85de-4d3ae460317d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:58.676948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42025d9-5a47-45b4-85de-4d3ae460317d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:58.676948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42025d9-5a47-45b4-85de-4d3ae460317d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:58.703801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e42025d9-5a47-45b4-85de-4d3ae460317d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:58.705967 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e42025d9-5a47-45b4-85de-4d3ae460317d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:58.787871 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 16/32] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:43:58.789054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42025d9-5a47-45b4-85de-4d3ae460317d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:58.901591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42025d9-5a47-45b4-85de-4d3ae460317d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:58.920935 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 17/33] 10.222.0.75 () {60 vars in 1141 bytes} [Thu Jul 28 17:43:58 2022] POST /identity/v3/projects => generated 301 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:43:58.922337 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482dacd-4a38-482c-bf0b-16d6ddd1e090 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:58.938486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:58.947334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783f7fa-b95a-4878-bacf-94e12e4be5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:58.948335 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783f7fa-b95a-4878-bacf-94e12e4be5d7 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:58.948867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783f7fa-b95a-4878-bacf-94e12e4be5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:58.949437 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783f7fa-b95a-4878-bacf-94e12e4be5d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:58.950485 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783f7fa-b95a-4878-bacf-94e12e4be5d7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:58.952359 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783f7fa-b95a-4878-bacf-94e12e4be5d7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:59.041565 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 17/34] 10.222.0.75 () {60 vars in 1131 bytes} [Thu Jul 28 17:43:58 2022] POST /identity/v3/roles => generated 225 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:43:59.043340 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb67ae-b24e-43f9-a868-b65f7b6b112b None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:59.043760 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb67ae-b24e-43f9-a868-b65f7b6b112b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:59.043928 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb67ae-b24e-43f9-a868-b65f7b6b112b None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:59.053848 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 18/35] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:43:59 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:59.062401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a677821-e68c-428b-8f9c-acab08a66669 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:59.063024 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:59.063244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a677821-e68c-428b-8f9c-acab08a66669 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:59.064094 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a677821-e68c-428b-8f9c-acab08a66669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:59.091161 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482dacd-4a38-482c-bf0b-16d6ddd1e090 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:59.109095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-8a677821-e68c-428b-8f9c-acab08a66669 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:59.110617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8a677821-e68c-428b-8f9c-acab08a66669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:59.135777 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92206146-5c00-4de5-bb1b-bfd387e9b926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:59.136932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92206146-5c00-4de5-bb1b-bfd387e9b926 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:59.137444 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92206146-5c00-4de5-bb1b-bfd387e9b926 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:59.137937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92206146-5c00-4de5-bb1b-bfd387e9b926 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:59.153437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92206146-5c00-4de5-bb1b-bfd387e9b926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:43:59.161472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-92206146-5c00-4de5-bb1b-bfd387e9b926 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:43:59.161472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:59.161472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:59.161472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:59.161472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:59.161472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:59.161472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:59.161472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:59.161472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:59.161472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:59.161472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:59.161472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:59.161472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:43:59.161472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:43:59.161472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:43:59.161472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:43:59.162391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:43:59.162391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:43:59.162391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:43:59.162391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:43:59.162391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:59.162391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:59.162391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:59.162391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:59.162391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:59.162391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:59.162391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:59.162391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:59.162391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:59.162391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:59.162391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:59.162391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:59.163193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:59.163193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:59.163193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:59.163193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:59.163193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:43:59.163193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:43:59.163193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:43:59.163193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:43:59.163193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:43:59.163193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:43:59.163193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:43:59.163193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:43:59.168847 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 18/36] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:43:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:59.172414 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92206146-5c00-4de5-bb1b-bfd387e9b926 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:59.231534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 19/37] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:43:59.256965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a677821-e68c-428b-8f9c-acab08a66669 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:59.311915 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92206146-5c00-4de5-bb1b-bfd387e9b926 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:59.364593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ba40a-6d73-4cd3-a68e-f9994f520f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:59.365444 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ba40a-6d73-4cd3-a68e-f9994f520f38 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:59.365969 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ba40a-6d73-4cd3-a68e-f9994f520f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:59.366258 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ba40a-6d73-4cd3-a68e-f9994f520f38 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:59.367025 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ba40a-6d73-4cd3-a68e-f9994f520f38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:59.367344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ba40a-6d73-4cd3-a68e-f9994f520f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:59.368931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ba40a-6d73-4cd3-a68e-f9994f520f38 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:59.388060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 19/38] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:43:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:59.394843 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ba40a-6d73-4cd3-a68e-f9994f520f38 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:59.399593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:59.403705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a677821-e68c-428b-8f9c-acab08a66669 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:59.427464 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:59.450866 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c039ab-620a-43c6-9e10-b516b1d604df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:59.451558 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c039ab-620a-43c6-9e10-b516b1d604df None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:59.452068 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c039ab-620a-43c6-9e10-b516b1d604df None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:59.452243 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c039ab-620a-43c6-9e10-b516b1d604df None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:59.452968 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c039ab-620a-43c6-9e10-b516b1d604df None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:59.454452 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c039ab-620a-43c6-9e10-b516b1d604df None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:59.510397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ba40a-6d73-4cd3-a68e-f9994f520f38 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:59.535763 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 20/39] 10.222.0.75 () {60 vars in 1131 bytes} [Thu Jul 28 17:43:59 2022] POST /identity/v3/roles => generated 223 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:43:59.546564 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb7b1f-4a81-4215-8f29-4fef110af7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:59.551534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb7b1f-4a81-4215-8f29-4fef110af7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:59.551534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb7b1f-4a81-4215-8f29-4fef110af7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:59.551534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb7b1f-4a81-4215-8f29-4fef110af7e7 None admin] PATH_INFO: `/v3/users/f7723740b021455a9d6a17442f071bca` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:59.551534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb7b1f-4a81-4215-8f29-4fef110af7e7 None admin] RBAC: Authorizing `identity:get_user(user_id=f7723740b021455a9d6a17442f071bca)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:59.551534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb7b1f-4a81-4215-8f29-4fef110af7e7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:59.552978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 20/40] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:43:59 2022] GET /identity/v3/users/f7723740b021455a9d6a17442f071bca => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:59.559291 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c039ab-620a-43c6-9e10-b516b1d604df None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:59.562429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b0ef6-4ee7-439b-aaab-bdcdf3e88ce8 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:59.562736 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b0ef6-4ee7-439b-aaab-bdcdf3e88ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:59.563056 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b0ef6-4ee7-439b-aaab-bdcdf3e88ce8 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:59.564579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 21/41] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:43:59.570816 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35731455-1610-4d20-aa71-d9002db4584f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:59.571116 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35731455-1610-4d20-aa71-d9002db4584f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:59.571393 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35731455-1610-4d20-aa71-d9002db4584f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:59.591363 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-35731455-1610-4d20-aa71-d9002db4584f None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:59.593137 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-35731455-1610-4d20-aa71-d9002db4584f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:59.664101 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:59.669636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 22/42] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:43:59.681236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c039ab-620a-43c6-9e10-b516b1d604df None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:59.692767 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35731455-1610-4d20-aa71-d9002db4584f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:59.722757 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fe8c0-6a93-4ffc-af9c-084101484822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:59.723423 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fe8c0-6a93-4ffc-af9c-084101484822 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:59.724036 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fe8c0-6a93-4ffc-af9c-084101484822 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:59.724330 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fe8c0-6a93-4ffc-af9c-084101484822 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:59.726573 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fe8c0-6a93-4ffc-af9c-084101484822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:59.728674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fe8c0-6a93-4ffc-af9c-084101484822 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:59.730669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 21/43] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:59.736073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fe8c0-6a93-4ffc-af9c-084101484822 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:59.781740 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:59.801506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35731455-1610-4d20-aa71-d9002db4584f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:59.835605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1154b-95f5-4530-9a15-5dce75906b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:59.836232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1154b-95f5-4530-9a15-5dce75906b80 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:59.836521 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1154b-95f5-4530-9a15-5dce75906b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:59.836826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1154b-95f5-4530-9a15-5dce75906b80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:59.838072 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1154b-95f5-4530-9a15-5dce75906b80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:59.838451 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fe8c0-6a93-4ffc-af9c-084101484822 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:59.839534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1154b-95f5-4530-9a15-5dce75906b80 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:59.841162 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 23/44] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:59.846716 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1154b-95f5-4530-9a15-5dce75906b80 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:59.873101 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5258fd-3953-4335-88d0-b41a63e5b792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:59.873789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5258fd-3953-4335-88d0-b41a63e5b792 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:59.874080 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5258fd-3953-4335-88d0-b41a63e5b792 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:59.874365 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5258fd-3953-4335-88d0-b41a63e5b792 None admin] PATH_INFO: `/v3/domains/default/users/f7723740b021455a9d6a17442f071bca/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:59.876359 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5258fd-3953-4335-88d0-b41a63e5b792 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f7723740b021455a9d6a17442f071bca, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:59.877875 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5258fd-3953-4335-88d0-b41a63e5b792 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:59.914772 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:59.948560 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1154b-95f5-4530-9a15-5dce75906b80 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:59.958540 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 22/45] 10.222.0.75 () {58 vars in 1361 bytes} [Thu Jul 28 17:43:59 2022] PUT /identity/v3/domains/default/users/f7723740b021455a9d6a17442f071bca/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:43:59.984626 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37648b58-e689-41f2-82d2-2f7ef999970e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:59.985305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37648b58-e689-41f2-82d2-2f7ef999970e None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:59.985588 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37648b58-e689-41f2-82d2-2f7ef999970e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:59.985858 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37648b58-e689-41f2-82d2-2f7ef999970e None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:59.986631 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37648b58-e689-41f2-82d2-2f7ef999970e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:59.988141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37648b58-e689-41f2-82d2-2f7ef999970e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:00.069846 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 24/46] 10.222.0.75 () {60 vars in 1141 bytes} [Thu Jul 28 17:43:59 2022] POST /identity/v3/projects => generated 312 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:44:01.973473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d91c8-889e-45b8-bc6e-32eef33b1f0d None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:01.973995 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d91c8-889e-45b8-bc6e-32eef33b1f0d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:01.974114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d91c8-889e-45b8-bc6e-32eef33b1f0d None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:01.975412 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 23/47] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:01.980663 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce12c2-b16b-45d5-b401-a30316fc21f1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:01.981074 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce12c2-b16b-45d5-b401-a30316fc21f1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:01.981368 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce12c2-b16b-45d5-b401-a30316fc21f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:01.999686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-87ce12c2-b16b-45d5-b401-a30316fc21f1 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:02.000903 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-87ce12c2-b16b-45d5-b401-a30316fc21f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:02.066857 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 25/48] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:02.085089 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdec5ca-3742-4e4e-a288-cf702102c8a0 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:02.085449 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdec5ca-3742-4e4e-a288-cf702102c8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:02.085736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdec5ca-3742-4e4e-a288-cf702102c8a0 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:02.087772 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 24/49] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:02.090736 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce12c2-b16b-45d5-b401-a30316fc21f1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:02.094739 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a30eb5-a6a9-4b90-aa56-fb34fa4cc684 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:02.095033 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a30eb5-a6a9-4b90-aa56-fb34fa4cc684 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:02.095378 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a30eb5-a6a9-4b90-aa56-fb34fa4cc684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:02.114358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-35a30eb5-a6a9-4b90-aa56-fb34fa4cc684 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:02.115555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-35a30eb5-a6a9-4b90-aa56-fb34fa4cc684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:02.147822 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:02.185121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 25/50] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:44:02.198463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce12c2-b16b-45d5-b401-a30316fc21f1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:02.209058 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a30eb5-a6a9-4b90-aa56-fb34fa4cc684 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:02.232723 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50256210-eddb-49e1-90c9-42e7c331e66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:02.233561 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50256210-eddb-49e1-90c9-42e7c331e66d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:02.234107 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50256210-eddb-49e1-90c9-42e7c331e66d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:02.234963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50256210-eddb-49e1-90c9-42e7c331e66d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:02.239031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:02.245262 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50256210-eddb-49e1-90c9-42e7c331e66d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:02.250457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-50256210-eddb-49e1-90c9-42e7c331e66d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:02.250457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:02.250457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:02.250457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:02.250457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:02.250457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:02.250457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:02.250457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:02.250457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:02.250457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:02.250457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:02.250457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:02.250457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:02.250457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:02.250457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:02.250457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:02.251323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:02.251323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:02.251323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:02.251323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:02.251323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:02.251323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:02.251323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:02.251323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:02.251323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:02.251323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:02.251323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:02.251323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:02.251323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:02.251323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:02.251323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:02.251323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:02.252067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:02.252067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:02.252067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:02.252067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:02.252067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:02.252067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:02.252067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:02.252067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:02.252067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:02.252067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:02.252067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:02.252067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:02.252067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 26/51] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:44:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:02.257939 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50256210-eddb-49e1-90c9-42e7c331e66d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:02.309471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a30eb5-a6a9-4b90-aa56-fb34fa4cc684 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:02.346539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee845f46-2994-48bc-8e60-df66ad69a547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:02.347201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee845f46-2994-48bc-8e60-df66ad69a547 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:02.347489 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee845f46-2994-48bc-8e60-df66ad69a547 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:02.347772 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee845f46-2994-48bc-8e60-df66ad69a547 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:02.348979 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee845f46-2994-48bc-8e60-df66ad69a547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:02.351005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee845f46-2994-48bc-8e60-df66ad69a547 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:02.352605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 26/52] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:44:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:02.357810 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50256210-eddb-49e1-90c9-42e7c331e66d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:02.358148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee845f46-2994-48bc-8e60-df66ad69a547 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:02.368785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:02.392547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53222510-738b-4799-855d-cdf301546c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:02.393205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53222510-738b-4799-855d-cdf301546c8b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:02.393497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53222510-738b-4799-855d-cdf301546c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:02.393782 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53222510-738b-4799-855d-cdf301546c8b None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:02.394510 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53222510-738b-4799-855d-cdf301546c8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:02.394826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53222510-738b-4799-855d-cdf301546c8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:02.396238 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53222510-738b-4799-855d-cdf301546c8b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:02.416854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 27/53] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:02.422538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53222510-738b-4799-855d-cdf301546c8b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:02.455959 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:02.458951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee845f46-2994-48bc-8e60-df66ad69a547 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:02.493127 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c9426-1abc-454e-8294-aedeacc92dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:02.493964 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c9426-1abc-454e-8294-aedeacc92dc0 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:02.494404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c9426-1abc-454e-8294-aedeacc92dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:02.495029 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c9426-1abc-454e-8294-aedeacc92dc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:02.495727 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c9426-1abc-454e-8294-aedeacc92dc0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:02.497244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c9426-1abc-454e-8294-aedeacc92dc0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:02.523906 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53222510-738b-4799-855d-cdf301546c8b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:02.557750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452277e-7e08-4252-b847-b08dfd113328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:02.558431 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452277e-7e08-4252-b847-b08dfd113328 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:02.558716 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452277e-7e08-4252-b847-b08dfd113328 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:02.558995 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452277e-7e08-4252-b847-b08dfd113328 None admin] PATH_INFO: `/v3/users/f7723740b021455a9d6a17442f071bca` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:02.560264 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452277e-7e08-4252-b847-b08dfd113328 None admin] RBAC: Authorizing `identity:get_user(user_id=f7723740b021455a9d6a17442f071bca)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:02.561781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452277e-7e08-4252-b847-b08dfd113328 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:02.563375 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 28/54] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:02 2022] GET /identity/v3/users/f7723740b021455a9d6a17442f071bca => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:02.569807 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452277e-7e08-4252-b847-b08dfd113328 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:02.610000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:02.634962 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 27/55] 10.222.0.75 () {60 vars in 1140 bytes} [Thu Jul 28 17:44:02 2022] POST /identity/v3/projects => generated 298 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:44:02.673539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452277e-7e08-4252-b847-b08dfd113328 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:02.711853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc9967-69f6-482a-b6c8-fc9746d102b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:02.712524 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc9967-69f6-482a-b6c8-fc9746d102b8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:02.712837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc9967-69f6-482a-b6c8-fc9746d102b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:02.713117 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc9967-69f6-482a-b6c8-fc9746d102b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:02.714336 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc9967-69f6-482a-b6c8-fc9746d102b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:02.715842 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc9967-69f6-482a-b6c8-fc9746d102b8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:02.717668 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 29/56] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:44:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:02.723682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c9426-1abc-454e-8294-aedeacc92dc0 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:02.831662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c9426-1abc-454e-8294-aedeacc92dc0 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:02.865364 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e8ab8-0285-492c-bb7b-93110f2b829e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:02.869805 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e8ab8-0285-492c-bb7b-93110f2b829e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:02.869805 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e8ab8-0285-492c-bb7b-93110f2b829e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:02.869805 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e8ab8-0285-492c-bb7b-93110f2b829e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:02.869805 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e8ab8-0285-492c-bb7b-93110f2b829e None admin] RBAC: Adding query filter params (role.id=d371062e071845ffa4570a76d40dff88, scope.domain.id=default, user.id=f7723740b021455a9d6a17442f071bca) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:02.869805 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e8ab8-0285-492c-bb7b-93110f2b829e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:02.869805 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e8ab8-0285-492c-bb7b-93110f2b829e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:02.875587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 28/57] 10.222.0.75 () {56 vars in 1322 bytes} [Thu Jul 28 17:44:02 2022] GET /identity/v3/role_assignments?user.id=f7723740b021455a9d6a17442f071bca&scope.domain.id=default&role.id=d371062e071845ffa4570a76d40dff88 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:04.716384 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e7143-1763-41f6-a4f0-108d305542a4 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:04.717002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e7143-1763-41f6-a4f0-108d305542a4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:04.717002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e7143-1763-41f6-a4f0-108d305542a4 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:04.718361 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 30/58] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:04.723656 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d5ec3-b204-4816-910d-7bcbb5bd2e28 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:04.724059 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d5ec3-b204-4816-910d-7bcbb5bd2e28 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:04.724222 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d5ec3-b204-4816-910d-7bcbb5bd2e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:04.742597 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-5a5d5ec3-b204-4816-910d-7bcbb5bd2e28 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:04.743805 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5a5d5ec3-b204-4816-910d-7bcbb5bd2e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:04.754251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:04.808492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 29/59] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:04.833243 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e7143-1763-41f6-a4f0-108d305542a4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:04.934181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e7143-1763-41f6-a4f0-108d305542a4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:04.942846 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:04.966939 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d23dad-7de7-4dec-b66a-8cc868ef8bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:04.967537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d23dad-7de7-4dec-b66a-8cc868ef8bfa None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:04.967820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d23dad-7de7-4dec-b66a-8cc868ef8bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:04.968098 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d23dad-7de7-4dec-b66a-8cc868ef8bfa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:04.969297 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d23dad-7de7-4dec-b66a-8cc868ef8bfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:04.970817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d23dad-7de7-4dec-b66a-8cc868ef8bfa None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:04.972406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 31/60] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:44:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:04.978625 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d5ec3-b204-4816-910d-7bcbb5bd2e28 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:05.079608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d5ec3-b204-4816-910d-7bcbb5bd2e28 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:05.117282 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d8596-ca6d-4520-b561-988ed74eb111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:05.117916 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d8596-ca6d-4520-b561-988ed74eb111 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:05.118210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d8596-ca6d-4520-b561-988ed74eb111 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:05.118490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d8596-ca6d-4520-b561-988ed74eb111 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:05.119188 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d8596-ca6d-4520-b561-988ed74eb111 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:05.120688 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d8596-ca6d-4520-b561-988ed74eb111 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:05.208336 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 30/61] 10.222.0.75 () {60 vars in 1132 bytes} [Thu Jul 28 17:44:04 2022] POST /identity/v3/users => generated 275 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:44:08.353600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedafb2-f349-457e-bfce-0e4a9cc4e1bc None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:08.354481 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedafb2-f349-457e-bfce-0e4a9cc4e1bc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:08.354961 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedafb2-f349-457e-bfce-0e4a9cc4e1bc None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:08.356524 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 32/62] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:08.361821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2627-9dc0-4517-9e89-af11380926cc None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:08.362670 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2627-9dc0-4517-9e89-af11380926cc None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:08.363159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2627-9dc0-4517-9e89-af11380926cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:08.376188 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:08.393828 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-830a2627-9dc0-4517-9e89-af11380926cc None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:08.395380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-830a2627-9dc0-4517-9e89-af11380926cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:08.427756 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c322a-64c9-481c-b98e-4da6b157c88b None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:08.428396 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c322a-64c9-481c-b98e-4da6b157c88b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:08.428880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c322a-64c9-481c-b98e-4da6b157c88b None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:08.430399 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 33/63] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:44:08.435383 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9af964-32e3-4904-a659-7200dbca8766 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:08.435717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9af964-32e3-4904-a659-7200dbca8766 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:08.435958 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9af964-32e3-4904-a659-7200dbca8766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:08.465095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ec9af964-32e3-4904-a659-7200dbca8766 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:08.466312 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ec9af964-32e3-4904-a659-7200dbca8766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:08.528919 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 31/64] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:08.552249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a2627-9dc0-4517-9e89-af11380926cc None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:08.616901 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 34/65] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:44:08.669112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9af964-32e3-4904-a659-7200dbca8766 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:08.677646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a2627-9dc0-4517-9e89-af11380926cc None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:08.719656 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64be86-d4ba-4cd6-ae7d-e4799521edcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:08.720325 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64be86-d4ba-4cd6-ae7d-e4799521edcc None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:08.720613 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64be86-d4ba-4cd6-ae7d-e4799521edcc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:08.720946 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64be86-d4ba-4cd6-ae7d-e4799521edcc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:08.725089 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:08.734991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64be86-d4ba-4cd6-ae7d-e4799521edcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:08.741926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-7f64be86-d4ba-4cd6-ae7d-e4799521edcc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:08.741926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:08.741926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:08.741926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:08.741926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:08.741926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:08.741926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:08.741926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:08.741926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:08.741926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:08.741926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:08.741926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:08.741926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:08.741926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:08.741926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:08.741926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:08.742788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:08.742788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:08.742788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:08.742788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:08.742788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:08.742788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:08.742788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:08.742788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:08.742788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:08.742788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:08.742788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:08.742788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:08.742788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:08.742788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:08.742788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:08.742788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:08.743545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:08.743545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:08.743545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:08.743545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:08.743545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:08.743545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:08.743545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:08.743545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:08.743545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:08.743545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:08.743545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:08.743545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:08.746314 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 32/66] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:44:08.749954 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a0d44-d183-4524-a249-364d2b37b000 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:08.750415 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a0d44-d183-4524-a249-364d2b37b000 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:08.751001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a0d44-d183-4524-a249-364d2b37b000 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:08.753142 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 33/67] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:08.754034 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a0d44-d183-4524-a249-364d2b37b000 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:08.800605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9af964-32e3-4904-a659-7200dbca8766 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:08.809944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:08.836937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7624c-2c2d-46a0-88e9-7b30888422fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:08.837595 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7624c-2c2d-46a0-88e9-7b30888422fb None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:08.837886 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7624c-2c2d-46a0-88e9-7b30888422fb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:08.838166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7624c-2c2d-46a0-88e9-7b30888422fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:08.850474 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7624c-2c2d-46a0-88e9-7b30888422fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:08.855484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-0bf7624c-2c2d-46a0-88e9-7b30888422fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:08.855484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:08.855484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:08.855484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:08.855484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:08.855484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:08.855484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:08.855484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:08.855484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:08.855484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:08.855484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:08.855484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:08.855484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:08.855484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:08.855484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:08.855484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:08.856339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:08.856339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:08.856339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:08.856339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:08.856339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:08.856339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:08.856339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:08.856339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:08.856339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:08.856339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:08.856339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:08.856339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:08.856339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:08.856339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:08.856339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:08.856339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:08.857141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:08.857141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:08.857141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:08.857141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:08.857141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:08.857141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:08.857141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:08.857141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:08.857141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:08.857141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:08.857141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:08.857141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:08.857141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 35/68] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:44:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:44:08.858193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55cd69-ddde-4f46-9b4f-7e1db6fd1733 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:08.858193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55cd69-ddde-4f46-9b4f-7e1db6fd1733 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:08.858469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55cd69-ddde-4f46-9b4f-7e1db6fd1733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:08.874581 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a0d44-d183-4524-a249-364d2b37b000 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:08.877436 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-cf55cd69-ddde-4f46-9b4f-7e1db6fd1733 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:08.878582 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cf55cd69-ddde-4f46-9b4f-7e1db6fd1733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:08.909457 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93af07d-23ab-4bfb-a4d8-d40ab95ca6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:08.910091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93af07d-23ab-4bfb-a4d8-d40ab95ca6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:08.910378 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93af07d-23ab-4bfb-a4d8-d40ab95ca6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:08.910655 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93af07d-23ab-4bfb-a4d8-d40ab95ca6e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:08.911379 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93af07d-23ab-4bfb-a4d8-d40ab95ca6e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:08.911688 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93af07d-23ab-4bfb-a4d8-d40ab95ca6e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:08.913673 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93af07d-23ab-4bfb-a4d8-d40ab95ca6e9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:08.926842 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 34/69] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:08.926842 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008a3ee-9e17-4493-ab52-1f644159e3bb None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:08.926842 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008a3ee-9e17-4493-ab52-1f644159e3bb None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:08.926842 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008a3ee-9e17-4493-ab52-1f644159e3bb None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:08.926842 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 35/70] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:08.926842 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008a3ee-9e17-4493-ab52-1f644159e3bb None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:08.958585 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 36/71] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:08.966886 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55cd69-ddde-4f46-9b4f-7e1db6fd1733 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:08.988423 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:09.036117 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008a3ee-9e17-4493-ab52-1f644159e3bb None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:09.071393 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cf04c-fe4b-4ce7-b998-76cd665f0c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:09.072021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cf04c-fe4b-4ce7-b998-76cd665f0c90 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:09.072307 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cf04c-fe4b-4ce7-b998-76cd665f0c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:09.072585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cf04c-fe4b-4ce7-b998-76cd665f0c90 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:09.073341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cf04c-fe4b-4ce7-b998-76cd665f0c90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:09.073661 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cf04c-fe4b-4ce7-b998-76cd665f0c90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:09.075091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cf04c-fe4b-4ce7-b998-76cd665f0c90 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:09.084107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 36/72] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:09.085435 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314cd88-96fa-4093-95c1-b4be44da75b5 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:09.085734 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314cd88-96fa-4093-95c1-b4be44da75b5 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:09.086020 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314cd88-96fa-4093-95c1-b4be44da75b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:09.089985 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:09.095725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55cd69-ddde-4f46-9b4f-7e1db6fd1733 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:09.104648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e314cd88-96fa-4093-95c1-b4be44da75b5 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:09.105882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e314cd88-96fa-4093-95c1-b4be44da75b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:09.131122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96955063-bbf1-4fed-b062-6e4168bfb455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:09.131716 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96955063-bbf1-4fed-b062-6e4168bfb455 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:09.131998 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96955063-bbf1-4fed-b062-6e4168bfb455 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:09.132282 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96955063-bbf1-4fed-b062-6e4168bfb455 None admin] PATH_INFO: `/v3/users/5ebb75ff475d457cb684829880a3d01e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:09.147258 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96955063-bbf1-4fed-b062-6e4168bfb455 None admin] RBAC: Authorizing `identity:get_user(user_id=5ebb75ff475d457cb684829880a3d01e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:09.148720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96955063-bbf1-4fed-b062-6e4168bfb455 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:09.150418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 37/73] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:08 2022] GET /identity/v3/users/5ebb75ff475d457cb684829880a3d01e => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:09.151190 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96955063-bbf1-4fed-b062-6e4168bfb455 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:09.173616 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 37/74] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:09.182208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04f4b2-a521-47f7-abed-49d51e676c9d None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:09.182505 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04f4b2-a521-47f7-abed-49d51e676c9d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:09.182795 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04f4b2-a521-47f7-abed-49d51e676c9d None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:09.184103 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 38/75] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:09.185608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04f4b2-a521-47f7-abed-49d51e676c9d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:09.235928 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:09.260992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96955063-bbf1-4fed-b062-6e4168bfb455 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:09.289097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04f4b2-a521-47f7-abed-49d51e676c9d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:09.296799 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f99ea-805c-4ba0-ae9d-814292ac4c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:09.297447 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f99ea-805c-4ba0-ae9d-814292ac4c6d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:09.297746 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f99ea-805c-4ba0-ae9d-814292ac4c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:09.298015 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f99ea-805c-4ba0-ae9d-814292ac4c6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:09.308355 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f99ea-805c-4ba0-ae9d-814292ac4c6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:09.314497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-279f99ea-805c-4ba0-ae9d-814292ac4c6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:09.314497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:09.314497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:09.314497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:09.314497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:09.314497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:09.314497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:09.314497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:09.314497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:09.314497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:09.314497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:09.314497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:09.314497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:09.314497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:09.314497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:09.314497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:09.315339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:09.315339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:09.315339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:09.315339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:09.315339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:09.315339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:09.315339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:09.315339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:09.315339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:09.315339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:09.315339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:09.315339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:09.315339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:09.315339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:09.315339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:09.315339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:09.316185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:09.316185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:09.316185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:09.316185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:09.316185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:09.316185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:09.316185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:09.316185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:09.316185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:09.316185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:09.316185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:09.316185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:09.316185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 38/76] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:09.316841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f99ea-805c-4ba0-ae9d-814292ac4c6d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:09.326148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deed49d-e700-4ff3-a244-b9a38660c2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:09.326800 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deed49d-e700-4ff3-a244-b9a38660c2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:09.327364 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deed49d-e700-4ff3-a244-b9a38660c2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:09.327648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deed49d-e700-4ff3-a244-b9a38660c2a7 None admin] PATH_INFO: `/v3/users/f7723740b021455a9d6a17442f071bca` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:09.328854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deed49d-e700-4ff3-a244-b9a38660c2a7 None admin] RBAC: Authorizing `identity:get_user(user_id=f7723740b021455a9d6a17442f071bca)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:09.330344 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deed49d-e700-4ff3-a244-b9a38660c2a7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:09.331659 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:09.337177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 39/77] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:09 2022] GET /identity/v3/users/f7723740b021455a9d6a17442f071bca => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:09.337177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd97eae-4033-4d40-9f03-9929377efa4b None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:09.337177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd97eae-4033-4d40-9f03-9929377efa4b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:09.337177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd97eae-4033-4d40-9f03-9929377efa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:09.354196 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-abd97eae-4033-4d40-9f03-9929377efa4b None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:09.355401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-abd97eae-4033-4d40-9f03-9929377efa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:09.424558 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f99ea-805c-4ba0-ae9d-814292ac4c6d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:09.429118 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 40/78] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:09.430432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd97eae-4033-4d40-9f03-9929377efa4b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:09.466612 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae7801-f122-4288-8611-b1f363fa3e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:09.467241 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae7801-f122-4288-8611-b1f363fa3e9a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:09.467524 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae7801-f122-4288-8611-b1f363fa3e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:09.467800 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae7801-f122-4288-8611-b1f363fa3e9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:09.475525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:09.529497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd97eae-4033-4d40-9f03-9929377efa4b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:09.535318 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae7801-f122-4288-8611-b1f363fa3e9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:09.536826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae7801-f122-4288-8611-b1f363fa3e9a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:09.551391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:09.564274 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb2744-fe8b-4cb5-bf47-7218c2c753d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:09.564951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb2744-fe8b-4cb5-bf47-7218c2c753d3 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:09.565235 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb2744-fe8b-4cb5-bf47-7218c2c753d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:09.565520 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb2744-fe8b-4cb5-bf47-7218c2c753d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:09.575984 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb2744-fe8b-4cb5-bf47-7218c2c753d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:09.581054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-6fbb2744-fe8b-4cb5-bf47-7218c2c753d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:09.581054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:09.581054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:09.581054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:09.581054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:09.581054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:09.581054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:09.581054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:09.581054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:09.581054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:09.581054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:09.581054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:09.581054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:09.581054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:09.581054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:09.581054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:09.581888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:09.581888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:09.581888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:09.581888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:09.581888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:09.581888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:09.581888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:09.581888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:09.581888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:09.581888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:09.581888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:09.581888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:09.581888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:09.581888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:09.581888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:09.581888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:09.588051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:09.588051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:09.588051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:09.588051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:09.588051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:09.588051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:09.588051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:09.588051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:09.588051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:09.588051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:09.588051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:09.588051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:09.588051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 41/79] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:44:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:09.588051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb2744-fe8b-4cb5-bf47-7218c2c753d3 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:09.636781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 39/80] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:09.637532 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae7801-f122-4288-8611-b1f363fa3e9a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:09.688931 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb2744-fe8b-4cb5-bf47-7218c2c753d3 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:09.691109 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:09.721823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bfe0f-f64c-40b3-b9f9-cdd8477b8fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:09.722456 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bfe0f-f64c-40b3-b9f9-cdd8477b8fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:09.722744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bfe0f-f64c-40b3-b9f9-cdd8477b8fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:09.723023 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bfe0f-f64c-40b3-b9f9-cdd8477b8fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:09.723759 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bfe0f-f64c-40b3-b9f9-cdd8477b8fc9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:09.724331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bfe0f-f64c-40b3-b9f9-cdd8477b8fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:09.726847 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bfe0f-f64c-40b3-b9f9-cdd8477b8fc9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:09.735877 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 42/81] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:09.736659 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bfe0f-f64c-40b3-b9f9-cdd8477b8fc9 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:09.743922 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae7801-f122-4288-8611-b1f363fa3e9a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:09.758311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:09.777518 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb3249-3607-4064-bfd5-3b6f52922a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:09.778400 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb3249-3607-4064-bfd5-3b6f52922a2e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:09.778700 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb3249-3607-4064-bfd5-3b6f52922a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:09.779065 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb3249-3607-4064-bfd5-3b6f52922a2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:09.833648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bfe0f-f64c-40b3-b9f9-cdd8477b8fc9 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:09.845275 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb3249-3607-4064-bfd5-3b6f52922a2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:09.846788 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb3249-3607-4064-bfd5-3b6f52922a2e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:09.867192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aca743-f66e-46a7-9b4a-2d9189442021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:09.867844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aca743-f66e-46a7-9b4a-2d9189442021 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:09.868130 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aca743-f66e-46a7-9b4a-2d9189442021 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:09.868408 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aca743-f66e-46a7-9b4a-2d9189442021 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:09.869587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aca743-f66e-46a7-9b4a-2d9189442021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:09.871055 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aca743-f66e-46a7-9b4a-2d9189442021 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:09.872629 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 43/82] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:44:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:09.877446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aca743-f66e-46a7-9b4a-2d9189442021 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:09.907994 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:09.949548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 40/83] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:09.950104 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb3249-3607-4064-bfd5-3b6f52922a2e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:09.966407 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:09.973315 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aca743-f66e-46a7-9b4a-2d9189442021 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:10.006919 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e13156-8c85-4f63-b21b-3d839f35a8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:10.007544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e13156-8c85-4f63-b21b-3d839f35a8ef None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:10.007828 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e13156-8c85-4f63-b21b-3d839f35a8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:10.008109 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e13156-8c85-4f63-b21b-3d839f35a8ef None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:10.008844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e13156-8c85-4f63-b21b-3d839f35a8ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:10.009152 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e13156-8c85-4f63-b21b-3d839f35a8ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:10.010551 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e13156-8c85-4f63-b21b-3d839f35a8ef None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:10.018389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 44/84] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:44:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:10.019018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e13156-8c85-4f63-b21b-3d839f35a8ef None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:10.052519 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb3249-3607-4064-bfd5-3b6f52922a2e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:10.087193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e88ce-c6ac-4b47-a255-bbcd15af4214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:10.087829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e88ce-c6ac-4b47-a255-bbcd15af4214 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:10.088109 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e88ce-c6ac-4b47-a255-bbcd15af4214 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:10.088383 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e88ce-c6ac-4b47-a255-bbcd15af4214 None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:10.089572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e88ce-c6ac-4b47-a255-bbcd15af4214 None admin] RBAC: Authorizing `identity:get_project(project_id=005e84bc135b44f088d0ad047d11daf7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:10.091023 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e88ce-c6ac-4b47-a255-bbcd15af4214 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:10.092829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 41/85] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:09 2022] GET /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:10.093567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e88ce-c6ac-4b47-a255-bbcd15af4214 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:10.117722 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:10.123126 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e13156-8c85-4f63-b21b-3d839f35a8ef None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:10.155889 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057bb33d-de2e-46e8-9c4a-fc94e2ed69cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:10.156534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bb33d-de2e-46e8-9c4a-fc94e2ed69cf None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:10.156837 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bb33d-de2e-46e8-9c4a-fc94e2ed69cf None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:10.157116 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bb33d-de2e-46e8-9c4a-fc94e2ed69cf None admin] PATH_INFO: `/v3/users/5ebb75ff475d457cb684829880a3d01e` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:10.158277 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057bb33d-de2e-46e8-9c4a-fc94e2ed69cf None admin] RBAC: Authorizing `identity:get_user(user_id=5ebb75ff475d457cb684829880a3d01e)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:10.159755 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057bb33d-de2e-46e8-9c4a-fc94e2ed69cf None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:10.161392 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 45/86] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:10 2022] GET /identity/v3/users/5ebb75ff475d457cb684829880a3d01e => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:10.162233 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057bb33d-de2e-46e8-9c4a-fc94e2ed69cf None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:10.173000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:10.192045 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e88ce-c6ac-4b47-a255-bbcd15af4214 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:10.226331 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5ca3d-fe94-4e6c-98df-9a9e1e86bb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:10.226892 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5ca3d-fe94-4e6c-98df-9a9e1e86bb57 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:10.227179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5ca3d-fe94-4e6c-98df-9a9e1e86bb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:10.227467 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5ca3d-fe94-4e6c-98df-9a9e1e86bb57 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:10.228157 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5ca3d-fe94-4e6c-98df-9a9e1e86bb57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:10.229642 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5ca3d-fe94-4e6c-98df-9a9e1e86bb57 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:10.263489 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057bb33d-de2e-46e8-9c4a-fc94e2ed69cf None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:10.296462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8108616-5544-4c5c-a7d4-d31af30213d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:10.297135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8108616-5544-4c5c-a7d4-d31af30213d7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:10.297417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8108616-5544-4c5c-a7d4-d31af30213d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:10.297694 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8108616-5544-4c5c-a7d4-d31af30213d7 None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:10.298861 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8108616-5544-4c5c-a7d4-d31af30213d7 None admin] RBAC: Authorizing `identity:get_project(project_id=005e84bc135b44f088d0ad047d11daf7)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:10.300330 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8108616-5544-4c5c-a7d4-d31af30213d7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:10.302017 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 46/87] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:10 2022] GET /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:10.303469 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8108616-5544-4c5c-a7d4-d31af30213d7 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:10.318968 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 42/88] 10.222.0.75 () {60 vars in 1132 bytes} [Thu Jul 28 17:44:10 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:44:10.319804 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5ca3d-fe94-4e6c-98df-9a9e1e86bb57 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:10.358262 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:10.437061 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5ca3d-fe94-4e6c-98df-9a9e1e86bb57 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:10.438602 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8108616-5544-4c5c-a7d4-d31af30213d7 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:10.475542 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d5a79-112c-4ec2-be59-249c735ef278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:10.476206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d5a79-112c-4ec2-be59-249c735ef278 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:10.476542 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d5a79-112c-4ec2-be59-249c735ef278 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:10.476789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d5a79-112c-4ec2-be59-249c735ef278 None admin] PATH_INFO: `/v3/users/5ebb75ff475d457cb684829880a3d01e` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:10.479206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d5a79-112c-4ec2-be59-249c735ef278 None admin] RBAC: Authorizing `identity:get_user(user_id=5ebb75ff475d457cb684829880a3d01e)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:10.480126 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4e22b-b69f-49ac-98fc-10b9c0f9e9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:10.480240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d5a79-112c-4ec2-be59-249c735ef278 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:10.480786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4e22b-b69f-49ac-98fc-10b9c0f9e9aa None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:10.481073 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4e22b-b69f-49ac-98fc-10b9c0f9e9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:10.481354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4e22b-b69f-49ac-98fc-10b9c0f9e9aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:10.482158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4e22b-b69f-49ac-98fc-10b9c0f9e9aa None admin] RBAC: Adding query filter params (role.id=279c255613df457cb2d5d9904dd6f12a, scope.project.id=005e84bc135b44f088d0ad047d11daf7, user.id=5ebb75ff475d457cb684829880a3d01e) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:10.482479 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4e22b-b69f-49ac-98fc-10b9c0f9e9aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:10.483479 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 47/89] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:10 2022] GET /identity/v3/users/5ebb75ff475d457cb684829880a3d01e => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:10.483642 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d5a79-112c-4ec2-be59-249c735ef278 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:10.483963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4e22b-b69f-49ac-98fc-10b9c0f9e9aa None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:10.494503 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 43/90] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:44:10 2022] GET /identity/v3/role_assignments?user.id=5ebb75ff475d457cb684829880a3d01e&scope.project.id=005e84bc135b44f088d0ad047d11daf7&role.id=279c255613df457cb2d5d9904dd6f12a => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:10.494503 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4e22b-b69f-49ac-98fc-10b9c0f9e9aa None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:10.497044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:10.607559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:10.610144 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d5a79-112c-4ec2-be59-249c735ef278 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:10.649425 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1002d-7006-49ba-960b-41581d3f3682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:10.650411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1002d-7006-49ba-960b-41581d3f3682 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:10.650925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1002d-7006-49ba-960b-41581d3f3682 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:10.651407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1002d-7006-49ba-960b-41581d3f3682 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:10.717379 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4e22b-b69f-49ac-98fc-10b9c0f9e9aa None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:10.758803 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1002d-7006-49ba-960b-41581d3f3682 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:10.759581 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f30f08-8e1a-4c77-8a2d-5dcb89a297cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:10.760227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1002d-7006-49ba-960b-41581d3f3682 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:10.760629 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f30f08-8e1a-4c77-8a2d-5dcb89a297cc None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:10.761111 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f30f08-8e1a-4c77-8a2d-5dcb89a297cc None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:10.761564 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f30f08-8e1a-4c77-8a2d-5dcb89a297cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:10.762656 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f30f08-8e1a-4c77-8a2d-5dcb89a297cc None admin] RBAC: Adding query filter params (role.id=d371062e071845ffa4570a76d40dff88, scope.project.id=005e84bc135b44f088d0ad047d11daf7, user.id=f7723740b021455a9d6a17442f071bca) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:10.763217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f30f08-8e1a-4c77-8a2d-5dcb89a297cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:10.765714 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f30f08-8e1a-4c77-8a2d-5dcb89a297cc None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:10.772311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 44/91] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:44:10 2022] GET /identity/v3/role_assignments?user.id=f7723740b021455a9d6a17442f071bca&scope.project.id=005e84bc135b44f088d0ad047d11daf7&role.id=d371062e071845ffa4570a76d40dff88 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:10.773502 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f30f08-8e1a-4c77-8a2d-5dcb89a297cc None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:10.916231 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:10.948067 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:10.954656 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 48/92] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:10.961219 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1002d-7006-49ba-960b-41581d3f3682 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:10.989789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f30f08-8e1a-4c77-8a2d-5dcb89a297cc None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:11.053252 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282dd7f-706e-423b-9127-a8cdcb356a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:11.054228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282dd7f-706e-423b-9127-a8cdcb356a42 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:11.054710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282dd7f-706e-423b-9127-a8cdcb356a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:11.055174 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282dd7f-706e-423b-9127-a8cdcb356a42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:11.144801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1002d-7006-49ba-960b-41581d3f3682 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:11.168778 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282dd7f-706e-423b-9127-a8cdcb356a42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:11.170698 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282dd7f-706e-423b-9127-a8cdcb356a42 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:11.250118 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d2450-8290-4c28-8e2a-c0c808a8bbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:11.250788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d2450-8290-4c28-8e2a-c0c808a8bbae None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:11.251074 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d2450-8290-4c28-8e2a-c0c808a8bbae None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:11.251349 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d2450-8290-4c28-8e2a-c0c808a8bbae None admin] PATH_INFO: `/v3/projects/d39929e0334342088d38ef7ad93dacac` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:11.253943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d2450-8290-4c28-8e2a-c0c808a8bbae None admin] RBAC: Authorizing `identity:get_project(project_id=d39929e0334342088d38ef7ad93dacac)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:11.255718 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d2450-8290-4c28-8e2a-c0c808a8bbae None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:11.261044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 49/93] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:10 2022] GET /identity/v3/projects/d39929e0334342088d38ef7ad93dacac => generated 312 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:11.269813 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d2450-8290-4c28-8e2a-c0c808a8bbae None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:11.295958 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:11.380510 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 45/94] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:11.386803 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282dd7f-706e-423b-9127-a8cdcb356a42 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:11.461121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:11.555446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d2450-8290-4c28-8e2a-c0c808a8bbae None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:11.577621 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282dd7f-706e-423b-9127-a8cdcb356a42 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:11.627621 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7823d-d159-4698-a484-c98bf02955fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:11.629937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7823d-d159-4698-a484-c98bf02955fc None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:11.631806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7823d-d159-4698-a484-c98bf02955fc None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:11.632271 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7823d-d159-4698-a484-c98bf02955fc None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:11.633766 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7823d-d159-4698-a484-c98bf02955fc None admin] RBAC: Authorizing `identity:get_project(project_id=005e84bc135b44f088d0ad047d11daf7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:11.636659 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7823d-d159-4698-a484-c98bf02955fc None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:11.639484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 46/95] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:11 2022] GET /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:11.648136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218884e-495b-41d3-9276-bfa3fe89b97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:11.648971 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7823d-d159-4698-a484-c98bf02955fc None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:11.649794 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218884e-495b-41d3-9276-bfa3fe89b97a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:11.650638 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218884e-495b-41d3-9276-bfa3fe89b97a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:11.651117 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218884e-495b-41d3-9276-bfa3fe89b97a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:11.654427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218884e-495b-41d3-9276-bfa3fe89b97a None admin] RBAC: Adding query filter params (role.id=279c255613df457cb2d5d9904dd6f12a, scope.project.id=d39929e0334342088d38ef7ad93dacac, user.id=5ebb75ff475d457cb684829880a3d01e) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:11.654937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218884e-495b-41d3-9276-bfa3fe89b97a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:11.656593 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218884e-495b-41d3-9276-bfa3fe89b97a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:11.669579 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 50/96] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:44:11 2022] GET /identity/v3/role_assignments?user.id=5ebb75ff475d457cb684829880a3d01e&scope.project.id=d39929e0334342088d38ef7ad93dacac&role.id=279c255613df457cb2d5d9904dd6f12a => generated 259 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:11.726826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:11.797453 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7823d-d159-4698-a484-c98bf02955fc None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:11.851189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce28c8-fd2b-4974-ae19-d0b35568aea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:11.851846 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce28c8-fd2b-4974-ae19-d0b35568aea4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:11.852126 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce28c8-fd2b-4974-ae19-d0b35568aea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:11.852397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce28c8-fd2b-4974-ae19-d0b35568aea4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:11.853233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce28c8-fd2b-4974-ae19-d0b35568aea4 None admin] RBAC: Adding query filter params (role.id=e2024b6eae3d49f09caa7d4275eb88bc, scope.project.id=005e84bc135b44f088d0ad047d11daf7, user.id=5ebb75ff475d457cb684829880a3d01e) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:11.853546 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce28c8-fd2b-4974-ae19-d0b35568aea4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:11.854996 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce28c8-fd2b-4974-ae19-d0b35568aea4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:11.871085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 47/97] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:44:11 2022] GET /identity/v3/role_assignments?user.id=5ebb75ff475d457cb684829880a3d01e&scope.project.id=005e84bc135b44f088d0ad047d11daf7&role.id=e2024b6eae3d49f09caa7d4275eb88bc => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:13.135701 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90870b2-8a14-4573-97ef-8d93e6748f04 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:13.136883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90870b2-8a14-4573-97ef-8d93e6748f04 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:13.137395 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90870b2-8a14-4573-97ef-8d93e6748f04 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:13.139060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 51/98] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:13.146825 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2c645-d757-4dc5-8185-6fa3a086e9cb None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:13.147077 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fcde2-e4c8-4498-a1cf-4a2bf73e7bb3 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:13.147573 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fcde2-e4c8-4498-a1cf-4a2bf73e7bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:13.147573 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fcde2-e4c8-4498-a1cf-4a2bf73e7bb3 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:13.148215 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2c645-d757-4dc5-8185-6fa3a086e9cb None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:13.148705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2c645-d757-4dc5-8185-6fa3a086e9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:13.148947 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 48/99] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:13.166228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10a2d4-7430-491f-bd0a-747ba0992854 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:13.166853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10a2d4-7430-491f-bd0a-747ba0992854 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:13.167342 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10a2d4-7430-491f-bd0a-747ba0992854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:13.178537 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-60a2c645-d757-4dc5-8185-6fa3a086e9cb None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:13.179891 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-60a2c645-d757-4dc5-8185-6fa3a086e9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:13.206106 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-cd10a2d4-7430-491f-bd0a-747ba0992854 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:13.207693 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cd10a2d4-7430-491f-bd0a-747ba0992854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:13.282300 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 52/100] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:13.314476 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2c645-d757-4dc5-8185-6fa3a086e9cb None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:13.431051 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 49/101] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:44:13.460078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:13.465147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10a2d4-7430-491f-bd0a-747ba0992854 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:13.524181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:13.529907 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2c645-d757-4dc5-8185-6fa3a086e9cb None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:13.630000 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0d0a4-77be-4b51-9ead-f8006af1df5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:13.630700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0d0a4-77be-4b51-9ead-f8006af1df5c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:13.631016 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0d0a4-77be-4b51-9ead-f8006af1df5c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:13.631260 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0d0a4-77be-4b51-9ead-f8006af1df5c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:13.652377 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0d0a4-77be-4b51-9ead-f8006af1df5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:13.658923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-27a0d0a4-77be-4b51-9ead-f8006af1df5c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:44:13.658923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:13.658923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:13.658923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:13.658923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:13.658923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:13.658923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:13.658923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:13.658923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:13.658923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:13.658923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:13.658923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:13.658923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:13.658923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:13.658923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:13.658923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:13.659801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:13.659801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:13.659801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:13.659801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:13.659801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:13.659801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:13.659801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:13.659801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:13.659801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:13.659801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:13.659801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:13.659801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:13.659801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:13.659801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:13.659801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:13.659801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:13.660587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:13.660587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:13.660587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:13.660587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:13.660587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:13.660587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:13.660587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:13.660587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:13.660587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:13.660587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:13.660587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:44:13.660587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:13.667664 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 53/102] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:44:13.673493 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0d0a4-77be-4b51-9ead-f8006af1df5c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:13.738930 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10a2d4-7430-491f-bd0a-747ba0992854 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:13.798377 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0d0a4-77be-4b51-9ead-f8006af1df5c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:13.825918 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:13.842625 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bd09b-82ad-4bea-a06c-2b5737595023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:13.843273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bd09b-82ad-4bea-a06c-2b5737595023 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:13.843561 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bd09b-82ad-4bea-a06c-2b5737595023 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:13.843840 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bd09b-82ad-4bea-a06c-2b5737595023 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:13.844574 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bd09b-82ad-4bea-a06c-2b5737595023 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:13.844919 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bd09b-82ad-4bea-a06c-2b5737595023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:13.846467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bd09b-82ad-4bea-a06c-2b5737595023 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:13.863390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 54/103] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:13.866030 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07e34e-c11b-4970-af5f-b80a358e109d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:13.866711 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07e34e-c11b-4970-af5f-b80a358e109d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:13.867000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07e34e-c11b-4970-af5f-b80a358e109d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:13.867284 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07e34e-c11b-4970-af5f-b80a358e109d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:13.869015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bd09b-82ad-4bea-a06c-2b5737595023 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:13.899843 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07e34e-c11b-4970-af5f-b80a358e109d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:13.905259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-6e07e34e-c11b-4970-af5f-b80a358e109d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:13.905259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:13.905259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:13.905259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:13.905259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:13.905259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:13.905259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:13.905259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:13.905259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:13.905259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:13.905259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:13.905259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:13.905259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:13.905259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:13.905259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:13.905259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:13.906113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:13.906113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:13.906113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:13.906113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:13.906113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:13.906113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:13.906113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:13.906113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:13.906113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:13.906113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:13.906113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:13.906113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:13.906113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:13.906113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:13.906113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:13.906113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:13.906867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:13.906867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:13.906867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:13.906867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:13.906867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:13.906867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:13.906867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:13.906867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:13.906867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:13.906867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:13.906867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:13.906867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:13.909554 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 50/104] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:13.915456 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07e34e-c11b-4970-af5f-b80a358e109d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:14.051823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bd09b-82ad-4bea-a06c-2b5737595023 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:14.073409 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:14.087675 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07e34e-c11b-4970-af5f-b80a358e109d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:14.095946 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91623c0c-6930-4476-bf41-197bf7d1319d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:14.096934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91623c0c-6930-4476-bf41-197bf7d1319d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:14.097426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91623c0c-6930-4476-bf41-197bf7d1319d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:14.098271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91623c0c-6930-4476-bf41-197bf7d1319d None admin] PATH_INFO: `/v3/users/805ae67c835b4cacafbceefc9d591090` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:14.116488 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91623c0c-6930-4476-bf41-197bf7d1319d None admin] RBAC: Authorizing `identity:get_user(user_id=805ae67c835b4cacafbceefc9d591090)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:14.118888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91623c0c-6930-4476-bf41-197bf7d1319d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:14.121567 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 55/105] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:13 2022] GET /identity/v3/users/805ae67c835b4cacafbceefc9d591090 => generated 289 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:14.123052 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b55b0-bd09-468f-8f56-9da081bc5491 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:14.123562 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b55b0-bd09-468f-8f56-9da081bc5491 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:14.124035 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b55b0-bd09-468f-8f56-9da081bc5491 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:14.124969 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018121ec-5009-46a2-b311-37d1bceeb750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:14.125607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018121ec-5009-46a2-b311-37d1bceeb750 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:14.126059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018121ec-5009-46a2-b311-37d1bceeb750 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:14.126242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018121ec-5009-46a2-b311-37d1bceeb750 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:14.126816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 56/106] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:14.127037 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018121ec-5009-46a2-b311-37d1bceeb750 None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:14.127358 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018121ec-5009-46a2-b311-37d1bceeb750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:14.128554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429f44e-1eb6-42fa-bed5-00d5581eb839 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:14.128880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018121ec-5009-46a2-b311-37d1bceeb750 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:14.129270 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429f44e-1eb6-42fa-bed5-00d5581eb839 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:14.129742 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429f44e-1eb6-42fa-bed5-00d5581eb839 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:14.132312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 57/107] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:14.137050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429f44e-1eb6-42fa-bed5-00d5581eb839 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:14.143484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 51/108] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:14.145002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5defd0-63f3-4950-8ad9-44b97bcd8c99 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:14.145297 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5defd0-63f3-4950-8ad9-44b97bcd8c99 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:14.145631 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5defd0-63f3-4950-8ad9-44b97bcd8c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:14.165829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8c5defd0-63f3-4950-8ad9-44b97bcd8c99 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:14.167046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8c5defd0-63f3-4950-8ad9-44b97bcd8c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:14.198430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:14.244108 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 52/109] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:14.249893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ba852-9f14-4945-adce-766410b9401c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:14.249893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ba852-9f14-4945-adce-766410b9401c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:14.250211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ba852-9f14-4945-adce-766410b9401c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:14.264051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429f44e-1eb6-42fa-bed5-00d5581eb839 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:14.281060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-090ba852-9f14-4945-adce-766410b9401c None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:14.282234 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-090ba852-9f14-4945-adce-766410b9401c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:14.304607 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d13bb-8916-4639-be0c-a3228bbadeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:14.305708 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d13bb-8916-4639-be0c-a3228bbadeeb None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:14.306480 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d13bb-8916-4639-be0c-a3228bbadeeb None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:14.307242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d13bb-8916-4639-be0c-a3228bbadeeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:14.368539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 53/110] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:14.369133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ba852-9f14-4945-adce-766410b9401c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:14.381429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:14.388055 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d13bb-8916-4639-be0c-a3228bbadeeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:14.389974 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d13bb-8916-4639-be0c-a3228bbadeeb None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:14.437454 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:14.477261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ba852-9f14-4945-adce-766410b9401c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:14.499860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 58/111] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:14.501206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d13bb-8916-4639-be0c-a3228bbadeeb None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:14.516137 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9444a41-870d-4e98-bae4-163c257e610f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:14.516983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9444a41-870d-4e98-bae4-163c257e610f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:14.517282 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9444a41-870d-4e98-bae4-163c257e610f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:14.517575 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9444a41-870d-4e98-bae4-163c257e610f None admin] PATH_INFO: `/v3/users/5ebb75ff475d457cb684829880a3d01e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:14.518895 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9444a41-870d-4e98-bae4-163c257e610f None admin] RBAC: Authorizing `identity:get_user(user_id=5ebb75ff475d457cb684829880a3d01e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:14.520457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9444a41-870d-4e98-bae4-163c257e610f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:14.522151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 54/112] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:14 2022] GET /identity/v3/users/5ebb75ff475d457cb684829880a3d01e => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:14.522921 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9444a41-870d-4e98-bae4-163c257e610f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:14.603044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d13bb-8916-4639-be0c-a3228bbadeeb None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:14.603941 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:14.625714 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9444a41-870d-4e98-bae4-163c257e610f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:14.637186 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5e725-1bd0-48a1-ae30-3f00d4121db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:14.637839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5e725-1bd0-48a1-ae30-3f00d4121db2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:14.638145 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5e725-1bd0-48a1-ae30-3f00d4121db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:14.638403 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5e725-1bd0-48a1-ae30-3f00d4121db2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:14.648400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5e725-1bd0-48a1-ae30-3f00d4121db2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:14.653674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-d3b5e725-1bd0-48a1-ae30-3f00d4121db2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:14.653674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:14.653674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:14.653674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:14.653674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:14.653674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:14.653674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:14.653674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:14.653674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:14.653674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:14.653674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:14.653674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:14.653674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:14.653674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:14.653674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:14.653674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:14.654978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:14.654978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:14.654978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:14.654978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:14.654978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:14.654978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:14.654978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:14.654978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:14.654978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:14.654978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:14.654978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:14.654978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:14.654978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:14.654978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:14.654978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:14.654978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:14.655741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:14.655741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:14.655741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:14.655741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:14.655741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:14.655741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:14.655741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:14.655741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:14.655741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:14.655741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:14.655741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:14.655741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:14.655741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 59/113] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:44:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:14.656360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5e725-1bd0-48a1-ae30-3f00d4121db2 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:14.659224 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:14.664664 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bec4d-340f-43c8-ba0c-2924dec0d8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:14.665411 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bec4d-340f-43c8-ba0c-2924dec0d8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:14.672119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bec4d-340f-43c8-ba0c-2924dec0d8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:14.672119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bec4d-340f-43c8-ba0c-2924dec0d8f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:14.672119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bec4d-340f-43c8-ba0c-2924dec0d8f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:14.672119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bec4d-340f-43c8-ba0c-2924dec0d8f3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:14.672119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 55/114] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:44:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:14.673423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e4eb1-2def-40b3-be79-fc392ccdb367 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:14.673799 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e4eb1-2def-40b3-be79-fc392ccdb367 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:14.674086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e4eb1-2def-40b3-be79-fc392ccdb367 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:14.675372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 56/115] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:14.679934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4a55e-3582-491d-a85c-4a2044217c06 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:14.679934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4a55e-3582-491d-a85c-4a2044217c06 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:14.679934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4a55e-3582-491d-a85c-4a2044217c06 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:14.679934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 57/116] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:14.679934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4a55e-3582-491d-a85c-4a2044217c06 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:14.787367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4a55e-3582-491d-a85c-4a2044217c06 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:14.792541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5e725-1bd0-48a1-ae30-3f00d4121db2 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:14.820898 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba1581-f0d6-4cf8-a62a-d9bafff2630b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:14.821550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba1581-f0d6-4cf8-a62a-d9bafff2630b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:14.821837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba1581-f0d6-4cf8-a62a-d9bafff2630b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:14.822112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba1581-f0d6-4cf8-a62a-d9bafff2630b None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:14.823272 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba1581-f0d6-4cf8-a62a-d9bafff2630b None admin] RBAC: Authorizing `identity:get_project(project_id=005e84bc135b44f088d0ad047d11daf7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:14.824719 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba1581-f0d6-4cf8-a62a-d9bafff2630b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:14.826313 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5f502-1607-467f-baae-98d7c4053d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:14.826556 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 58/117] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:14 2022] GET /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:14.827323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba1581-f0d6-4cf8-a62a-d9bafff2630b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:14.829175 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5f502-1607-467f-baae-98d7c4053d5f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:14.829472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5f502-1607-467f-baae-98d7c4053d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:14.829932 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5f502-1607-467f-baae-98d7c4053d5f None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:14.831486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5f502-1607-467f-baae-98d7c4053d5f None admin] RBAC: Authorizing `identity:get_project(project_id=005e84bc135b44f088d0ad047d11daf7)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:14.832848 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5f502-1607-467f-baae-98d7c4053d5f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:14.834536 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 60/118] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:14 2022] GET /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:14.835284 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5f502-1607-467f-baae-98d7c4053d5f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:14.845914 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:14.903891 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:14.929337 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba1581-f0d6-4cf8-a62a-d9bafff2630b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:14.934066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5f502-1607-467f-baae-98d7c4053d5f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:14.963625 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24f2c5-dafb-4dc2-bf13-73da06476843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:14.964250 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24f2c5-dafb-4dc2-bf13-73da06476843 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:14.964537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24f2c5-dafb-4dc2-bf13-73da06476843 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:14.964842 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24f2c5-dafb-4dc2-bf13-73da06476843 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:14.965565 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24f2c5-dafb-4dc2-bf13-73da06476843 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:14.965881 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24f2c5-dafb-4dc2-bf13-73da06476843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:14.966884 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933abd0e-58f2-40d3-8e6b-bee90563b8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:14.967456 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24f2c5-dafb-4dc2-bf13-73da06476843 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:14.967564 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933abd0e-58f2-40d3-8e6b-bee90563b8ba None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:14.967791 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933abd0e-58f2-40d3-8e6b-bee90563b8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:14.968077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933abd0e-58f2-40d3-8e6b-bee90563b8ba None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:14.968778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933abd0e-58f2-40d3-8e6b-bee90563b8ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:14.970238 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933abd0e-58f2-40d3-8e6b-bee90563b8ba None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:14.975998 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 59/119] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:14.977272 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc9d04-4f2b-44ac-8c37-a30102035e00 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:14.977573 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc9d04-4f2b-44ac-8c37-a30102035e00 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:14.977854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc9d04-4f2b-44ac-8c37-a30102035e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:14.997473 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-95dc9d04-4f2b-44ac-8c37-a30102035e00 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:14.998683 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-95dc9d04-4f2b-44ac-8c37-a30102035e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:15.067558 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 60/120] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:15.068870 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5bc8e-7f47-470d-8241-8e7a1b332ff9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:15.069159 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5bc8e-7f47-470d-8241-8e7a1b332ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:15.069437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5bc8e-7f47-470d-8241-8e7a1b332ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:15.081222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:15.087601 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-aca5bc8e-7f47-470d-8241-8e7a1b332ff9 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:15.088828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-aca5bc8e-7f47-470d-8241-8e7a1b332ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:15.089458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 61/121] 10.222.0.75 () {60 vars in 1141 bytes} [Thu Jul 28 17:44:14 2022] POST /identity/v3/projects => generated 302 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:44:15.100312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933abd0e-58f2-40d3-8e6b-bee90563b8ba None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:15.182646 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 61/122] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:15.183824 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5bc8e-7f47-470d-8241-8e7a1b332ff9 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:15.227298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933abd0e-58f2-40d3-8e6b-bee90563b8ba None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:15.255223 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:15.275728 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5add0-d617-4914-a19f-6f08cdb08034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:15.277653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5add0-d617-4914-a19f-6f08cdb08034 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:15.278233 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5add0-d617-4914-a19f-6f08cdb08034 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:15.278722 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5add0-d617-4914-a19f-6f08cdb08034 None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7/users/5ebb75ff475d457cb684829880a3d01e/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:15.288790 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5add0-d617-4914-a19f-6f08cdb08034 None admin] RBAC: Authorizing `identity:create_grant(project_id=005e84bc135b44f088d0ad047d11daf7, user_id=5ebb75ff475d457cb684829880a3d01e, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:15.288790 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5add0-d617-4914-a19f-6f08cdb08034 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:15.299909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5bc8e-7f47-470d-8241-8e7a1b332ff9 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:15.334606 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef702d0-05ea-44d7-a51c-939932830012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:15.335235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef702d0-05ea-44d7-a51c-939932830012 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:15.335527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef702d0-05ea-44d7-a51c-939932830012 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:15.335803 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef702d0-05ea-44d7-a51c-939932830012 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:15.336610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef702d0-05ea-44d7-a51c-939932830012 None admin] RBAC: Adding query filter params (role.id=b25f2feb715144eebde4711522cb8024, scope.project.id=005e84bc135b44f088d0ad047d11daf7, user.id=805ae67c835b4cacafbceefc9d591090) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:15.336962 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef702d0-05ea-44d7-a51c-939932830012 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:15.338426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef702d0-05ea-44d7-a51c-939932830012 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:15.341442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:15.344646 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 62/123] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:44:15 2022] GET /identity/v3/role_assignments?user.id=805ae67c835b4cacafbceefc9d591090&scope.project.id=005e84bc135b44f088d0ad047d11daf7&role.id=b25f2feb715144eebde4711522cb8024 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:15.345489 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef702d0-05ea-44d7-a51c-939932830012 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:15.401713 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 62/124] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:44:15 2022] PUT /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7/users/5ebb75ff475d457cb684829880a3d01e/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:44:15.411465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5add0-d617-4914-a19f-6f08cdb08034 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:15.525149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef702d0-05ea-44d7-a51c-939932830012 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:15.566699 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5a1ec-dea7-4aee-b5ef-5593cc46e12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:15.567372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5a1ec-dea7-4aee-b5ef-5593cc46e12e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:15.567657 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5a1ec-dea7-4aee-b5ef-5593cc46e12e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:15.567977 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5a1ec-dea7-4aee-b5ef-5593cc46e12e None admin] PATH_INFO: `/v3/users/f7723740b021455a9d6a17442f071bca` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:15.569463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5a1ec-dea7-4aee-b5ef-5593cc46e12e None admin] RBAC: Authorizing `identity:get_user(user_id=f7723740b021455a9d6a17442f071bca)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:15.571011 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5a1ec-dea7-4aee-b5ef-5593cc46e12e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:15.572986 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 63/125] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:15 2022] GET /identity/v3/users/f7723740b021455a9d6a17442f071bca => generated 247 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:15.573868 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5a1ec-dea7-4aee-b5ef-5593cc46e12e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:15.635634 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5add0-d617-4914-a19f-6f08cdb08034 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:15.666521 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:15.683176 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3e602-834b-40fd-9433-666f999454e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:15.683889 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3e602-834b-40fd-9433-666f999454e7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:15.684173 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3e602-834b-40fd-9433-666f999454e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:15.684452 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3e602-834b-40fd-9433-666f999454e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:15.698886 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3e602-834b-40fd-9433-666f999454e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:15.707356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-3dd3e602-834b-40fd-9433-666f999454e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:15.707356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:15.707356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:15.707356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:15.707356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:15.707356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:15.707356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:15.707356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:15.707356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:15.707356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:15.707356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:15.707356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:15.707356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:15.707356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:15.707356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:15.707356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:15.708207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:15.708207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:15.708207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:15.708207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:15.708207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:15.708207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:15.708207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:15.708207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:15.708207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:15.708207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:15.708207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:15.708207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:15.708207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:15.708207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:15.708207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:15.708207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:15.709632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:15.709632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:15.709632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:15.709632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:15.709632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:15.709632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:15.709632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:15.709632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:15.709632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:15.709632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:15.709632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:15.709632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:15.709632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 63/126] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:15.710256 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5a1ec-dea7-4aee-b5ef-5593cc46e12e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:15.710332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3e602-834b-40fd-9433-666f999454e7 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:15.761299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:15.774561 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213e25e-88c5-44ad-8683-6b39ff42ea52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:15.775329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213e25e-88c5-44ad-8683-6b39ff42ea52 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:15.775577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213e25e-88c5-44ad-8683-6b39ff42ea52 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:15.775863 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213e25e-88c5-44ad-8683-6b39ff42ea52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:15.805416 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213e25e-88c5-44ad-8683-6b39ff42ea52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:15.811731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-0213e25e-88c5-44ad-8683-6b39ff42ea52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:15.811731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:15.811731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:15.811731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:15.811731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:15.811731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:15.811731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:15.811731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:15.811731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:15.811731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:15.811731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:15.811731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:15.811731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:15.811731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:15.811731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:15.811731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:15.813899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:15.813899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:15.813899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:15.813899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:15.813899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:15.813899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:15.813899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:15.813899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:15.813899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:15.813899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:15.813899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:15.813899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:15.813899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:15.813899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:15.813899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:15.813899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:15.815796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:15.815796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:15.815796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:15.815796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:15.815796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:15.815796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:15.815796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:15.815796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:15.815796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:15.815796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:15.815796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:15.815796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:15.815796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 64/127] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:44:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:15.815796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213e25e-88c5-44ad-8683-6b39ff42ea52 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:15.832015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3e602-834b-40fd-9433-666f999454e7 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:15.873362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa38d4-ec1d-4378-bdd1-649c7d6e555d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:15.874190 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa38d4-ec1d-4378-bdd1-649c7d6e555d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:15.874477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa38d4-ec1d-4378-bdd1-649c7d6e555d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:15.874755 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa38d4-ec1d-4378-bdd1-649c7d6e555d None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:15.876129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa38d4-ec1d-4378-bdd1-649c7d6e555d None admin] RBAC: Authorizing `identity:get_project(project_id=005e84bc135b44f088d0ad047d11daf7)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:15.878349 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa38d4-ec1d-4378-bdd1-649c7d6e555d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:15.881436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 64/128] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:15 2022] GET /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:15.882189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa38d4-ec1d-4378-bdd1-649c7d6e555d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:15.999009 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa38d4-ec1d-4378-bdd1-649c7d6e555d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:16.009138 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:16.036286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8f0ae-0877-4a70-b80e-3fb595869d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:16.037718 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8f0ae-0877-4a70-b80e-3fb595869d8c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:16.038099 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8f0ae-0877-4a70-b80e-3fb595869d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:16.038520 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8f0ae-0877-4a70-b80e-3fb595869d8c None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:16.039231 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213e25e-88c5-44ad-8683-6b39ff42ea52 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:16.039420 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8f0ae-0877-4a70-b80e-3fb595869d8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:16.039824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8f0ae-0877-4a70-b80e-3fb595869d8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:16.044783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8f0ae-0877-4a70-b80e-3fb595869d8c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:16.053714 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 65/129] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:44:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:16.057945 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8f0ae-0877-4a70-b80e-3fb595869d8c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:16.093362 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:16.103468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a96791-859c-453e-bb64-584a8d3adaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:16.104177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a96791-859c-453e-bb64-584a8d3adaf4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:16.104494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a96791-859c-453e-bb64-584a8d3adaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:16.104872 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a96791-859c-453e-bb64-584a8d3adaf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:16.105569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a96791-859c-453e-bb64-584a8d3adaf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:16.105927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a96791-859c-453e-bb64-584a8d3adaf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:16.107360 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a96791-859c-453e-bb64-584a8d3adaf4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:16.118344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 65/130] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:16.119273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a96791-859c-453e-bb64-584a8d3adaf4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:16.227516 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a96791-859c-453e-bb64-584a8d3adaf4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:16.234937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8f0ae-0877-4a70-b80e-3fb595869d8c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:16.260795 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887d141-04ef-49b7-85b7-88b015cf5f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:16.260795 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887d141-04ef-49b7-85b7-88b015cf5f99 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:16.260795 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887d141-04ef-49b7-85b7-88b015cf5f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:16.260795 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887d141-04ef-49b7-85b7-88b015cf5f99 None admin] PATH_INFO: `/v3/users/5ebb75ff475d457cb684829880a3d01e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:16.261199 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887d141-04ef-49b7-85b7-88b015cf5f99 None admin] RBAC: Authorizing `identity:get_user(user_id=5ebb75ff475d457cb684829880a3d01e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:16.262499 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887d141-04ef-49b7-85b7-88b015cf5f99 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:16.264458 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 66/131] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:16 2022] GET /identity/v3/users/5ebb75ff475d457cb684829880a3d01e => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:16.265270 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887d141-04ef-49b7-85b7-88b015cf5f99 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:16.300543 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7c0e4-008d-4b0a-9711-915bb51fe234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:16.301583 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c0e4-008d-4b0a-9711-915bb51fe234 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:16.302169 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c0e4-008d-4b0a-9711-915bb51fe234 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:16.302703 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c0e4-008d-4b0a-9711-915bb51fe234 None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7/users/f7723740b021455a9d6a17442f071bca/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:16.309565 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7c0e4-008d-4b0a-9711-915bb51fe234 None admin] RBAC: Authorizing `identity:create_grant(project_id=005e84bc135b44f088d0ad047d11daf7, user_id=f7723740b021455a9d6a17442f071bca, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:16.311465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7c0e4-008d-4b0a-9711-915bb51fe234 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:16.332929 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:16.387670 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887d141-04ef-49b7-85b7-88b015cf5f99 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:16.423073 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73875a0b-745b-4430-a9d5-e1f38ef17afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:16.423725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73875a0b-745b-4430-a9d5-e1f38ef17afe None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:16.424007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73875a0b-745b-4430-a9d5-e1f38ef17afe None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:16.424285 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73875a0b-745b-4430-a9d5-e1f38ef17afe None admin] PATH_INFO: `/v3/users/5ebb75ff475d457cb684829880a3d01e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:16.425458 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73875a0b-745b-4430-a9d5-e1f38ef17afe None admin] RBAC: Authorizing `identity:get_user(user_id=5ebb75ff475d457cb684829880a3d01e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:16.426985 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73875a0b-745b-4430-a9d5-e1f38ef17afe None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:16.428649 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 67/132] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:16 2022] GET /identity/v3/users/5ebb75ff475d457cb684829880a3d01e => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:16.429444 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73875a0b-745b-4430-a9d5-e1f38ef17afe None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:16.441921 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 66/133] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:44:16 2022] PUT /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7/users/f7723740b021455a9d6a17442f071bca/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:44:16.443870 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7c0e4-008d-4b0a-9711-915bb51fe234 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:16.530773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:16.539593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73875a0b-745b-4430-a9d5-e1f38ef17afe None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:16.570223 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:16.580540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be890e8-be64-47a7-9efa-4f4679070864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:16.581483 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be890e8-be64-47a7-9efa-4f4679070864 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:16.581909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be890e8-be64-47a7-9efa-4f4679070864 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:16.582318 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be890e8-be64-47a7-9efa-4f4679070864 None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:16.584277 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be890e8-be64-47a7-9efa-4f4679070864 None admin] RBAC: Authorizing `identity:get_project(project_id=005e84bc135b44f088d0ad047d11daf7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:16.586000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be890e8-be64-47a7-9efa-4f4679070864 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:16.588218 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 68/134] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:16 2022] GET /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:16.593935 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be890e8-be64-47a7-9efa-4f4679070864 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:16.705791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be890e8-be64-47a7-9efa-4f4679070864 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:16.743393 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2a75f-68f2-487c-aa7d-f89496eeec10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:16.744364 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2a75f-68f2-487c-aa7d-f89496eeec10 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:16.744931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2a75f-68f2-487c-aa7d-f89496eeec10 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:16.745402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2a75f-68f2-487c-aa7d-f89496eeec10 None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7/users/5ebb75ff475d457cb684829880a3d01e/roles/e2024b6eae3d49f09caa7d4275eb88bc` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:16.748057 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2a75f-68f2-487c-aa7d-f89496eeec10 None admin] RBAC: Authorizing `identity:create_grant(project_id=005e84bc135b44f088d0ad047d11daf7, user_id=5ebb75ff475d457cb684829880a3d01e, role_id=e2024b6eae3d49f09caa7d4275eb88bc)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:16.749876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2a75f-68f2-487c-aa7d-f89496eeec10 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:16.763213 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7c0e4-008d-4b0a-9711-915bb51fe234 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:16.805799 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6a280-08b6-40f9-84e4-5daec01dd60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:16.806465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6a280-08b6-40f9-84e4-5daec01dd60f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:16.806814 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6a280-08b6-40f9-84e4-5daec01dd60f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:16.807088 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6a280-08b6-40f9-84e4-5daec01dd60f None admin] PATH_INFO: `/v3/projects/d39929e0334342088d38ef7ad93dacac` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:16.808259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6a280-08b6-40f9-84e4-5daec01dd60f None admin] RBAC: Authorizing `identity:get_project(project_id=d39929e0334342088d38ef7ad93dacac)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:16.809815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6a280-08b6-40f9-84e4-5daec01dd60f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:16.815172 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 67/135] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:16 2022] GET /identity/v3/projects/d39929e0334342088d38ef7ad93dacac => generated 312 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:16.817685 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6a280-08b6-40f9-84e4-5daec01dd60f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:16.845781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 69/136] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:44:16 2022] PUT /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7/users/5ebb75ff475d457cb684829880a3d01e/roles/e2024b6eae3d49f09caa7d4275eb88bc => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:44:16.935318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:16.938476 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6a280-08b6-40f9-84e4-5daec01dd60f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:16.982782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80635080-b36f-42c3-9a08-7306f3fe03fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:16.983505 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80635080-b36f-42c3-9a08-7306f3fe03fc None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:16.983794 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80635080-b36f-42c3-9a08-7306f3fe03fc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:16.984076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80635080-b36f-42c3-9a08-7306f3fe03fc None admin] PATH_INFO: `/v3/projects/d39929e0334342088d38ef7ad93dacac/users/5ebb75ff475d457cb684829880a3d01e/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:16.986286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80635080-b36f-42c3-9a08-7306f3fe03fc None admin] RBAC: Authorizing `identity:create_grant(project_id=d39929e0334342088d38ef7ad93dacac, user_id=5ebb75ff475d457cb684829880a3d01e, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:16.987899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80635080-b36f-42c3-9a08-7306f3fe03fc None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:17.065671 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 68/137] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:44:16 2022] PUT /identity/v3/projects/d39929e0334342088d38ef7ad93dacac/users/5ebb75ff475d457cb684829880a3d01e/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:44:17.771532 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ec9cd-2e19-41f2-b5b6-7100da966fda None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:17.772039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ec9cd-2e19-41f2-b5b6-7100da966fda None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:17.772110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ec9cd-2e19-41f2-b5b6-7100da966fda None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:17.773751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 70/138] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:17.779273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516e4ff-f769-4926-8ddc-60f3e866d947 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:17.779698 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516e4ff-f769-4926-8ddc-60f3e866d947 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:17.779883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516e4ff-f769-4926-8ddc-60f3e866d947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:17.808609 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4516e4ff-f769-4926-8ddc-60f3e866d947 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:17.809848 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4516e4ff-f769-4926-8ddc-60f3e866d947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:17.900804 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 69/139] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:17.936849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ec9cd-2e19-41f2-b5b6-7100da966fda None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:17.951734 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cac34-a0b3-4beb-8851-0bb3b62caaf0 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:17.952039 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cac34-a0b3-4beb-8851-0bb3b62caaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:17.952289 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cac34-a0b3-4beb-8851-0bb3b62caaf0 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:17.953684 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 70/140] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:17.960850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72114b5b-cd1d-4c07-8179-e737ea1f087d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:17.961138 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72114b5b-cd1d-4c07-8179-e737ea1f087d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:17.961414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72114b5b-cd1d-4c07-8179-e737ea1f087d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:18.001225 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-72114b5b-cd1d-4c07-8179-e737ea1f087d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:18.002430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-72114b5b-cd1d-4c07-8179-e737ea1f087d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:18.055638 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:18.074159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 71/141] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:18.097902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72114b5b-cd1d-4c07-8179-e737ea1f087d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:18.139689 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:18.158642 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ec9cd-2e19-41f2-b5b6-7100da966fda None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:18.265524 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72556396-9951-4700-821b-1432d54c122b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:18.266202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72556396-9951-4700-821b-1432d54c122b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:18.266489 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72556396-9951-4700-821b-1432d54c122b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:18.266769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72556396-9951-4700-821b-1432d54c122b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:18.268001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72556396-9951-4700-821b-1432d54c122b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:18.269516 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72556396-9951-4700-821b-1432d54c122b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:18.271658 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 71/142] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:44:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:18.278369 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72556396-9951-4700-821b-1432d54c122b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:18.281564 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72114b5b-cd1d-4c07-8179-e737ea1f087d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:18.354526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f50e7-18cf-4425-8a80-4661f0f211c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:18.355200 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f50e7-18cf-4425-8a80-4661f0f211c1 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:18.355482 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f50e7-18cf-4425-8a80-4661f0f211c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:18.355768 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f50e7-18cf-4425-8a80-4661f0f211c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:18.383732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f50e7-18cf-4425-8a80-4661f0f211c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:18.388937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-9d6f50e7-18cf-4425-8a80-4661f0f211c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:44:18.388937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:18.388937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:18.388937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:18.388937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:18.388937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:18.388937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:18.388937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:18.388937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:18.388937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:18.388937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:18.388937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:18.388937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:18.388937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:18.388937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:18.388937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:18.389758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:18.389758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:18.389758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:18.389758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:18.389758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:18.389758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:18.389758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:18.389758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:18.389758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:18.389758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:18.389758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:18.389758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:18.389758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:18.389758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:18.389758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:18.389758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:18.390538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:18.390538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:18.390538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:18.390538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:18.390538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:18.390538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:18.390538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:18.390538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:18.390538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:18.390538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:18.390538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:44:18.390538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:18.393418 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 72/143] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:44:18.413832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f50e7-18cf-4425-8a80-4661f0f211c1 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:18.444934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72556396-9951-4700-821b-1432d54c122b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:18.485164 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:18.490216 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250cc36-553d-4a6a-8223-4a9d91807ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:18.490889 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250cc36-553d-4a6a-8223-4a9d91807ff3 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:18.491144 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250cc36-553d-4a6a-8223-4a9d91807ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:18.491421 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250cc36-553d-4a6a-8223-4a9d91807ff3 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:18.492116 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250cc36-553d-4a6a-8223-4a9d91807ff3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:18.493609 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250cc36-553d-4a6a-8223-4a9d91807ff3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:18.589535 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 72/144] 10.222.0.75 () {60 vars in 1132 bytes} [Thu Jul 28 17:44:18 2022] POST /identity/v3/users => generated 283 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:44:18.591625 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:18.620661 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f50e7-18cf-4425-8a80-4661f0f211c1 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:18.657081 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a7d54-b31a-4f0c-a22a-c64d59794c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:18.657727 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a7d54-b31a-4f0c-a22a-c64d59794c3c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:18.658009 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a7d54-b31a-4f0c-a22a-c64d59794c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:18.658273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a7d54-b31a-4f0c-a22a-c64d59794c3c None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:18.659021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a7d54-b31a-4f0c-a22a-c64d59794c3c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:18.659304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a7d54-b31a-4f0c-a22a-c64d59794c3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:18.660817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a7d54-b31a-4f0c-a22a-c64d59794c3c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:18.671358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 73/145] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:18.677112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250cc36-553d-4a6a-8223-4a9d91807ff3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:18.744623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004702a8-7310-4d62-9639-300cb11ba8eb None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:18.745083 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004702a8-7310-4d62-9639-300cb11ba8eb None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:18.745463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004702a8-7310-4d62-9639-300cb11ba8eb None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:18.747179 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 74/146] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:18.753393 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c14baa-41fb-4c25-95ae-6b4c3997d13b None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:18.753784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c14baa-41fb-4c25-95ae-6b4c3997d13b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:18.754556 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c14baa-41fb-4c25-95ae-6b4c3997d13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:18.776494 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-10c14baa-41fb-4c25-95ae-6b4c3997d13b None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:18.778152 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-10c14baa-41fb-4c25-95ae-6b4c3997d13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:18.833882 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250cc36-553d-4a6a-8223-4a9d91807ff3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:18.870452 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197af10b-d533-4b75-9d50-ed46131af26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:18.871190 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197af10b-d533-4b75-9d50-ed46131af26e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:18.871432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197af10b-d533-4b75-9d50-ed46131af26e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:18.871711 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197af10b-d533-4b75-9d50-ed46131af26e None admin] PATH_INFO: `/v3/users/805ae67c835b4cacafbceefc9d591090` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:18.873478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197af10b-d533-4b75-9d50-ed46131af26e None admin] RBAC: Authorizing `identity:get_user(user_id=805ae67c835b4cacafbceefc9d591090)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:18.875459 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197af10b-d533-4b75-9d50-ed46131af26e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:18.877563 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 73/147] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:18 2022] GET /identity/v3/users/805ae67c835b4cacafbceefc9d591090 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:18.891741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 75/148] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:44:18.906537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197af10b-d533-4b75-9d50-ed46131af26e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:18.915424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c14baa-41fb-4c25-95ae-6b4c3997d13b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:18.987596 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:18.989133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:19.018934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c14baa-41fb-4c25-95ae-6b4c3997d13b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:19.058238 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c6a76-bdb9-4e8e-b693-fa3889a723e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:19.058927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c6a76-bdb9-4e8e-b693-fa3889a723e4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:19.059214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c6a76-bdb9-4e8e-b693-fa3889a723e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:19.059489 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c6a76-bdb9-4e8e-b693-fa3889a723e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:19.082583 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c6a76-bdb9-4e8e-b693-fa3889a723e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:19.089072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-a00c6a76-bdb9-4e8e-b693-fa3889a723e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:19.089072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:19.089072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:19.089072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:19.089072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:19.089072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:19.089072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:19.089072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:19.089072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:19.089072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:19.089072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:19.089072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:19.089072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:19.089072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:19.089072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:19.089072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:19.089902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:19.089902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:19.089902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:19.089902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:19.089902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:19.089902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:19.089902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:19.089902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:19.089902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:19.089902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:19.089902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:19.089902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:19.089902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:19.089902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:19.089902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:19.089902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:19.090654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:19.090654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:19.090654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:19.090654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:19.090654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:19.090654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:19.090654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:19.090654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:19.090654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:19.090654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:19.090654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:19.090654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:19.090654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 76/149] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:44:19.100875 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c6a76-bdb9-4e8e-b693-fa3889a723e4 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:19.108940 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197af10b-d533-4b75-9d50-ed46131af26e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:19.199838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7d531-da7f-430f-a4df-67357585e95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:19.201013 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7d531-da7f-430f-a4df-67357585e95e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:19.201520 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7d531-da7f-430f-a4df-67357585e95e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:19.201995 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7d531-da7f-430f-a4df-67357585e95e None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:19.203685 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7d531-da7f-430f-a4df-67357585e95e None admin] RBAC: Authorizing `identity:get_project(project_id=005e84bc135b44f088d0ad047d11daf7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:19.209872 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7d531-da7f-430f-a4df-67357585e95e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:19.211856 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 74/150] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:18 2022] GET /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:19.220216 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7d531-da7f-430f-a4df-67357585e95e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:19.227436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c6a76-bdb9-4e8e-b693-fa3889a723e4 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:19.260515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:19.263689 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a72211-e59c-4e4c-8a7c-ad4d18724ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:19.264523 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a72211-e59c-4e4c-8a7c-ad4d18724ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:19.264876 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a72211-e59c-4e4c-8a7c-ad4d18724ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:19.265164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a72211-e59c-4e4c-8a7c-ad4d18724ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:19.266210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a72211-e59c-4e4c-8a7c-ad4d18724ff7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:19.266530 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a72211-e59c-4e4c-8a7c-ad4d18724ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:19.268032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a72211-e59c-4e4c-8a7c-ad4d18724ff7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:19.278230 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 77/151] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:19.284608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a72211-e59c-4e4c-8a7c-ad4d18724ff7 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:19.397536 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a72211-e59c-4e4c-8a7c-ad4d18724ff7 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:19.437905 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905aa616-3629-4b5b-be37-15c1b1f94ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:19.438624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aa616-3629-4b5b-be37-15c1b1f94ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:19.438911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aa616-3629-4b5b-be37-15c1b1f94ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:19.439193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aa616-3629-4b5b-be37-15c1b1f94ff0 None admin] PATH_INFO: `/v3/users/5ebb75ff475d457cb684829880a3d01e` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:19.440427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905aa616-3629-4b5b-be37-15c1b1f94ff0 None admin] RBAC: Authorizing `identity:get_user(user_id=5ebb75ff475d457cb684829880a3d01e)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:19.442726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905aa616-3629-4b5b-be37-15c1b1f94ff0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:19.444662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 78/152] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:19 2022] GET /identity/v3/users/5ebb75ff475d457cb684829880a3d01e => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:19.450523 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905aa616-3629-4b5b-be37-15c1b1f94ff0 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:19.517944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7d531-da7f-430f-a4df-67357585e95e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:19.533108 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:19.535014 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:19.560075 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8db62-6d09-4140-aa7b-d4a3a4fe899a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:19.560791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8db62-6d09-4140-aa7b-d4a3a4fe899a None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:19.561095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8db62-6d09-4140-aa7b-d4a3a4fe899a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:19.561371 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8db62-6d09-4140-aa7b-d4a3a4fe899a None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7/users/805ae67c835b4cacafbceefc9d591090/roles/b25f2feb715144eebde4711522cb8024` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:19.563444 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8db62-6d09-4140-aa7b-d4a3a4fe899a None admin] RBAC: Authorizing `identity:create_grant(project_id=005e84bc135b44f088d0ad047d11daf7, user_id=805ae67c835b4cacafbceefc9d591090, role_id=b25f2feb715144eebde4711522cb8024)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:19.565652 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8db62-6d09-4140-aa7b-d4a3a4fe899a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:19.577223 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905aa616-3629-4b5b-be37-15c1b1f94ff0 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:19.614450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6397a-fe7a-4b14-a6f8-368372183315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:19.615517 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6397a-fe7a-4b14-a6f8-368372183315 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:19.615801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6397a-fe7a-4b14-a6f8-368372183315 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:19.616073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6397a-fe7a-4b14-a6f8-368372183315 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:19.694628 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6397a-fe7a-4b14-a6f8-368372183315 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:19.696117 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6397a-fe7a-4b14-a6f8-368372183315 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:19.717363 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 75/153] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:44:19 2022] PUT /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7/users/805ae67c835b4cacafbceefc9d591090/roles/b25f2feb715144eebde4711522cb8024 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:44:19.719940 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3dcd1-eafa-4b0e-9cf7-22d323b36a94 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:19.720227 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3dcd1-eafa-4b0e-9cf7-22d323b36a94 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:19.720504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3dcd1-eafa-4b0e-9cf7-22d323b36a94 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:19.721968 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 76/154] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:19.724341 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aab594-8ab1-4e87-a18d-c36109b78d95 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:19.724626 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aab594-8ab1-4e87-a18d-c36109b78d95 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:19.724927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aab594-8ab1-4e87-a18d-c36109b78d95 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:19.731087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 77/155] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:19.732546 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9997a9-65a7-4ba2-9fba-c28a823f2b07 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:19.732869 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9997a9-65a7-4ba2-9fba-c28a823f2b07 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:19.733147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9997a9-65a7-4ba2-9fba-c28a823f2b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:19.763973 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8d9997a9-65a7-4ba2-9fba-c28a823f2b07 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:19.765797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8d9997a9-65a7-4ba2-9fba-c28a823f2b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:19.791707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:19.841893 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 79/156] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:44:19.843222 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5862eaa-8c8c-43ed-b3be-d8b61f0f41a8 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:19.843593 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5862eaa-8c8c-43ed-b3be-d8b61f0f41a8 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:19.843965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5862eaa-8c8c-43ed-b3be-d8b61f0f41a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:19.867515 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 78/157] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:19.868024 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f5862eaa-8c8c-43ed-b3be-d8b61f0f41a8 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:19.869082 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9997a9-65a7-4ba2-9fba-c28a823f2b07 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:19.869292 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f5862eaa-8c8c-43ed-b3be-d8b61f0f41a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:19.961260 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 80/158] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:19.962307 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5862eaa-8c8c-43ed-b3be-d8b61f0f41a8 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:20.011778 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9997a9-65a7-4ba2-9fba-c28a823f2b07 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:20.015252 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:20.060093 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c5f08-adfd-410a-a0fe-c4fbb8fd0f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:20.060789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c5f08-adfd-410a-a0fe-c4fbb8fd0f12 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:20.061079 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c5f08-adfd-410a-a0fe-c4fbb8fd0f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:20.061356 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c5f08-adfd-410a-a0fe-c4fbb8fd0f12 None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:20.063208 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c5f08-adfd-410a-a0fe-c4fbb8fd0f12 None admin] RBAC: Authorizing `identity:get_project(project_id=005e84bc135b44f088d0ad047d11daf7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:20.064683 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c5f08-adfd-410a-a0fe-c4fbb8fd0f12 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:20.066409 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 79/159] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:19 2022] GET /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:20.067257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c5f08-adfd-410a-a0fe-c4fbb8fd0f12 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:20.097655 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:20.116258 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5862eaa-8c8c-43ed-b3be-d8b61f0f41a8 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:20.205551 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fa5f8-77c7-4ed6-ad4b-25533a320829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:20.206429 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fa5f8-77c7-4ed6-ad4b-25533a320829 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:20.206714 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fa5f8-77c7-4ed6-ad4b-25533a320829 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:20.207511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fa5f8-77c7-4ed6-ad4b-25533a320829 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:20.241638 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fa5f8-77c7-4ed6-ad4b-25533a320829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:20.246897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-632fa5f8-77c7-4ed6-ad4b-25533a320829 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:20.246897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:20.246897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:20.246897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:20.246897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:20.246897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:20.246897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:20.246897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:20.246897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:20.246897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:20.246897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:20.246897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:20.246897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:20.246897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:20.246897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:20.246897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:20.247746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:20.247746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:20.247746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:20.247746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:20.247746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:20.247746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:20.247746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:20.247746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:20.247746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:20.247746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:20.247746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:20.247746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:20.247746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:20.247746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:20.247746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:20.247746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:20.248606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:20.248606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:20.248606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:20.248606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:20.248606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:20.248606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:20.248606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:20.248606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:20.248606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:20.248606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:20.248606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:20.248606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:20.248606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 81/160] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:44:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:20.249715 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fa5f8-77c7-4ed6-ad4b-25533a320829 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:20.268178 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c5f08-adfd-410a-a0fe-c4fbb8fd0f12 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:20.339347 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1d527-53cf-45b2-932a-508c8084dc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:20.341152 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1d527-53cf-45b2-932a-508c8084dc36 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:20.341447 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1d527-53cf-45b2-932a-508c8084dc36 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:20.341709 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1d527-53cf-45b2-932a-508c8084dc36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:20.370165 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1d527-53cf-45b2-932a-508c8084dc36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:20.387094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-11b1d527-53cf-45b2-932a-508c8084dc36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:20.387094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:20.387094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:20.387094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:20.387094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:20.387094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:20.387094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:20.387094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:20.387094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:20.387094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:20.387094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:20.387094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:20.387094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:20.387094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:20.387094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:20.387094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:20.388008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:20.388008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:20.388008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:20.388008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:20.388008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:20.388008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:20.388008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:20.388008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:20.388008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:20.388008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:20.388008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:20.388008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:20.388008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:20.388008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:20.388008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:20.388008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:20.389233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:20.389233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:20.389233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:20.389233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:20.389233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:20.389233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:20.389233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:20.389233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:20.389233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:20.389233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:20.389233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:20.389233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:20.389233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 80/161] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:44:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:20.402840 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1d527-53cf-45b2-932a-508c8084dc36 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:20.506406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:20.510601 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fa5f8-77c7-4ed6-ad4b-25533a320829 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:20.649561 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9c9c4-50ad-47c7-bd37-4802037576a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:20.650129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9c9c4-50ad-47c7-bd37-4802037576a3 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:20.650412 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9c9c4-50ad-47c7-bd37-4802037576a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:20.650690 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9c9c4-50ad-47c7-bd37-4802037576a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:20.651503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9c9c4-50ad-47c7-bd37-4802037576a3 None admin] RBAC: Adding query filter params (role.id=279c255613df457cb2d5d9904dd6f12a, scope.project.id=005e84bc135b44f088d0ad047d11daf7, user.id=5ebb75ff475d457cb684829880a3d01e) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:20.651817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9c9c4-50ad-47c7-bd37-4802037576a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:20.653639 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9c9c4-50ad-47c7-bd37-4802037576a3 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:20.665346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1d527-53cf-45b2-932a-508c8084dc36 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:20.675091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 82/162] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:44:20 2022] GET /identity/v3/role_assignments?user.id=5ebb75ff475d457cb684829880a3d01e&scope.project.id=005e84bc135b44f088d0ad047d11daf7&role.id=279c255613df457cb2d5d9904dd6f12a => generated 608 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:20.675969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9c9c4-50ad-47c7-bd37-4802037576a3 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:20.716643 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:20.757238 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55678d8-1718-4cf9-8cef-3afd0eb2a88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:20.759136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55678d8-1718-4cf9-8cef-3afd0eb2a88f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:20.759734 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55678d8-1718-4cf9-8cef-3afd0eb2a88f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:20.759734 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55678d8-1718-4cf9-8cef-3afd0eb2a88f None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:20.760410 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55678d8-1718-4cf9-8cef-3afd0eb2a88f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:20.760836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55678d8-1718-4cf9-8cef-3afd0eb2a88f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:20.762189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55678d8-1718-4cf9-8cef-3afd0eb2a88f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:20.785259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 81/163] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:20.787315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedfcc8-0e02-4e81-8e0a-55b8b8a18673 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:20.787601 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedfcc8-0e02-4e81-8e0a-55b8b8a18673 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:20.787878 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedfcc8-0e02-4e81-8e0a-55b8b8a18673 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:20.790576 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 82/164] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:20.799734 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8e1b5-e4bb-48b1-86c6-1932f91d431e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:20.800014 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8e1b5-e4bb-48b1-86c6-1932f91d431e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:20.800292 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8e1b5-e4bb-48b1-86c6-1932f91d431e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:20.841882 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6db8e1b5-e4bb-48b1-86c6-1932f91d431e None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:20.843154 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6db8e1b5-e4bb-48b1-86c6-1932f91d431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:20.879920 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9c9c4-50ad-47c7-bd37-4802037576a3 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:20.953544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7012b4-7267-455c-986b-f86332686c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:20.954199 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7012b4-7267-455c-986b-f86332686c1a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:20.954488 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7012b4-7267-455c-986b-f86332686c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:20.954768 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7012b4-7267-455c-986b-f86332686c1a None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:20.955506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7012b4-7267-455c-986b-f86332686c1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:20.955818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7012b4-7267-455c-986b-f86332686c1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:20.957288 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7012b4-7267-455c-986b-f86332686c1a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:20.966450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 83/165] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:44:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:20.967160 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7012b4-7267-455c-986b-f86332686c1a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:20.983624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 83/166] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:20.984511 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8e1b5-e4bb-48b1-86c6-1932f91d431e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:21.024316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:21.107824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:21.126926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7012b4-7267-455c-986b-f86332686c1a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:21.174001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e482f1-9e9d-40d5-b767-b3b2bd4969b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:21.175068 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e482f1-9e9d-40d5-b767-b3b2bd4969b0 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:21.175563 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e482f1-9e9d-40d5-b767-b3b2bd4969b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:21.176038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e482f1-9e9d-40d5-b767-b3b2bd4969b0 None admin] PATH_INFO: `/v3/users/f7723740b021455a9d6a17442f071bca` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:21.178041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e482f1-9e9d-40d5-b767-b3b2bd4969b0 None admin] RBAC: Authorizing `identity:get_user(user_id=f7723740b021455a9d6a17442f071bca)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:21.180198 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e482f1-9e9d-40d5-b767-b3b2bd4969b0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:21.182270 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 84/167] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:20 2022] GET /identity/v3/users/f7723740b021455a9d6a17442f071bca => generated 247 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:21.183449 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e482f1-9e9d-40d5-b767-b3b2bd4969b0 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:21.185240 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8e1b5-e4bb-48b1-86c6-1932f91d431e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:21.292051 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ebeeb-1c22-405b-ac5b-1d81c62572b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:21.292625 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ebeeb-1c22-405b-ac5b-1d81c62572b9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:21.297158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ebeeb-1c22-405b-ac5b-1d81c62572b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:21.297371 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ebeeb-1c22-405b-ac5b-1d81c62572b9 None admin] PATH_INFO: `/v3/users/5ebb75ff475d457cb684829880a3d01e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:21.299295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ebeeb-1c22-405b-ac5b-1d81c62572b9 None admin] RBAC: Authorizing `identity:get_user(user_id=5ebb75ff475d457cb684829880a3d01e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:21.300765 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ebeeb-1c22-405b-ac5b-1d81c62572b9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:21.302649 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 84/168] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:20 2022] GET /identity/v3/users/5ebb75ff475d457cb684829880a3d01e => generated 275 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:21.306051 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ebeeb-1c22-405b-ac5b-1d81c62572b9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:21.445080 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e482f1-9e9d-40d5-b767-b3b2bd4969b0 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:21.497575 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:21.503454 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ebeeb-1c22-405b-ac5b-1d81c62572b9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:21.510395 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090c128-b5db-4c45-b2eb-3019375353bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:21.511127 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090c128-b5db-4c45-b2eb-3019375353bb None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:21.511323 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090c128-b5db-4c45-b2eb-3019375353bb None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:21.511604 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090c128-b5db-4c45-b2eb-3019375353bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:21.530014 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090c128-b5db-4c45-b2eb-3019375353bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:21.535463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-c090c128-b5db-4c45-b2eb-3019375353bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:21.535463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:21.535463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:21.535463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:21.535463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:21.535463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:21.535463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:21.535463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:21.535463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:21.535463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:21.535463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:21.535463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:21.535463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:21.535463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:21.535463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:21.535463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:21.536925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:21.536925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:21.536925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:21.536925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:21.536925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:21.536925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:21.536925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:21.536925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:21.536925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:21.536925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:21.536925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:21.536925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:21.536925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:21.536925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:21.536925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:21.536925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:21.537721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:21.537721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:21.537721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:21.537721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:21.537721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:21.537721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:21.537721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:21.537721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:21.537721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:21.537721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:21.537721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:21.537721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:21.537721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 85/169] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:21.538375 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090c128-b5db-4c45-b2eb-3019375353bb None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:21.551382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:21.556036 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a83a5-015b-4467-ba26-6b6045b33342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:21.556673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a83a5-015b-4467-ba26-6b6045b33342 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:21.557054 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a83a5-015b-4467-ba26-6b6045b33342 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:21.557321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a83a5-015b-4467-ba26-6b6045b33342 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:21.688118 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a83a5-015b-4467-ba26-6b6045b33342 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:21.689608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a83a5-015b-4467-ba26-6b6045b33342 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:21.700778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090c128-b5db-4c45-b2eb-3019375353bb None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:21.735443 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6dacf-9342-417a-bb80-35e01e4d427f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:21.736072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6dacf-9342-417a-bb80-35e01e4d427f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:21.736356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6dacf-9342-417a-bb80-35e01e4d427f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:21.736633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6dacf-9342-417a-bb80-35e01e4d427f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:21.812143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6dacf-9342-417a-bb80-35e01e4d427f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:21.813732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6dacf-9342-417a-bb80-35e01e4d427f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:21.838751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:21.925698 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 86/170] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:21.926528 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6dacf-9342-417a-bb80-35e01e4d427f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:21.951979 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:21.999455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 85/171] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:22.000398 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a83a5-015b-4467-ba26-6b6045b33342 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:22.040577 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6dacf-9342-417a-bb80-35e01e4d427f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:22.048878 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:22.078222 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1adef-75da-4c0e-a7aa-b7b868f49680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:22.078775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1adef-75da-4c0e-a7aa-b7b868f49680 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:22.079057 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1adef-75da-4c0e-a7aa-b7b868f49680 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:22.079334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1adef-75da-4c0e-a7aa-b7b868f49680 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:22.080056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1adef-75da-4c0e-a7aa-b7b868f49680 None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:22.080365 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1adef-75da-4c0e-a7aa-b7b868f49680 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:22.081973 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1adef-75da-4c0e-a7aa-b7b868f49680 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:22.091181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 87/172] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:22.092039 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1adef-75da-4c0e-a7aa-b7b868f49680 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:22.190877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a83a5-015b-4467-ba26-6b6045b33342 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:22.200859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1adef-75da-4c0e-a7aa-b7b868f49680 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:22.237371 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d273d-570e-4aac-b5c8-0af72d840273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:22.238131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d273d-570e-4aac-b5c8-0af72d840273 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:22.238429 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d273d-570e-4aac-b5c8-0af72d840273 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:22.238713 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d273d-570e-4aac-b5c8-0af72d840273 None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:22.240027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d273d-570e-4aac-b5c8-0af72d840273 None admin] RBAC: Authorizing `identity:get_project(project_id=005e84bc135b44f088d0ad047d11daf7)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:22.241638 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d273d-570e-4aac-b5c8-0af72d840273 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:22.243605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 88/173] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:22 2022] GET /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:22.244241 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d273d-570e-4aac-b5c8-0af72d840273 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:22.261469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b721fd-de7f-4fa9-a3fc-50ae04e63f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:22.262135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b721fd-de7f-4fa9-a3fc-50ae04e63f49 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:22.262508 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b721fd-de7f-4fa9-a3fc-50ae04e63f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:22.262785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b721fd-de7f-4fa9-a3fc-50ae04e63f49 None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:22.264013 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b721fd-de7f-4fa9-a3fc-50ae04e63f49 None admin] RBAC: Authorizing `identity:get_project(project_id=005e84bc135b44f088d0ad047d11daf7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:22.265481 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b721fd-de7f-4fa9-a3fc-50ae04e63f49 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:22.267151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 86/174] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:21 2022] GET /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:22.268978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b721fd-de7f-4fa9-a3fc-50ae04e63f49 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:22.293100 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:22.365193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d273d-570e-4aac-b5c8-0af72d840273 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:22.374985 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:22.401910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5ed1c-6719-4747-9e1d-faecbfcd265b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:22.403091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5ed1c-6719-4747-9e1d-faecbfcd265b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:22.403522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5ed1c-6719-4747-9e1d-faecbfcd265b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:22.403946 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5ed1c-6719-4747-9e1d-faecbfcd265b None admin] PATH_INFO: `/v3/users/5ebb75ff475d457cb684829880a3d01e` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:22.406570 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5ed1c-6719-4747-9e1d-faecbfcd265b None admin] RBAC: Authorizing `identity:get_user(user_id=5ebb75ff475d457cb684829880a3d01e)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:22.409208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5ed1c-6719-4747-9e1d-faecbfcd265b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:22.411279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 89/175] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:22 2022] GET /identity/v3/users/5ebb75ff475d457cb684829880a3d01e => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:22.412645 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5ed1c-6719-4747-9e1d-faecbfcd265b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:22.499000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b721fd-de7f-4fa9-a3fc-50ae04e63f49 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:22.523033 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5ed1c-6719-4747-9e1d-faecbfcd265b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:22.526184 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:22.539133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207d5e7-5f67-4dd2-a7de-7e2b73c0505a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:22.539896 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207d5e7-5f67-4dd2-a7de-7e2b73c0505a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:22.540305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207d5e7-5f67-4dd2-a7de-7e2b73c0505a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:22.540686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207d5e7-5f67-4dd2-a7de-7e2b73c0505a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:22.541608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207d5e7-5f67-4dd2-a7de-7e2b73c0505a None admin] RBAC: Adding query filter params (role.id=d371062e071845ffa4570a76d40dff88, scope.project.id=005e84bc135b44f088d0ad047d11daf7, user.id=f7723740b021455a9d6a17442f071bca) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:22.542059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207d5e7-5f67-4dd2-a7de-7e2b73c0505a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:22.543635 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207d5e7-5f67-4dd2-a7de-7e2b73c0505a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:22.555311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 87/176] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:44:22 2022] GET /identity/v3/role_assignments?user.id=f7723740b021455a9d6a17442f071bca&scope.project.id=005e84bc135b44f088d0ad047d11daf7&role.id=d371062e071845ffa4570a76d40dff88 => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:22.562242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207d5e7-5f67-4dd2-a7de-7e2b73c0505a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:22.569572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c56734-1582-4ef6-93c2-8bc6bad91ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:22.570669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c56734-1582-4ef6-93c2-8bc6bad91ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:22.573532 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c56734-1582-4ef6-93c2-8bc6bad91ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:22.573960 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c56734-1582-4ef6-93c2-8bc6bad91ed4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:22.574917 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c56734-1582-4ef6-93c2-8bc6bad91ed4 None admin] RBAC: Adding query filter params (role.id=e2024b6eae3d49f09caa7d4275eb88bc, scope.project.id=005e84bc135b44f088d0ad047d11daf7, user.id=5ebb75ff475d457cb684829880a3d01e) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:22.577767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c56734-1582-4ef6-93c2-8bc6bad91ed4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:22.579727 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c56734-1582-4ef6-93c2-8bc6bad91ed4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:22.591810 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 90/177] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:44:22 2022] GET /identity/v3/role_assignments?user.id=5ebb75ff475d457cb684829880a3d01e&scope.project.id=005e84bc135b44f088d0ad047d11daf7&role.id=e2024b6eae3d49f09caa7d4275eb88bc => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:22.595065 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050e8dd-cb26-4d42-8a29-0ff1c39a0604 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:22.596278 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050e8dd-cb26-4d42-8a29-0ff1c39a0604 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:22.596960 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050e8dd-cb26-4d42-8a29-0ff1c39a0604 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:22.601386 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 91/178] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:22.608120 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9a31c-cdaa-4f2a-9859-d7b715babcc4 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:22.608627 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9a31c-cdaa-4f2a-9859-d7b715babcc4 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:22.609071 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9a31c-cdaa-4f2a-9859-d7b715babcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:22.635433 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-61a9a31c-cdaa-4f2a-9859-d7b715babcc4 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:22.637164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-61a9a31c-cdaa-4f2a-9859-d7b715babcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:22.720956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 92/179] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:44:22.738944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9a31c-cdaa-4f2a-9859-d7b715babcc4 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:22.746000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207d5e7-5f67-4dd2-a7de-7e2b73c0505a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:22.781155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:22.801077 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbda74-28df-44f9-8d96-49757e4ae490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:22.802566 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbda74-28df-44f9-8d96-49757e4ae490 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:22.802730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbda74-28df-44f9-8d96-49757e4ae490 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:22.803616 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbda74-28df-44f9-8d96-49757e4ae490 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:22.874999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:22.879324 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9a31c-cdaa-4f2a-9859-d7b715babcc4 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:22.917892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac532353-f8a9-4ba2-bbe5-ec00a7d8b668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:22.918925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac532353-f8a9-4ba2-bbe5-ec00a7d8b668 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:22.919394 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac532353-f8a9-4ba2-bbe5-ec00a7d8b668 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:22.919882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac532353-f8a9-4ba2-bbe5-ec00a7d8b668 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:22.920684 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbda74-28df-44f9-8d96-49757e4ae490 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:22.928502 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbda74-28df-44f9-8d96-49757e4ae490 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:22.949985 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac532353-f8a9-4ba2-bbe5-ec00a7d8b668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:22.955389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-ac532353-f8a9-4ba2-bbe5-ec00a7d8b668 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:22.955389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:22.955389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:22.955389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:22.955389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:22.955389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:22.955389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:22.955389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:22.955389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:22.955389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:22.955389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:22.955389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:22.955389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:22.955389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:22.955389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:22.955389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:22.956294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:22.956294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:22.956294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:22.956294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:22.956294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:22.956294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:22.956294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:22.956294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:22.956294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:22.956294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:22.956294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:22.956294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:22.956294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:22.956294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:22.956294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:22.956294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:22.957097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:22.957097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:22.957097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:22.957097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:22.957097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:22.957097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:22.957097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:22.957097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:22.957097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:22.957097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:22.957097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:22.957097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:22.965166 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 93/180] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:44:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:22.976293 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac532353-f8a9-4ba2-bbe5-ec00a7d8b668 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:23.068198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 88/181] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:23.074468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbda74-28df-44f9-8d96-49757e4ae490 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:23.098444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac532353-f8a9-4ba2-bbe5-ec00a7d8b668 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:23.110463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:23.149402 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be8b63-1d51-4e1a-9b54-30564fc0679f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:23.150557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be8b63-1d51-4e1a-9b54-30564fc0679f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:23.150988 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be8b63-1d51-4e1a-9b54-30564fc0679f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:23.151423 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be8b63-1d51-4e1a-9b54-30564fc0679f None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:23.153084 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be8b63-1d51-4e1a-9b54-30564fc0679f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:23.153553 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be8b63-1d51-4e1a-9b54-30564fc0679f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:23.155554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be8b63-1d51-4e1a-9b54-30564fc0679f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:23.167910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 94/182] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:23.174129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be8b63-1d51-4e1a-9b54-30564fc0679f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:23.213476 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:23.230109 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbda74-28df-44f9-8d96-49757e4ae490 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:23.284168 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672f80f-e167-4a8f-8e49-b4e16a8eb7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:23.284866 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672f80f-e167-4a8f-8e49-b4e16a8eb7ac None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:23.285246 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672f80f-e167-4a8f-8e49-b4e16a8eb7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:23.285517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672f80f-e167-4a8f-8e49-b4e16a8eb7ac None admin] PATH_INFO: `/v3/projects/d39929e0334342088d38ef7ad93dacac` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:23.287615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672f80f-e167-4a8f-8e49-b4e16a8eb7ac None admin] RBAC: Authorizing `identity:get_project(project_id=d39929e0334342088d38ef7ad93dacac)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:23.288775 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672f80f-e167-4a8f-8e49-b4e16a8eb7ac None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:23.292031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 89/183] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:23 2022] GET /identity/v3/projects/d39929e0334342088d38ef7ad93dacac => generated 312 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:23.297480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672f80f-e167-4a8f-8e49-b4e16a8eb7ac None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:23.323909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be8b63-1d51-4e1a-9b54-30564fc0679f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:23.375538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fda4a-a824-4882-88df-17e1160debc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:23.376660 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fda4a-a824-4882-88df-17e1160debc5 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:23.377206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fda4a-a824-4882-88df-17e1160debc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:23.377700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fda4a-a824-4882-88df-17e1160debc5 None admin] PATH_INFO: `/v3/users/694adc30d18d4b1d81978cceb42c7e45` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:23.399705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fda4a-a824-4882-88df-17e1160debc5 None admin] RBAC: Authorizing `identity:get_user(user_id=694adc30d18d4b1d81978cceb42c7e45)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:23.401260 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fda4a-a824-4882-88df-17e1160debc5 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:23.404137 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 95/184] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:23 2022] GET /identity/v3/users/694adc30d18d4b1d81978cceb42c7e45 => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:23.405562 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ced6cd-12a0-470e-a399-e1b0d05bc5b6 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:23.405956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ced6cd-12a0-470e-a399-e1b0d05bc5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:23.406340 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ced6cd-12a0-470e-a399-e1b0d05bc5b6 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:23.407745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 96/185] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:23.408230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:23.409088 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba759e9-c5f8-4ab8-9c67-eb066636a874 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:23.409476 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba759e9-c5f8-4ab8-9c67-eb066636a874 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:23.409831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba759e9-c5f8-4ab8-9c67-eb066636a874 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:23.411835 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 97/186] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:23.413894 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba759e9-c5f8-4ab8-9c67-eb066636a874 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:23.418203 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672f80f-e167-4a8f-8e49-b4e16a8eb7ac None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:23.457701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b37be-6873-4cfa-be1b-d811177c820c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:23.458992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b37be-6873-4cfa-be1b-d811177c820c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:23.459434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b37be-6873-4cfa-be1b-d811177c820c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:23.459722 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b37be-6873-4cfa-be1b-d811177c820c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:23.460509 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b37be-6873-4cfa-be1b-d811177c820c None admin] RBAC: Adding query filter params (role.id=279c255613df457cb2d5d9904dd6f12a, scope.project.id=d39929e0334342088d38ef7ad93dacac, user.id=5ebb75ff475d457cb684829880a3d01e) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:23.460839 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b37be-6873-4cfa-be1b-d811177c820c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:23.462423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b37be-6873-4cfa-be1b-d811177c820c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:23.476790 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 90/187] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:44:23 2022] GET /identity/v3/role_assignments?user.id=5ebb75ff475d457cb684829880a3d01e&scope.project.id=d39929e0334342088d38ef7ad93dacac&role.id=279c255613df457cb2d5d9904dd6f12a => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:23.476790 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd419b2f-b1a2-4be0-bad9-9c0e895858d8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:23.476790 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd419b2f-b1a2-4be0-bad9-9c0e895858d8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:23.476790 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd419b2f-b1a2-4be0-bad9-9c0e895858d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:23.494815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fd419b2f-b1a2-4be0-bad9-9c0e895858d8 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:23.496161 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fd419b2f-b1a2-4be0-bad9-9c0e895858d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:23.512120 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:23.549441 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba759e9-c5f8-4ab8-9c67-eb066636a874 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:23.587443 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 91/188] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:23.588712 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9762d6-586b-4bf2-901f-ebe6a8f226cc None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:23.589029 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9762d6-586b-4bf2-901f-ebe6a8f226cc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:23.589303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9762d6-586b-4bf2-901f-ebe6a8f226cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:23.608796 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361ecd1-dd60-4ab2-98e6-3ad9d55752cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:23.609511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361ecd1-dd60-4ab2-98e6-3ad9d55752cf None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:23.610159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361ecd1-dd60-4ab2-98e6-3ad9d55752cf None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:23.610443 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361ecd1-dd60-4ab2-98e6-3ad9d55752cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:23.612403 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3f9762d6-586b-4bf2-901f-ebe6a8f226cc None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:23.613686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3f9762d6-586b-4bf2-901f-ebe6a8f226cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:23.689407 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 92/189] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:23.690699 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823cb01-26c4-46d7-8a04-fd916f4ed19e None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:23.690989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823cb01-26c4-46d7-8a04-fd916f4ed19e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:23.691299 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823cb01-26c4-46d7-8a04-fd916f4ed19e None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:23.692614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 93/190] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:23.692906 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361ecd1-dd60-4ab2-98e6-3ad9d55752cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:23.693371 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823cb01-26c4-46d7-8a04-fd916f4ed19e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:23.694828 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361ecd1-dd60-4ab2-98e6-3ad9d55752cf None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:23.713836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:23.780563 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:23.804370 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 98/191] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:23.805789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f2c02-7602-491d-a30e-d5f5803a0af3 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:23.806066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f2c02-7602-491d-a30e-d5f5803a0af3 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:23.806337 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f2c02-7602-491d-a30e-d5f5803a0af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:23.825686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-287f2c02-7602-491d-a30e-d5f5803a0af3 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:23.826902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-287f2c02-7602-491d-a30e-d5f5803a0af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:23.829694 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823cb01-26c4-46d7-8a04-fd916f4ed19e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:23.867540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34515db-9453-475d-9c01-689c644bf23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:23.868192 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34515db-9453-475d-9c01-689c644bf23d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:23.868533 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34515db-9453-475d-9c01-689c644bf23d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:23.868843 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34515db-9453-475d-9c01-689c644bf23d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:23.878797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34515db-9453-475d-9c01-689c644bf23d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:23.884324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-c34515db-9453-475d-9c01-689c644bf23d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:23.884324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:23.884324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:23.884324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:23.884324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:23.884324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:23.884324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:23.884324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:23.884324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:23.884324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:23.884324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:23.884324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:23.884324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:23.884324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:23.884324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:23.884324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:23.885537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:23.885537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:23.885537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:23.885537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:23.885537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:23.885537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:23.885537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:23.885537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:23.885537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:23.885537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:23.885537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:23.885537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:23.885537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:23.885537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:23.885537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:23.885537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:23.886326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:23.886326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:23.886326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:23.886326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:23.886326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:23.886326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:23.886326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:23.886326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:23.886326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:23.886326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:23.886326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:23.886326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:23.886326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 94/192] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:44:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:23.886958 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34515db-9453-475d-9c01-689c644bf23d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:23.898372 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 99/193] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:23.899234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f2c02-7602-491d-a30e-d5f5803a0af3 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:23.974237 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:23.995537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34515db-9453-475d-9c01-689c644bf23d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:23.999255 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f2c02-7602-491d-a30e-d5f5803a0af3 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:24.009677 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:24.030596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef49eb2-5c80-4f06-a736-490c460985fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:24.031239 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef49eb2-5c80-4f06-a736-490c460985fe None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:24.031513 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef49eb2-5c80-4f06-a736-490c460985fe None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:24.031782 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef49eb2-5c80-4f06-a736-490c460985fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:24.034548 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27349792-4bf7-436c-b87c-5029bc913dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:24.035195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27349792-4bf7-436c-b87c-5029bc913dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:24.035472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27349792-4bf7-436c-b87c-5029bc913dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:24.035742 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27349792-4bf7-436c-b87c-5029bc913dc0 None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:24.036952 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27349792-4bf7-436c-b87c-5029bc913dc0 None admin] RBAC: Authorizing `identity:get_project(project_id=3747706d68904890975b5253c7f2b3a9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:24.038416 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27349792-4bf7-436c-b87c-5029bc913dc0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:24.040083 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 100/194] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:23 2022] GET /identity/v3/projects/3747706d68904890975b5253c7f2b3a9 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:24.040868 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27349792-4bf7-436c-b87c-5029bc913dc0 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:24.042143 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef49eb2-5c80-4f06-a736-490c460985fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:24.047090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-0ef49eb2-5c80-4f06-a736-490c460985fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:44:24.047090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:24.047090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:24.047090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:24.047090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:24.047090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:24.047090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:24.047090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:24.047090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:24.047090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:24.047090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:24.047090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:24.047090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:24.047090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:24.047090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:24.047090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:24.047978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:24.047978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:24.047978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:24.047978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:24.047978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:24.047978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:24.047978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:24.047978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:24.047978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:24.047978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:24.047978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:24.047978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:24.047978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:24.047978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:24.047978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:24.047978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:24.048744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:24.048744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:24.048744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:24.048744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:24.048744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:24.048744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:24.048744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:24.048744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:24.048744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:24.048744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:24.048744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:44:24.048744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:24.048744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 95/195] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:24.049430 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef49eb2-5c80-4f06-a736-490c460985fe None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:24.139374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27349792-4bf7-436c-b87c-5029bc913dc0 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:24.149755 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef49eb2-5c80-4f06-a736-490c460985fe None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:24.188839 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ed17b-29b0-466f-84e2-9efec4895463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:24.189629 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ed17b-29b0-466f-84e2-9efec4895463 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:24.189904 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ed17b-29b0-466f-84e2-9efec4895463 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:24.190178 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ed17b-29b0-466f-84e2-9efec4895463 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:24.191338 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ed17b-29b0-466f-84e2-9efec4895463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:24.193489 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ed17b-29b0-466f-84e2-9efec4895463 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:24.193686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817b516-289f-4799-b3aa-c496c99d975d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:24.194319 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817b516-289f-4799-b3aa-c496c99d975d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:24.194595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817b516-289f-4799-b3aa-c496c99d975d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:24.194864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817b516-289f-4799-b3aa-c496c99d975d None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:24.195082 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 96/196] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:44:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:24.195587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817b516-289f-4799-b3aa-c496c99d975d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:24.195836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ed17b-29b0-466f-84e2-9efec4895463 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:24.195931 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817b516-289f-4799-b3aa-c496c99d975d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:24.197304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817b516-289f-4799-b3aa-c496c99d975d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:24.200713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:24.205701 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 101/197] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:44:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:24.206490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817b516-289f-4799-b3aa-c496c99d975d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:24.248166 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:24.297923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ed17b-29b0-466f-84e2-9efec4895463 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:24.307003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817b516-289f-4799-b3aa-c496c99d975d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:24.331545 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab49ea-6c32-4ca5-94a1-49560e3e4234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:24.332158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab49ea-6c32-4ca5-94a1-49560e3e4234 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:24.332440 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab49ea-6c32-4ca5-94a1-49560e3e4234 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:24.332713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab49ea-6c32-4ca5-94a1-49560e3e4234 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:24.333534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab49ea-6c32-4ca5-94a1-49560e3e4234 None admin] RBAC: Adding query filter params (role.id=d371062e071845ffa4570a76d40dff88, scope.project.id=3747706d68904890975b5253c7f2b3a9, user.id=694adc30d18d4b1d81978cceb42c7e45) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:24.333843 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab49ea-6c32-4ca5-94a1-49560e3e4234 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:24.335298 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab49ea-6c32-4ca5-94a1-49560e3e4234 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:24.342859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b483272-942b-4b4a-a5e3-43e3f69083a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:24.343489 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b483272-942b-4b4a-a5e3-43e3f69083a6 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:24.343581 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 97/198] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:44:24 2022] GET /identity/v3/role_assignments?user.id=694adc30d18d4b1d81978cceb42c7e45&scope.project.id=3747706d68904890975b5253c7f2b3a9&role.id=d371062e071845ffa4570a76d40dff88 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:24.343786 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b483272-942b-4b4a-a5e3-43e3f69083a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:24.344048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b483272-942b-4b4a-a5e3-43e3f69083a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:24.344865 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b483272-942b-4b4a-a5e3-43e3f69083a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:24.345180 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b483272-942b-4b4a-a5e3-43e3f69083a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:24.345813 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab49ea-6c32-4ca5-94a1-49560e3e4234 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:24.346618 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b483272-942b-4b4a-a5e3-43e3f69083a6 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:24.356572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 102/199] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:24.357304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b483272-942b-4b4a-a5e3-43e3f69083a6 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:24.422933 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:24.461796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab49ea-6c32-4ca5-94a1-49560e3e4234 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:24.486670 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:24.490549 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b483272-942b-4b4a-a5e3-43e3f69083a6 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:24.501905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c342c-504c-4d5a-8bfe-60e0aa020cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:24.502476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c342c-504c-4d5a-8bfe-60e0aa020cbb None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:24.502757 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c342c-504c-4d5a-8bfe-60e0aa020cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:24.503040 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c342c-504c-4d5a-8bfe-60e0aa020cbb None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:24.503742 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c342c-504c-4d5a-8bfe-60e0aa020cbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:24.505913 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c342c-504c-4d5a-8bfe-60e0aa020cbb None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:24.531806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d974d35-ade7-47a9-9fc5-d35106fd866a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:24.532466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d974d35-ade7-47a9-9fc5-d35106fd866a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:24.532772 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d974d35-ade7-47a9-9fc5-d35106fd866a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:24.533060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d974d35-ade7-47a9-9fc5-d35106fd866a None admin] PATH_INFO: `/v3/users/694adc30d18d4b1d81978cceb42c7e45` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:24.534239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d974d35-ade7-47a9-9fc5-d35106fd866a None admin] RBAC: Authorizing `identity:get_user(user_id=694adc30d18d4b1d81978cceb42c7e45)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:24.535740 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d974d35-ade7-47a9-9fc5-d35106fd866a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:24.537953 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 103/200] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:24 2022] GET /identity/v3/users/694adc30d18d4b1d81978cceb42c7e45 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:24.538742 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d974d35-ade7-47a9-9fc5-d35106fd866a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:24.621724 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 98/201] 10.222.0.75 () {60 vars in 1132 bytes} [Thu Jul 28 17:44:24 2022] POST /identity/v3/users => generated 297 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:44:24.623028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c342c-504c-4d5a-8bfe-60e0aa020cbb None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:24.653315 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d974d35-ade7-47a9-9fc5-d35106fd866a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:24.702261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346c600-0928-4d95-a511-818a782be9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:24.703087 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346c600-0928-4d95-a511-818a782be9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:24.703434 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346c600-0928-4d95-a511-818a782be9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:24.703784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346c600-0928-4d95-a511-818a782be9e3 None admin] PATH_INFO: `/v3/users/805ae67c835b4cacafbceefc9d591090` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:24.705782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346c600-0928-4d95-a511-818a782be9e3 None admin] RBAC: Authorizing `identity:get_user(user_id=805ae67c835b4cacafbceefc9d591090)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:24.707574 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346c600-0928-4d95-a511-818a782be9e3 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:24.709490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 104/202] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:24 2022] GET /identity/v3/users/805ae67c835b4cacafbceefc9d591090 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:24.715370 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346c600-0928-4d95-a511-818a782be9e3 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:24.754311 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:24.771463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c342c-504c-4d5a-8bfe-60e0aa020cbb None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:24.802235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:24.815695 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e1e05-6a51-4501-9ae8-ff6a3be76050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:24.816669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e1e05-6a51-4501-9ae8-ff6a3be76050 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:24.817177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e1e05-6a51-4501-9ae8-ff6a3be76050 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:24.818187 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e1e05-6a51-4501-9ae8-ff6a3be76050 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:24.828778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346c600-0928-4d95-a511-818a782be9e3 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:24.878667 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbaf8c-73a5-47bd-a0dd-3c3f6ab598b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:24.879319 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbaf8c-73a5-47bd-a0dd-3c3f6ab598b2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:24.879632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbaf8c-73a5-47bd-a0dd-3c3f6ab598b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:24.880503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbaf8c-73a5-47bd-a0dd-3c3f6ab598b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:24.918206 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e1e05-6a51-4501-9ae8-ff6a3be76050 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:24.920181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e1e05-6a51-4501-9ae8-ff6a3be76050 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:24.971926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbaf8c-73a5-47bd-a0dd-3c3f6ab598b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:24.974339 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbaf8c-73a5-47bd-a0dd-3c3f6ab598b2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:25.030667 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:25.067021 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 99/203] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:25.073399 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e1e05-6a51-4501-9ae8-ff6a3be76050 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:25.108271 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:25.122638 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 105/204] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:44:25.128837 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbaf8c-73a5-47bd-a0dd-3c3f6ab598b2 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:25.251795 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e1e05-6a51-4501-9ae8-ff6a3be76050 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:25.259025 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbaf8c-73a5-47bd-a0dd-3c3f6ab598b2 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:25.304861 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e3cd1-9a8d-4c02-be2c-6f82542ed53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:25.304861 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e3cd1-9a8d-4c02-be2c-6f82542ed53e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:25.304861 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e3cd1-9a8d-4c02-be2c-6f82542ed53e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:25.305179 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e3cd1-9a8d-4c02-be2c-6f82542ed53e None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:25.306376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e3cd1-9a8d-4c02-be2c-6f82542ed53e None admin] RBAC: Authorizing `identity:get_project(project_id=005e84bc135b44f088d0ad047d11daf7)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:25.307762 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e3cd1-9a8d-4c02-be2c-6f82542ed53e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:25.309504 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 106/205] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:25 2022] GET /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:25.315859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e3cd1-9a8d-4c02-be2c-6f82542ed53e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:25.320210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:25.353646 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8630e1-7ee1-4559-b0cf-e79af2119e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:25.354314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8630e1-7ee1-4559-b0cf-e79af2119e4e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:25.354608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8630e1-7ee1-4559-b0cf-e79af2119e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:25.356048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8630e1-7ee1-4559-b0cf-e79af2119e4e None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:25.358595 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8630e1-7ee1-4559-b0cf-e79af2119e4e None admin] RBAC: Authorizing `identity:get_project(project_id=3747706d68904890975b5253c7f2b3a9)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:25.360152 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8630e1-7ee1-4559-b0cf-e79af2119e4e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:25.368109 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 100/206] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:25 2022] GET /identity/v3/projects/3747706d68904890975b5253c7f2b3a9 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:25.370219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8630e1-7ee1-4559-b0cf-e79af2119e4e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:25.498706 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e3cd1-9a8d-4c02-be2c-6f82542ed53e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:25.554470 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:25.563740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8630e1-7ee1-4559-b0cf-e79af2119e4e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:25.564861 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed13238-9a70-4300-a301-5b2a4e416578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:25.565503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed13238-9a70-4300-a301-5b2a4e416578 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:25.565786 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed13238-9a70-4300-a301-5b2a4e416578 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:25.566065 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed13238-9a70-4300-a301-5b2a4e416578 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:25.566871 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed13238-9a70-4300-a301-5b2a4e416578 None admin] RBAC: Adding query filter params (role.id=b25f2feb715144eebde4711522cb8024, scope.project.id=005e84bc135b44f088d0ad047d11daf7, user.id=805ae67c835b4cacafbceefc9d591090) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:25.567188 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed13238-9a70-4300-a301-5b2a4e416578 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:25.569288 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed13238-9a70-4300-a301-5b2a4e416578 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:25.584138 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 107/207] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:44:25 2022] GET /identity/v3/role_assignments?user.id=805ae67c835b4cacafbceefc9d591090&scope.project.id=005e84bc135b44f088d0ad047d11daf7&role.id=b25f2feb715144eebde4711522cb8024 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:25.617779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37389fd0-d1c2-41b5-8927-8c2b70677d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:25.618435 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37389fd0-d1c2-41b5-8927-8c2b70677d0d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:25.618718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37389fd0-d1c2-41b5-8927-8c2b70677d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:25.618996 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37389fd0-d1c2-41b5-8927-8c2b70677d0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:25.619823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37389fd0-d1c2-41b5-8927-8c2b70677d0d None admin] RBAC: Adding query filter params (role.id=e2024b6eae3d49f09caa7d4275eb88bc, scope.project.id=3747706d68904890975b5253c7f2b3a9, user.id=694adc30d18d4b1d81978cceb42c7e45) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:25.620136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37389fd0-d1c2-41b5-8927-8c2b70677d0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:25.621776 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37389fd0-d1c2-41b5-8927-8c2b70677d0d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:25.628584 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 101/208] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:44:25 2022] GET /identity/v3/role_assignments?user.id=694adc30d18d4b1d81978cceb42c7e45&scope.project.id=3747706d68904890975b5253c7f2b3a9&role.id=e2024b6eae3d49f09caa7d4275eb88bc => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:26.554366 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e82f8-3ec2-46a1-9cea-b54ac04c4411 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:26.554870 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e82f8-3ec2-46a1-9cea-b54ac04c4411 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:26.554946 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e82f8-3ec2-46a1-9cea-b54ac04c4411 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:26.556302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 108/209] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:26.562224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70ba22-294f-4afb-9970-7756030bc124 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:26.562684 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70ba22-294f-4afb-9970-7756030bc124 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:26.562864 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70ba22-294f-4afb-9970-7756030bc124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:26.584053 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ac70ba22-294f-4afb-9970-7756030bc124 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:26.585355 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ac70ba22-294f-4afb-9970-7756030bc124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:26.655943 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 102/210] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:44:26.678653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e82f8-3ec2-46a1-9cea-b54ac04c4411 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:26.751068 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:26.787809 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e82f8-3ec2-46a1-9cea-b54ac04c4411 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:26.825844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254193c9-5659-4d3f-a528-db4b0da9507f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:26.826911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254193c9-5659-4d3f-a528-db4b0da9507f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:26.827433 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254193c9-5659-4d3f-a528-db4b0da9507f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:26.827906 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254193c9-5659-4d3f-a528-db4b0da9507f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:26.840256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254193c9-5659-4d3f-a528-db4b0da9507f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:26.846124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-254193c9-5659-4d3f-a528-db4b0da9507f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:26.846124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:26.846124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:26.846124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:26.846124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:26.846124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:26.846124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:26.846124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:26.846124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:26.846124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:26.846124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:26.846124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:26.846124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:26.846124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:26.846124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:26.846124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:26.846997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:26.846997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:26.846997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:26.846997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:26.846997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:26.846997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:26.846997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:26.846997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:26.846997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:26.846997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:26.846997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:26.846997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:26.846997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:26.846997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:26.846997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:26.846997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:26.847765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:26.847765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:26.847765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:26.847765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:26.847765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:26.847765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:26.847765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:26.847765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:26.847765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:26.847765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:26.847765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:26.847765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:26.850079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 109/211] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:44:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:26.858239 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70ba22-294f-4afb-9970-7756030bc124 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:26.945289 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:26.961089 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70ba22-294f-4afb-9970-7756030bc124 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:26.995780 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dca86-c595-4603-ab57-958d219c8f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:26.996413 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dca86-c595-4603-ab57-958d219c8f9f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:26.996774 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dca86-c595-4603-ab57-958d219c8f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:26.997128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dca86-c595-4603-ab57-958d219c8f9f None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:26.998260 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dca86-c595-4603-ab57-958d219c8f9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:26.998585 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dca86-c595-4603-ab57-958d219c8f9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:27.000299 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dca86-c595-4603-ab57-958d219c8f9f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:27.013713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 103/212] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:27.016090 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254193c9-5659-4d3f-a528-db4b0da9507f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:27.054791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f7092-981a-4a77-8c5d-31b717d67ca3 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:27.055090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f7092-981a-4a77-8c5d-31b717d67ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:27.055362 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f7092-981a-4a77-8c5d-31b717d67ca3 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:27.056730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 104/213] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:44:27.061852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f8163-07f9-4b5f-8e5f-d27a76c15813 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:27.062145 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f8163-07f9-4b5f-8e5f-d27a76c15813 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:27.062432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f8163-07f9-4b5f-8e5f-d27a76c15813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:27.081436 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f20f8163-07f9-4b5f-8e5f-d27a76c15813 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:27.082651 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f20f8163-07f9-4b5f-8e5f-d27a76c15813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:27.130160 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254193c9-5659-4d3f-a528-db4b0da9507f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:27.158354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 105/214] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:44:27.170027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:27.177378 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4ab56-c27a-4cfd-9248-f786a3ae232d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:27.178132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4ab56-c27a-4cfd-9248-f786a3ae232d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:27.178482 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4ab56-c27a-4cfd-9248-f786a3ae232d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:27.178769 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4ab56-c27a-4cfd-9248-f786a3ae232d None admin] PATH_INFO: `/v3/users/694adc30d18d4b1d81978cceb42c7e45` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:27.180009 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4ab56-c27a-4cfd-9248-f786a3ae232d None admin] RBAC: Authorizing `identity:get_user(user_id=694adc30d18d4b1d81978cceb42c7e45)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:27.181937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4ab56-c27a-4cfd-9248-f786a3ae232d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:27.182262 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f8163-07f9-4b5f-8e5f-d27a76c15813 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:27.183816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 110/215] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:27 2022] GET /identity/v3/users/694adc30d18d4b1d81978cceb42c7e45 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:27.192356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4ab56-c27a-4cfd-9248-f786a3ae232d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:27.272138 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:27.294967 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f8163-07f9-4b5f-8e5f-d27a76c15813 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:27.305889 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4ab56-c27a-4cfd-9248-f786a3ae232d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:27.333599 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf18bd-d875-4048-982b-b1557d991606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:27.334288 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf18bd-d875-4048-982b-b1557d991606 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:27.334571 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf18bd-d875-4048-982b-b1557d991606 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:27.334847 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf18bd-d875-4048-982b-b1557d991606 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:27.346586 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf18bd-d875-4048-982b-b1557d991606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:27.349994 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1748c90-cd57-40bd-bc32-b5649e38b3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:27.350812 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1748c90-cd57-40bd-bc32-b5649e38b3af None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:27.351242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1748c90-cd57-40bd-bc32-b5649e38b3af None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:27.351664 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1748c90-cd57-40bd-bc32-b5649e38b3af None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:27.351793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-8baf18bd-d875-4048-982b-b1557d991606 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:27.351793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:27.351793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:27.351793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:27.351793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:27.351793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:27.351793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:27.351793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:27.351793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:27.351793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:27.351793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:27.351793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:27.351793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:27.351793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:27.351793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:27.351793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:27.352830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:27.352830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:27.352830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:27.352830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:27.352830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:27.352830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:27.352830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:27.352830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:27.352830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:27.352830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:27.352830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:27.352830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:27.352830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:27.352830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:27.352830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:27.352830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:27.359185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:27.359185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:27.359185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:27.359185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:27.359185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:27.359185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:27.359185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:27.359185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:27.359185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:27.359185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:27.359185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:27.359185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:27.359185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 106/216] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:44:27.359831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1748c90-cd57-40bd-bc32-b5649e38b3af None admin] RBAC: Authorizing `identity:get_project(project_id=3747706d68904890975b5253c7f2b3a9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:27.359900 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08a939-0d80-41dd-8cdc-d416eb579ccd None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:27.359900 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08a939-0d80-41dd-8cdc-d416eb579ccd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:27.359900 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08a939-0d80-41dd-8cdc-d416eb579ccd None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:27.360097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1748c90-cd57-40bd-bc32-b5649e38b3af None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:27.360162 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 107/217] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:27.360233 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 111/218] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:27 2022] GET /identity/v3/projects/3747706d68904890975b5253c7f2b3a9 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:27.365806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08a939-0d80-41dd-8cdc-d416eb579ccd None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:27.366835 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed969c-281b-4d1c-8851-61bdee90d37d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:27.367130 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed969c-281b-4d1c-8851-61bdee90d37d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:27.367407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed969c-281b-4d1c-8851-61bdee90d37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:27.386867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-56ed969c-281b-4d1c-8851-61bdee90d37d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:27.388496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-56ed969c-281b-4d1c-8851-61bdee90d37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:27.457334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:27.465773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 112/219] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:27.473599 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed969c-281b-4d1c-8851-61bdee90d37d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:27.478022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08a939-0d80-41dd-8cdc-d416eb579ccd None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:27.514911 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac565ff-72de-4682-9311-e62686f89363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:27.515137 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac565ff-72de-4682-9311-e62686f89363 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:27.515325 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac565ff-72de-4682-9311-e62686f89363 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:27.515553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac565ff-72de-4682-9311-e62686f89363 None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9/users/694adc30d18d4b1d81978cceb42c7e45/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:27.517540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac565ff-72de-4682-9311-e62686f89363 None admin] RBAC: Authorizing `identity:create_grant(project_id=3747706d68904890975b5253c7f2b3a9, user_id=694adc30d18d4b1d81978cceb42c7e45, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:27.519001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac565ff-72de-4682-9311-e62686f89363 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:27.580331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed969c-281b-4d1c-8851-61bdee90d37d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:27.613833 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e0af7-15c0-481e-9270-830215e63c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:27.615096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e0af7-15c0-481e-9270-830215e63c35 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:27.615380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e0af7-15c0-481e-9270-830215e63c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:27.615654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e0af7-15c0-481e-9270-830215e63c35 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:27.616373 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e0af7-15c0-481e-9270-830215e63c35 None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:27.616681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e0af7-15c0-481e-9270-830215e63c35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:27.618111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e0af7-15c0-481e-9270-830215e63c35 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:27.622095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:27.626974 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 113/220] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:27.632099 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e0af7-15c0-481e-9270-830215e63c35 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:27.632224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 108/221] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:44:27 2022] PUT /identity/v3/projects/3747706d68904890975b5253c7f2b3a9/users/694adc30d18d4b1d81978cceb42c7e45/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:44:27.636237 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac565ff-72de-4682-9311-e62686f89363 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:27.704873 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:27.766009 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e0af7-15c0-481e-9270-830215e63c35 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:27.783059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac565ff-72de-4682-9311-e62686f89363 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:27.804444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905efd0-93a5-4d4a-b9d1-cfa043aab4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:27.805228 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905efd0-93a5-4d4a-b9d1-cfa043aab4af None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:27.805547 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905efd0-93a5-4d4a-b9d1-cfa043aab4af None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:27.806811 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905efd0-93a5-4d4a-b9d1-cfa043aab4af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:27.807007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905efd0-93a5-4d4a-b9d1-cfa043aab4af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:27.808480 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905efd0-93a5-4d4a-b9d1-cfa043aab4af None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:27.810360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 114/222] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:44:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:27.811297 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d8487-9225-4b4b-837e-a2d57ead13e9 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:27.811544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d8487-9225-4b4b-837e-a2d57ead13e9 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:27.811816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d8487-9225-4b4b-837e-a2d57ead13e9 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:27.813230 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 115/223] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:27.819203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2a390-5437-4569-be41-630a97ee81ed None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:27.819490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2a390-5437-4569-be41-630a97ee81ed None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:27.819858 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2a390-5437-4569-be41-630a97ee81ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:27.830487 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e62464-abf8-49a4-b720-9b59663644f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:27.831116 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e62464-abf8-49a4-b720-9b59663644f3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:27.831361 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e62464-abf8-49a4-b720-9b59663644f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:27.831636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e62464-abf8-49a4-b720-9b59663644f3 None admin] PATH_INFO: `/v3/users/f1a2c644931943709b7246165e75583f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:27.838818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-91d2a390-5437-4569-be41-630a97ee81ed None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:27.840206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-91d2a390-5437-4569-be41-630a97ee81ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:27.846388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e62464-abf8-49a4-b720-9b59663644f3 None admin] RBAC: Authorizing `identity:get_user(user_id=f1a2c644931943709b7246165e75583f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:27.847882 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e62464-abf8-49a4-b720-9b59663644f3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:27.850147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 109/224] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:27 2022] GET /identity/v3/users/f1a2c644931943709b7246165e75583f => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:27.850982 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e62464-abf8-49a4-b720-9b59663644f3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:27.920811 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 116/225] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:44:27.921038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:27.921134 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2a390-5437-4569-be41-630a97ee81ed None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:27.976148 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e62464-abf8-49a4-b720-9b59663644f3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:27.978381 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:28.014624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3c26d-ed3f-433e-bf99-c805e9f1679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:28.015562 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3c26d-ed3f-433e-bf99-c805e9f1679d None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:28.015845 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3c26d-ed3f-433e-bf99-c805e9f1679d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:28.016383 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3c26d-ed3f-433e-bf99-c805e9f1679d None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:28.017165 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3c26d-ed3f-433e-bf99-c805e9f1679d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:28.019103 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3c26d-ed3f-433e-bf99-c805e9f1679d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:28.025209 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2a390-5437-4569-be41-630a97ee81ed None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:28.059584 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74070cdc-88c9-4b42-86db-7a0c25810b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:28.060218 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74070cdc-88c9-4b42-86db-7a0c25810b1c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:28.060480 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74070cdc-88c9-4b42-86db-7a0c25810b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:28.060772 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74070cdc-88c9-4b42-86db-7a0c25810b1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:28.133858 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74070cdc-88c9-4b42-86db-7a0c25810b1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:28.135297 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74070cdc-88c9-4b42-86db-7a0c25810b1c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:28.143991 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 110/226] 10.222.0.75 () {60 vars in 1132 bytes} [Thu Jul 28 17:44:27 2022] POST /identity/v3/users => generated 297 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:44:28.143991 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3c26d-ed3f-433e-bf99-c805e9f1679d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:28.211672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:28.279954 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3c26d-ed3f-433e-bf99-c805e9f1679d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:28.284330 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 117/227] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:28.291639 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74070cdc-88c9-4b42-86db-7a0c25810b1c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:28.298068 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:28.329744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851be1a9-e3c2-4fd8-9138-e1e5237286c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:28.330549 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851be1a9-e3c2-4fd8-9138-e1e5237286c1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:28.330802 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851be1a9-e3c2-4fd8-9138-e1e5237286c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:28.331384 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851be1a9-e3c2-4fd8-9138-e1e5237286c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:28.349071 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851be1a9-e3c2-4fd8-9138-e1e5237286c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:28.354306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-851be1a9-e3c2-4fd8-9138-e1e5237286c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:28.354306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:28.354306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:28.354306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:28.354306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:28.354306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:28.354306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:28.354306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:28.354306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:28.354306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:28.354306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:28.354306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:28.354306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:28.354306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:28.354306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:28.354306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:28.355179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:28.355179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:28.355179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:28.355179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:28.355179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:28.355179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:28.355179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:28.355179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:28.355179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:28.355179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:28.355179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:28.355179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:28.355179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:28.355179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:28.355179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:28.355179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:28.356010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:28.356010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:28.356010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:28.356010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:28.356010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:28.356010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:28.356010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:28.356010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:28.356010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:28.356010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:28.356010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:28.356010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:28.356010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 111/228] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:44:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:28.363911 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851be1a9-e3c2-4fd8-9138-e1e5237286c1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:28.437649 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74070cdc-88c9-4b42-86db-7a0c25810b1c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:28.486679 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a03f0-9411-4e9f-859c-5d61a8b5f77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:28.487354 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a03f0-9411-4e9f-859c-5d61a8b5f77a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:28.487639 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a03f0-9411-4e9f-859c-5d61a8b5f77a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:28.487919 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a03f0-9411-4e9f-859c-5d61a8b5f77a None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:28.490130 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a03f0-9411-4e9f-859c-5d61a8b5f77a None admin] RBAC: Authorizing `identity:get_project(project_id=3747706d68904890975b5253c7f2b3a9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:28.491955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a03f0-9411-4e9f-859c-5d61a8b5f77a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:28.494056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 118/229] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:28 2022] GET /identity/v3/projects/3747706d68904890975b5253c7f2b3a9 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:28.497280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851be1a9-e3c2-4fd8-9138-e1e5237286c1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:28.499922 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a03f0-9411-4e9f-859c-5d61a8b5f77a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:28.532325 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:28.540107 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fbb18-3808-44c7-ae7e-5201eb2029ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:28.541061 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fbb18-3808-44c7-ae7e-5201eb2029ae None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:28.541382 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fbb18-3808-44c7-ae7e-5201eb2029ae None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:28.541749 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fbb18-3808-44c7-ae7e-5201eb2029ae None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:28.542583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fbb18-3808-44c7-ae7e-5201eb2029ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:28.542974 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fbb18-3808-44c7-ae7e-5201eb2029ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:28.544439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fbb18-3808-44c7-ae7e-5201eb2029ae None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:28.554167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 112/230] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:44:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:28.559631 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fbb18-3808-44c7-ae7e-5201eb2029ae None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:28.614421 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:28.636710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a03f0-9411-4e9f-859c-5d61a8b5f77a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:28.689188 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af3a35-085f-4661-a2f3-9b344465d3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:28.689749 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af3a35-085f-4661-a2f3-9b344465d3df None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:28.690054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af3a35-085f-4661-a2f3-9b344465d3df None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:28.690589 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af3a35-085f-4661-a2f3-9b344465d3df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:28.691412 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af3a35-085f-4661-a2f3-9b344465d3df None admin] RBAC: Adding query filter params (role.id=279c255613df457cb2d5d9904dd6f12a, scope.project.id=3747706d68904890975b5253c7f2b3a9, user.id=f1a2c644931943709b7246165e75583f) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:28.691728 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af3a35-085f-4661-a2f3-9b344465d3df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:28.694750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af3a35-085f-4661-a2f3-9b344465d3df None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:28.701864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 119/231] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:44:28 2022] GET /identity/v3/role_assignments?user.id=f1a2c644931943709b7246165e75583f&scope.project.id=3747706d68904890975b5253c7f2b3a9&role.id=279c255613df457cb2d5d9904dd6f12a => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:28.719732 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fbb18-3808-44c7-ae7e-5201eb2029ae None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:28.765611 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834ba68-4e1d-40ed-a090-5a3cfdc4ab65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:28.766686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834ba68-4e1d-40ed-a090-5a3cfdc4ab65 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:28.767192 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834ba68-4e1d-40ed-a090-5a3cfdc4ab65 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:28.767677 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834ba68-4e1d-40ed-a090-5a3cfdc4ab65 None admin] PATH_INFO: `/v3/users/694adc30d18d4b1d81978cceb42c7e45` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:28.772040 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834ba68-4e1d-40ed-a090-5a3cfdc4ab65 None admin] RBAC: Authorizing `identity:get_user(user_id=694adc30d18d4b1d81978cceb42c7e45)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:28.773949 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834ba68-4e1d-40ed-a090-5a3cfdc4ab65 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:28.776412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 113/232] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:28 2022] GET /identity/v3/users/694adc30d18d4b1d81978cceb42c7e45 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:28.782188 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af3a35-085f-4661-a2f3-9b344465d3df None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:28.920609 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:28.951989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af3a35-085f-4661-a2f3-9b344465d3df None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:28.988952 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d6eeb-70bc-4d3c-ad6c-887af5150b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:28.989626 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d6eeb-70bc-4d3c-ad6c-887af5150b6f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:28.989987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d6eeb-70bc-4d3c-ad6c-887af5150b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:28.990301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d6eeb-70bc-4d3c-ad6c-887af5150b6f None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:28.991748 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d6eeb-70bc-4d3c-ad6c-887af5150b6f None admin] RBAC: Authorizing `identity:get_project(project_id=3747706d68904890975b5253c7f2b3a9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:28.993574 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d6eeb-70bc-4d3c-ad6c-887af5150b6f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:28.995694 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 120/233] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:28 2022] GET /identity/v3/projects/3747706d68904890975b5253c7f2b3a9 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:29.001322 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834ba68-4e1d-40ed-a090-5a3cfdc4ab65 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:29.147450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834ba68-4e1d-40ed-a090-5a3cfdc4ab65 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:29.149031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:29.181887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4d479-5ec2-4036-af44-0a2184e0a2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:29.182571 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4d479-5ec2-4036-af44-0a2184e0a2ec None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:29.182852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4d479-5ec2-4036-af44-0a2184e0a2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:29.183127 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4d479-5ec2-4036-af44-0a2184e0a2ec None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9/users/694adc30d18d4b1d81978cceb42c7e45/roles/e2024b6eae3d49f09caa7d4275eb88bc` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:29.185385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4d479-5ec2-4036-af44-0a2184e0a2ec None admin] RBAC: Authorizing `identity:create_grant(project_id=3747706d68904890975b5253c7f2b3a9, user_id=694adc30d18d4b1d81978cceb42c7e45, role_id=e2024b6eae3d49f09caa7d4275eb88bc)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:29.186907 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4d479-5ec2-4036-af44-0a2184e0a2ec None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:29.262319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 114/234] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:44:28 2022] PUT /identity/v3/projects/3747706d68904890975b5253c7f2b3a9/users/694adc30d18d4b1d81978cceb42c7e45/roles/e2024b6eae3d49f09caa7d4275eb88bc => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:44:30.072622 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a04ce4-86e0-42f0-98b6-f9fd819c7783 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:30.073152 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a04ce4-86e0-42f0-98b6-f9fd819c7783 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:30.073227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a04ce4-86e0-42f0-98b6-f9fd819c7783 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:30.074918 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 121/235] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:30.080023 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521ad13-9add-417e-9328-c14693c12e50 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:30.080449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521ad13-9add-417e-9328-c14693c12e50 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:30.080617 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521ad13-9add-417e-9328-c14693c12e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:30.099438 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0521ad13-9add-417e-9328-c14693c12e50 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:30.100615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0521ad13-9add-417e-9328-c14693c12e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:30.189103 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 115/236] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:30.207043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a04ce4-86e0-42f0-98b6-f9fd819c7783 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:30.353682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a04ce4-86e0-42f0-98b6-f9fd819c7783 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:30.388530 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd37434-d803-4978-9a85-2126a5acf005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:30.389221 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd37434-d803-4978-9a85-2126a5acf005 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:30.389510 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd37434-d803-4978-9a85-2126a5acf005 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:30.389789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd37434-d803-4978-9a85-2126a5acf005 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:30.401345 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd37434-d803-4978-9a85-2126a5acf005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:30.407426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-6dd37434-d803-4978-9a85-2126a5acf005 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:30.407426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:30.407426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:30.407426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:30.407426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:30.407426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:30.407426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:30.407426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:30.407426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:30.407426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:30.407426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:30.407426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:30.407426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:30.407426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:30.407426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:30.407426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:30.408308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:30.408308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:30.408308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:30.408308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:30.408308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:30.408308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:30.408308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:30.408308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:30.408308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:30.408308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:30.408308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:30.408308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:30.408308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:30.408308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:30.408308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:30.408308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:30.409143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:30.409143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:30.409143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:30.409143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:30.409143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:30.409143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:30.409143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:30.409143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:30.409143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:30.409143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:30.409143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:30.409143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:30.409143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 122/237] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:44:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:30.414913 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521ad13-9add-417e-9328-c14693c12e50 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:30.553119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:30.562552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521ad13-9add-417e-9328-c14693c12e50 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:30.612404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67115db1-50f1-4952-835e-9e90a4ef6f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:30.612988 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67115db1-50f1-4952-835e-9e90a4ef6f23 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:30.613275 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67115db1-50f1-4952-835e-9e90a4ef6f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:30.613551 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67115db1-50f1-4952-835e-9e90a4ef6f23 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:30.614363 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67115db1-50f1-4952-835e-9e90a4ef6f23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:30.614671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67115db1-50f1-4952-835e-9e90a4ef6f23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:30.616062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67115db1-50f1-4952-835e-9e90a4ef6f23 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:30.625153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 116/238] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:30.631080 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd37434-d803-4978-9a85-2126a5acf005 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:30.671773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:30.774292 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096dc86-9a2e-40f6-8417-44ebcd8ded04 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:30.774992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096dc86-9a2e-40f6-8417-44ebcd8ded04 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:30.775504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096dc86-9a2e-40f6-8417-44ebcd8ded04 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:30.777623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 117/239] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:30.783978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47da93-70e9-420b-8646-db8502f8dc5e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:30.784905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47da93-70e9-420b-8646-db8502f8dc5e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:30.785390 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47da93-70e9-420b-8646-db8502f8dc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:30.806813 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9c47da93-70e9-420b-8646-db8502f8dc5e None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:30.808386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9c47da93-70e9-420b-8646-db8502f8dc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:30.821679 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd37434-d803-4978-9a85-2126a5acf005 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:30.870810 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd9066-2d40-480f-8d88-4518060fb152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:30.871399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd9066-2d40-480f-8d88-4518060fb152 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:30.871678 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd9066-2d40-480f-8d88-4518060fb152 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:30.871954 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd9066-2d40-480f-8d88-4518060fb152 None admin] PATH_INFO: `/v3/users/694adc30d18d4b1d81978cceb42c7e45` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:30.877565 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd9066-2d40-480f-8d88-4518060fb152 None admin] RBAC: Authorizing `identity:get_user(user_id=694adc30d18d4b1d81978cceb42c7e45)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:30.879324 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd9066-2d40-480f-8d88-4518060fb152 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:30.881587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 123/240] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:30 2022] GET /identity/v3/users/694adc30d18d4b1d81978cceb42c7e45 => generated 283 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:30.887093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd9066-2d40-480f-8d88-4518060fb152 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:30.902070 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 118/241] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:44:30.903443 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9423d83-796e-4a48-9fab-b569f617ce24 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:30.903738 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9423d83-796e-4a48-9fab-b569f617ce24 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:30.904014 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9423d83-796e-4a48-9fab-b569f617ce24 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:30.905543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 119/242] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:30.910932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6248b1-8d74-41cc-beb4-859a676bf084 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:30.911292 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6248b1-8d74-41cc-beb4-859a676bf084 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:30.911582 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6248b1-8d74-41cc-beb4-859a676bf084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:30.934755 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ac6248b1-8d74-41cc-beb4-859a676bf084 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:30.936024 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ac6248b1-8d74-41cc-beb4-859a676bf084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:30.984983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:31.015799 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd9066-2d40-480f-8d88-4518060fb152 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:31.025803 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 120/243] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:44:31.029637 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6248b1-8d74-41cc-beb4-859a676bf084 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:31.061142 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:31.069412 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b3571-c1a9-41a4-aafd-b0db73048ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:31.070167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b3571-c1a9-41a4-aafd-b0db73048ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:31.070511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b3571-c1a9-41a4-aafd-b0db73048ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:31.073653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b3571-c1a9-41a4-aafd-b0db73048ad6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:31.147375 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b3571-c1a9-41a4-aafd-b0db73048ad6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:31.149047 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b3571-c1a9-41a4-aafd-b0db73048ad6 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:31.174798 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6248b1-8d74-41cc-beb4-859a676bf084 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:31.218757 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9baae9-7a57-4ae7-910b-802dd8cdebd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:31.220074 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9baae9-7a57-4ae7-910b-802dd8cdebd2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:31.220367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9baae9-7a57-4ae7-910b-802dd8cdebd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:31.220645 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9baae9-7a57-4ae7-910b-802dd8cdebd2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:31.234991 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9baae9-7a57-4ae7-910b-802dd8cdebd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:31.236581 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:31.241378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-7d9baae9-7a57-4ae7-910b-802dd8cdebd2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:44:31.241378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:31.241378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:31.241378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:31.241378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:31.241378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:31.241378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:31.241378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:31.241378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:31.241378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:31.241378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:31.241378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:31.241378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:31.241378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:31.241378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:31.241378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:31.243185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:31.243185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:31.243185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:31.243185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:31.243185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:31.243185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:31.243185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:31.243185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:31.243185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:31.243185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:31.243185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:31.243185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:31.243185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:31.243185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:31.243185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:31.243185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:31.244304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:31.244304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:31.244304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:31.244304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:31.244304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:31.244304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:31.244304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:31.244304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:31.244304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:31.244304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:31.244304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:44:31.244304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:31.244304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 121/244] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:31.244304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9baae9-7a57-4ae7-910b-802dd8cdebd2 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:31.259288 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 124/245] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:44:31.260429 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b3571-c1a9-41a4-aafd-b0db73048ad6 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:31.336889 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:31.366901 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b3571-c1a9-41a4-aafd-b0db73048ad6 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:31.374651 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9baae9-7a57-4ae7-910b-802dd8cdebd2 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:31.403722 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b2c58-d376-49de-bcbe-273a9aceadc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:31.404274 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b2c58-d376-49de-bcbe-273a9aceadc1 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:31.404560 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b2c58-d376-49de-bcbe-273a9aceadc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:31.405179 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b2c58-d376-49de-bcbe-273a9aceadc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:31.405894 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b2c58-d376-49de-bcbe-273a9aceadc1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:31.406280 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b2c58-d376-49de-bcbe-273a9aceadc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:31.407684 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b2c58-d376-49de-bcbe-273a9aceadc1 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:31.413254 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc2d92-75f3-4428-a334-c92cd89bb6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:31.414129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc2d92-75f3-4428-a334-c92cd89bb6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:31.414559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc2d92-75f3-4428-a334-c92cd89bb6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:31.414982 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc2d92-75f3-4428-a334-c92cd89bb6c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:31.416173 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 125/246] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:31.416443 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc2d92-75f3-4428-a334-c92cd89bb6c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:31.417018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b2c58-d376-49de-bcbe-273a9aceadc1 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:31.418664 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc2d92-75f3-4428-a334-c92cd89bb6c9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:31.420149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 122/247] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:44:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:31.425814 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088de071-b551-4b51-90e3-4307d01877ca None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:31.426108 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088de071-b551-4b51-90e3-4307d01877ca None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:31.426422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088de071-b551-4b51-90e3-4307d01877ca None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:31.427821 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 123/248] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:31.428459 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088de071-b551-4b51-90e3-4307d01877ca None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:31.475431 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:31.533934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b2c58-d376-49de-bcbe-273a9aceadc1 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:31.546984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088de071-b551-4b51-90e3-4307d01877ca None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:31.569524 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812480c9-4d6a-4e25-989a-836d967dd358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:31.570200 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812480c9-4d6a-4e25-989a-836d967dd358 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:31.570478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812480c9-4d6a-4e25-989a-836d967dd358 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:31.570752 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812480c9-4d6a-4e25-989a-836d967dd358 None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:31.572074 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812480c9-4d6a-4e25-989a-836d967dd358 None admin] RBAC: Authorizing `identity:get_project(project_id=3747706d68904890975b5253c7f2b3a9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:31.573590 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812480c9-4d6a-4e25-989a-836d967dd358 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:31.575440 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 126/249] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:31 2022] GET /identity/v3/projects/3747706d68904890975b5253c7f2b3a9 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:31.576018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812480c9-4d6a-4e25-989a-836d967dd358 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:31.593103 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47373df8-90f4-41e9-b67c-022e652ff452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:31.594022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47373df8-90f4-41e9-b67c-022e652ff452 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:31.594455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47373df8-90f4-41e9-b67c-022e652ff452 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:31.594878 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47373df8-90f4-41e9-b67c-022e652ff452 None admin] PATH_INFO: `/v3/users/f76074415825460cbddbca1d7ec98d3a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:31.608418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:31.610983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47373df8-90f4-41e9-b67c-022e652ff452 None admin] RBAC: Authorizing `identity:get_user(user_id=f76074415825460cbddbca1d7ec98d3a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:31.612736 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47373df8-90f4-41e9-b67c-022e652ff452 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:31.618851 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 124/250] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:31 2022] GET /identity/v3/users/f76074415825460cbddbca1d7ec98d3a => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:31.618851 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe246c-be17-4a0d-bc75-c3a9cc7622ed None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:31.618851 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe246c-be17-4a0d-bc75-c3a9cc7622ed None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:31.618851 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe246c-be17-4a0d-bc75-c3a9cc7622ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:31.639174 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fabe246c-be17-4a0d-bc75-c3a9cc7622ed None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:31.640207 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fabe246c-be17-4a0d-bc75-c3a9cc7622ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:31.696294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812480c9-4d6a-4e25-989a-836d967dd358 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:31.711078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:31.711591 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 125/251] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:31.716973 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe246c-be17-4a0d-bc75-c3a9cc7622ed None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:31.745617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb06f55-55b6-487e-8bc8-9e3eccdabcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:31.746449 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb06f55-55b6-487e-8bc8-9e3eccdabcac None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:31.747044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb06f55-55b6-487e-8bc8-9e3eccdabcac None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:31.747341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb06f55-55b6-487e-8bc8-9e3eccdabcac None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:31.748194 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb06f55-55b6-487e-8bc8-9e3eccdabcac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:31.749806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb06f55-55b6-487e-8bc8-9e3eccdabcac None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:31.819002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe246c-be17-4a0d-bc75-c3a9cc7622ed None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:31.847510 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:31.853246 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2208f9-d382-4df1-ba93-23006473817b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:31.853869 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2208f9-d382-4df1-ba93-23006473817b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:31.854148 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2208f9-d382-4df1-ba93-23006473817b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:31.854499 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2208f9-d382-4df1-ba93-23006473817b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:31.855206 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2208f9-d382-4df1-ba93-23006473817b None admin] RBAC: Adding query filter params (role.id=d371062e071845ffa4570a76d40dff88, scope.project.id=3747706d68904890975b5253c7f2b3a9, user.id=694adc30d18d4b1d81978cceb42c7e45) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:31.855605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2208f9-d382-4df1-ba93-23006473817b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:31.857177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2208f9-d382-4df1-ba93-23006473817b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:31.862820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 126/252] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:44:31 2022] GET /identity/v3/role_assignments?user.id=694adc30d18d4b1d81978cceb42c7e45&scope.project.id=3747706d68904890975b5253c7f2b3a9&role.id=d371062e071845ffa4570a76d40dff88 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:31.873044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2208f9-d382-4df1-ba93-23006473817b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:31.892420 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 127/253] 10.222.0.75 () {60 vars in 1132 bytes} [Thu Jul 28 17:44:31 2022] POST /identity/v3/users => generated 293 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:44:31.902765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb06f55-55b6-487e-8bc8-9e3eccdabcac None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:32.026121 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2208f9-d382-4df1-ba93-23006473817b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:32.062742 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb06f55-55b6-487e-8bc8-9e3eccdabcac None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:32.076190 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8d48f-d750-43bd-a9d1-4bc8ddccd34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:32.077134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8d48f-d750-43bd-a9d1-4bc8ddccd34b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:32.077416 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8d48f-d750-43bd-a9d1-4bc8ddccd34b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:32.077695 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8d48f-d750-43bd-a9d1-4bc8ddccd34b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:32.104004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46731721-01b3-47ba-9e4f-c498e5ee4cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:32.104712 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46731721-01b3-47ba-9e4f-c498e5ee4cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:32.105024 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46731721-01b3-47ba-9e4f-c498e5ee4cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:32.105297 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46731721-01b3-47ba-9e4f-c498e5ee4cc5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:32.119962 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46731721-01b3-47ba-9e4f-c498e5ee4cc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:32.125744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-46731721-01b3-47ba-9e4f-c498e5ee4cc5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:32.125744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:32.125744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:32.125744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:32.125744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:32.125744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:32.125744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:32.125744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:32.125744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:32.125744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:32.125744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:32.125744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:32.125744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:32.125744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:32.125744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:32.125744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:32.126700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:32.126700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:32.126700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:32.126700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:32.126700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:32.126700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:32.126700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:32.126700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:32.126700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:32.126700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:32.126700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:32.126700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:32.126700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:32.126700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:32.126700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:32.126700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:32.127682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:32.127682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:32.127682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:32.127682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:32.127682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:32.127682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:32.127682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:32.127682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:32.127682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:32.127682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:32.127682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:32.127682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:32.127682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 128/254] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:32.128494 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbaffb-22e8-4a16-8a66-b5e2eeecfef0 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:32.128779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbaffb-22e8-4a16-8a66-b5e2eeecfef0 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:32.129066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbaffb-22e8-4a16-8a66-b5e2eeecfef0 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:32.130409 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 129/255] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:32.136066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff4028-efc6-404f-9ccb-e5d62e95b41f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:32.136410 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff4028-efc6-404f-9ccb-e5d62e95b41f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:32.136716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff4028-efc6-404f-9ccb-e5d62e95b41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:32.154657 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:32.157573 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-bfff4028-efc6-404f-9ccb-e5d62e95b41f None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:32.158797 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bfff4028-efc6-404f-9ccb-e5d62e95b41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:32.162376 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8d48f-d750-43bd-a9d1-4bc8ddccd34b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:32.163853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8d48f-d750-43bd-a9d1-4bc8ddccd34b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:32.186171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:32.242887 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 130/256] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:32.244340 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff4028-efc6-404f-9ccb-e5d62e95b41f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:32.289179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 127/257] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:32.289963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8d48f-d750-43bd-a9d1-4bc8ddccd34b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:32.397598 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff4028-efc6-404f-9ccb-e5d62e95b41f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:32.405687 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:32.412697 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8d48f-d750-43bd-a9d1-4bc8ddccd34b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:32.449640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9666d-42ee-4cab-b413-a31e44b68c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:32.450273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9666d-42ee-4cab-b413-a31e44b68c7d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:32.450553 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9666d-42ee-4cab-b413-a31e44b68c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:32.450825 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9666d-42ee-4cab-b413-a31e44b68c7d None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:32.451549 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9666d-42ee-4cab-b413-a31e44b68c7d None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:32.451855 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9666d-42ee-4cab-b413-a31e44b68c7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:32.452845 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47722af-e643-4580-ab08-f8ded9d29a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:32.453302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9666d-42ee-4cab-b413-a31e44b68c7d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:32.453947 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47722af-e643-4580-ab08-f8ded9d29a4a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:32.454427 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47722af-e643-4580-ab08-f8ded9d29a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:32.454961 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47722af-e643-4580-ab08-f8ded9d29a4a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:32.462755 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 131/258] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:32.463571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9666d-42ee-4cab-b413-a31e44b68c7d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:32.467836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47722af-e643-4580-ab08-f8ded9d29a4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:32.474224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-b47722af-e643-4580-ab08-f8ded9d29a4a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:32.474224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:32.474224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:32.474224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:32.474224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:32.474224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:32.474224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:32.474224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:32.474224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:32.474224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:32.474224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:32.474224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:32.474224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:32.474224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:32.474224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:32.474224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:32.475092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:32.475092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:32.475092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:32.475092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:32.475092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:32.475092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:32.475092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:32.475092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:32.475092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:32.475092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:32.475092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:32.475092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:32.475092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:32.475092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:32.475092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:32.475092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:32.475877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:32.475877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:32.475877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:32.475877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:32.475877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:32.475877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:32.475877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:32.475877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:32.475877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:32.475877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:32.475877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:32.475877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:32.478300 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 128/259] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:44:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:32.479418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47722af-e643-4580-ab08-f8ded9d29a4a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:32.497840 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:32.586639 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9666d-42ee-4cab-b413-a31e44b68c7d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:32.587140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47722af-e643-4580-ab08-f8ded9d29a4a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:32.622896 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac003f1-1b62-4cf0-abfe-59c908c5358b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:32.623107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2483a-00f4-4403-bac8-d811985ebb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:32.623597 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2483a-00f4-4403-bac8-d811985ebb3c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:32.623877 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2483a-00f4-4403-bac8-d811985ebb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:32.624153 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2483a-00f4-4403-bac8-d811985ebb3c None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:32.624532 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac003f1-1b62-4cf0-abfe-59c908c5358b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:32.624994 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac003f1-1b62-4cf0-abfe-59c908c5358b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:32.625425 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2483a-00f4-4403-bac8-d811985ebb3c None admin] RBAC: Authorizing `identity:get_project(project_id=3747706d68904890975b5253c7f2b3a9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:32.625559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac003f1-1b62-4cf0-abfe-59c908c5358b None admin] PATH_INFO: `/v3/users/f1a2c644931943709b7246165e75583f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:32.626911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2483a-00f4-4403-bac8-d811985ebb3c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:32.627025 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac003f1-1b62-4cf0-abfe-59c908c5358b None admin] RBAC: Authorizing `identity:get_user(user_id=f1a2c644931943709b7246165e75583f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:32.628591 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac003f1-1b62-4cf0-abfe-59c908c5358b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:32.628966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 132/260] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:32 2022] GET /identity/v3/projects/3747706d68904890975b5253c7f2b3a9 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:32.629794 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2483a-00f4-4403-bac8-d811985ebb3c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:32.631195 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 129/261] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:32 2022] GET /identity/v3/users/f1a2c644931943709b7246165e75583f => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:32.642235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac003f1-1b62-4cf0-abfe-59c908c5358b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:32.677462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:32.745431 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:32.763584 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2483a-00f4-4403-bac8-d811985ebb3c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:32.822832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c0cff-079c-464e-8fdf-3caec87ec2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:32.822832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c0cff-079c-464e-8fdf-3caec87ec2ae None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:32.823092 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c0cff-079c-464e-8fdf-3caec87ec2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:32.823319 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c0cff-079c-464e-8fdf-3caec87ec2ae None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:32.824053 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c0cff-079c-464e-8fdf-3caec87ec2ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:32.824371 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c0cff-079c-464e-8fdf-3caec87ec2ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:32.825921 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c0cff-079c-464e-8fdf-3caec87ec2ae None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:32.827775 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac003f1-1b62-4cf0-abfe-59c908c5358b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:32.836165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 133/262] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:44:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:32.837108 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c0cff-079c-464e-8fdf-3caec87ec2ae None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:32.865947 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241eed0-d236-4d1e-809e-6a5ac84a32cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:32.866880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241eed0-d236-4d1e-809e-6a5ac84a32cd None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:32.867345 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241eed0-d236-4d1e-809e-6a5ac84a32cd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:32.867801 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241eed0-d236-4d1e-809e-6a5ac84a32cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:32.868844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241eed0-d236-4d1e-809e-6a5ac84a32cd None admin] RBAC: Adding query filter params (role.id=b25f2feb715144eebde4711522cb8024, scope.project.id=3747706d68904890975b5253c7f2b3a9, user.id=f76074415825460cbddbca1d7ec98d3a) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:32.869341 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241eed0-d236-4d1e-809e-6a5ac84a32cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:32.870963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241eed0-d236-4d1e-809e-6a5ac84a32cd None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:32.876827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 130/263] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:44:32 2022] GET /identity/v3/role_assignments?user.id=f76074415825460cbddbca1d7ec98d3a&scope.project.id=3747706d68904890975b5253c7f2b3a9&role.id=b25f2feb715144eebde4711522cb8024 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:32.877843 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241eed0-d236-4d1e-809e-6a5ac84a32cd None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:32.982851 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c0cff-079c-464e-8fdf-3caec87ec2ae None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:32.983475 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:33.000581 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241eed0-d236-4d1e-809e-6a5ac84a32cd None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:33.020696 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d7ac9-66a7-4747-bdcf-e58a90474b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:33.021386 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d7ac9-66a7-4747-bdcf-e58a90474b6b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:33.021670 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d7ac9-66a7-4747-bdcf-e58a90474b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:33.021944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d7ac9-66a7-4747-bdcf-e58a90474b6b None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:33.023175 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d7ac9-66a7-4747-bdcf-e58a90474b6b None admin] RBAC: Authorizing `identity:get_project(project_id=3747706d68904890975b5253c7f2b3a9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:33.024811 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d7ac9-66a7-4747-bdcf-e58a90474b6b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:33.026939 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 134/264] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:32 2022] GET /identity/v3/projects/3747706d68904890975b5253c7f2b3a9 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:33.033771 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d7ac9-66a7-4747-bdcf-e58a90474b6b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:33.050358 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebf288-1671-4fe5-94e8-5ea70006aa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:33.051473 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebf288-1671-4fe5-94e8-5ea70006aa1c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:33.052028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebf288-1671-4fe5-94e8-5ea70006aa1c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:33.052506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebf288-1671-4fe5-94e8-5ea70006aa1c None admin] PATH_INFO: `/v3/users/694adc30d18d4b1d81978cceb42c7e45` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:33.056524 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:33.057687 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebf288-1671-4fe5-94e8-5ea70006aa1c None admin] RBAC: Authorizing `identity:get_user(user_id=694adc30d18d4b1d81978cceb42c7e45)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:33.059294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebf288-1671-4fe5-94e8-5ea70006aa1c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:33.061438 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 131/265] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:32 2022] GET /identity/v3/users/694adc30d18d4b1d81978cceb42c7e45 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:33.067604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebf288-1671-4fe5-94e8-5ea70006aa1c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:33.186751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d7ac9-66a7-4747-bdcf-e58a90474b6b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:33.206996 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebf288-1671-4fe5-94e8-5ea70006aa1c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:33.248909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45aee2-f335-4c9c-92a6-5cbf5c8ef74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:33.248909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45aee2-f335-4c9c-92a6-5cbf5c8ef74a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:33.248909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45aee2-f335-4c9c-92a6-5cbf5c8ef74a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:33.248909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45aee2-f335-4c9c-92a6-5cbf5c8ef74a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:33.283166 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac949a-20ce-4fa2-9c47-ec32534b8532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:33.284120 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac949a-20ce-4fa2-9c47-ec32534b8532 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:33.284544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac949a-20ce-4fa2-9c47-ec32534b8532 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:33.284987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac949a-20ce-4fa2-9c47-ec32534b8532 None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9/users/f1a2c644931943709b7246165e75583f/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:33.290093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac949a-20ce-4fa2-9c47-ec32534b8532 None admin] RBAC: Authorizing `identity:create_grant(project_id=3747706d68904890975b5253c7f2b3a9, user_id=f1a2c644931943709b7246165e75583f, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:33.292301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac949a-20ce-4fa2-9c47-ec32534b8532 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:33.320613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:33.376237 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45aee2-f335-4c9c-92a6-5cbf5c8ef74a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:33.377789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45aee2-f335-4c9c-92a6-5cbf5c8ef74a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:33.400162 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 135/266] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:44:33 2022] PUT /identity/v3/projects/3747706d68904890975b5253c7f2b3a9/users/f1a2c644931943709b7246165e75583f/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:44:33.497722 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 132/267] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:44:33.503200 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac949a-20ce-4fa2-9c47-ec32534b8532 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:33.646534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:33.678384 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac949a-20ce-4fa2-9c47-ec32534b8532 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:33.729487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481cc4ad-fbde-48a8-a45c-f6704a59281b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:33.730580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cc4ad-fbde-48a8-a45c-f6704a59281b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:33.730868 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cc4ad-fbde-48a8-a45c-f6704a59281b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:33.731148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cc4ad-fbde-48a8-a45c-f6704a59281b None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:33.732374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481cc4ad-fbde-48a8-a45c-f6704a59281b None admin] RBAC: Authorizing `identity:get_project(project_id=3747706d68904890975b5253c7f2b3a9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:33.733902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481cc4ad-fbde-48a8-a45c-f6704a59281b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:33.735944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 136/268] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:33 2022] GET /identity/v3/projects/3747706d68904890975b5253c7f2b3a9 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:33.742156 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45aee2-f335-4c9c-92a6-5cbf5c8ef74a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:33.823590 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:33.871838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45aee2-f335-4c9c-92a6-5cbf5c8ef74a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:33.908937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915e115-cf85-4875-bd5a-c618ddba0ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:33.910000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915e115-cf85-4875-bd5a-c618ddba0ffd None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:33.910503 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915e115-cf85-4875-bd5a-c618ddba0ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:33.910968 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915e115-cf85-4875-bd5a-c618ddba0ffd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:33.911949 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915e115-cf85-4875-bd5a-c618ddba0ffd None admin] RBAC: Adding query filter params (role.id=e2024b6eae3d49f09caa7d4275eb88bc, scope.project.id=3747706d68904890975b5253c7f2b3a9, user.id=694adc30d18d4b1d81978cceb42c7e45) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:33.912463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915e115-cf85-4875-bd5a-c618ddba0ffd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:33.914106 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915e115-cf85-4875-bd5a-c618ddba0ffd None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:33.920723 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 133/269] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:44:33 2022] GET /identity/v3/role_assignments?user.id=694adc30d18d4b1d81978cceb42c7e45&scope.project.id=3747706d68904890975b5253c7f2b3a9&role.id=e2024b6eae3d49f09caa7d4275eb88bc => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:34.407422 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836d5bd-11be-4494-a205-9e267f58149e None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:34.407979 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836d5bd-11be-4494-a205-9e267f58149e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:34.407979 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836d5bd-11be-4494-a205-9e267f58149e None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:34.409374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 137/270] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:34.415079 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73427ced-645d-4de9-9184-eaed9f037137 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:34.415473 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73427ced-645d-4de9-9184-eaed9f037137 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:34.415640 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73427ced-645d-4de9-9184-eaed9f037137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:34.441175 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-73427ced-645d-4de9-9184-eaed9f037137 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:34.442923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-73427ced-645d-4de9-9184-eaed9f037137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:34.522855 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 134/271] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:34.529500 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8553dd-212f-4c5e-85a9-f1ee7ca03864 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:34.534082 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8553dd-212f-4c5e-85a9-f1ee7ca03864 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:34.534082 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8553dd-212f-4c5e-85a9-f1ee7ca03864 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:34.534082 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 138/272] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:34.538049 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40df0f-8b5f-4102-961a-84785645e34a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:34.538341 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40df0f-8b5f-4102-961a-84785645e34a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:34.538618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40df0f-8b5f-4102-961a-84785645e34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:34.550444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8553dd-212f-4c5e-85a9-f1ee7ca03864 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:34.559569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1d40df0f-8b5f-4102-961a-84785645e34a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:34.561104 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1d40df0f-8b5f-4102-961a-84785645e34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:34.614887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:34.646966 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 135/273] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:34.667118 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40df0f-8b5f-4102-961a-84785645e34a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:34.708532 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8553dd-212f-4c5e-85a9-f1ee7ca03864 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:34.743071 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70a8b8-2781-400c-974c-cfa3d3c2e28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:34.743731 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70a8b8-2781-400c-974c-cfa3d3c2e28b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:34.744017 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70a8b8-2781-400c-974c-cfa3d3c2e28b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:34.744290 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70a8b8-2781-400c-974c-cfa3d3c2e28b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:34.757617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70a8b8-2781-400c-974c-cfa3d3c2e28b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:34.763461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-eb70a8b8-2781-400c-974c-cfa3d3c2e28b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:34.763461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:34.763461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:34.763461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:34.763461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:34.763461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:34.763461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:34.763461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:34.763461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:34.763461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:34.763461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:34.763461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:34.763461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:34.763461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:34.763461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:34.763461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:34.764399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:34.764399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:34.764399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:34.764399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:34.764399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:34.764399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:34.764399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:34.764399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:34.764399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:34.764399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:34.764399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:34.764399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:34.764399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:34.764399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:34.764399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:34.764399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:34.765299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:34.765299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:34.765299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:34.765299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:34.765299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:34.765299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:34.765299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:34.765299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:34.765299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:34.765299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:34.765299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:34.765299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:34.765299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 139/274] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:44:34.770710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70a8b8-2781-400c-974c-cfa3d3c2e28b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:34.780456 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40df0f-8b5f-4102-961a-84785645e34a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:34.785120 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:34.817682 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f54848-12b9-46e4-abd1-41ae29adf6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:34.818672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f54848-12b9-46e4-abd1-41ae29adf6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:34.819246 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f54848-12b9-46e4-abd1-41ae29adf6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:34.819754 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f54848-12b9-46e4-abd1-41ae29adf6c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:34.821218 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f54848-12b9-46e4-abd1-41ae29adf6c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:34.822884 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f54848-12b9-46e4-abd1-41ae29adf6c9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:34.828992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 136/275] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:44:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:34.830830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f54848-12b9-46e4-abd1-41ae29adf6c9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:34.876912 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70a8b8-2781-400c-974c-cfa3d3c2e28b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:34.881746 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:34.912546 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0ae1e-f1e8-4be1-8dbc-7eecd5280c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:34.913205 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0ae1e-f1e8-4be1-8dbc-7eecd5280c57 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:34.913487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0ae1e-f1e8-4be1-8dbc-7eecd5280c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:34.913763 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0ae1e-f1e8-4be1-8dbc-7eecd5280c57 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:34.914483 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0ae1e-f1e8-4be1-8dbc-7eecd5280c57 None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:34.915126 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0ae1e-f1e8-4be1-8dbc-7eecd5280c57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:34.916194 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0ae1e-f1e8-4be1-8dbc-7eecd5280c57 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:34.929611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 140/276] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:34.930903 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0ae1e-f1e8-4be1-8dbc-7eecd5280c57 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:34.942135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f54848-12b9-46e4-abd1-41ae29adf6c9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:34.978677 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c00a25-244d-4662-bc5e-8698e17d2eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:34.979862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c00a25-244d-4662-bc5e-8698e17d2eac None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:34.980602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c00a25-244d-4662-bc5e-8698e17d2eac None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:34.981102 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c00a25-244d-4662-bc5e-8698e17d2eac None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:34.982242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c00a25-244d-4662-bc5e-8698e17d2eac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:34.983893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c00a25-244d-4662-bc5e-8698e17d2eac None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:35.000883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:35.032239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0ae1e-f1e8-4be1-8dbc-7eecd5280c57 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:35.066046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05043356-cfa4-42a1-bd90-0ace290d9392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:35.067214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05043356-cfa4-42a1-bd90-0ace290d9392 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:35.067498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05043356-cfa4-42a1-bd90-0ace290d9392 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:35.067771 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05043356-cfa4-42a1-bd90-0ace290d9392 None admin] PATH_INFO: `/v3/users/97cf0fbd7098457ba4dbc8ba2bc5291b` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:35.088337 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05043356-cfa4-42a1-bd90-0ace290d9392 None admin] RBAC: Authorizing `identity:get_user(user_id=97cf0fbd7098457ba4dbc8ba2bc5291b)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:35.089993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05043356-cfa4-42a1-bd90-0ace290d9392 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:35.096886 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 141/278] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:34 2022] GET /identity/v3/users/97cf0fbd7098457ba4dbc8ba2bc5291b => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:35.097164 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 137/278] 10.222.0.75 () {60 vars in 1132 bytes} [Thu Jul 28 17:44:34 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:44:35.098201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05043356-cfa4-42a1-bd90-0ace290d9392 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:35.165757 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e19dc3-869b-4c59-b0ea-56d523292789 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:35.165943 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e19dc3-869b-4c59-b0ea-56d523292789 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:35.166235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e19dc3-869b-4c59-b0ea-56d523292789 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:35.167907 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 138/279] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:44:35.173626 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7338c8-ec3d-47cd-8b69-3aa01cca4fae None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:35.173937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7338c8-ec3d-47cd-8b69-3aa01cca4fae None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:35.174194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7338c8-ec3d-47cd-8b69-3aa01cca4fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:35.195285 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9e7338c8-ec3d-47cd-8b69-3aa01cca4fae None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:35.196502 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9e7338c8-ec3d-47cd-8b69-3aa01cca4fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:35.214975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05043356-cfa4-42a1-bd90-0ace290d9392 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:35.243885 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:35.253061 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad7175-3a2b-4e63-8c64-47328b538836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:35.253970 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad7175-3a2b-4e63-8c64-47328b538836 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:35.254430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad7175-3a2b-4e63-8c64-47328b538836 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:35.254854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad7175-3a2b-4e63-8c64-47328b538836 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:35.255834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad7175-3a2b-4e63-8c64-47328b538836 None admin] RBAC: Adding query filter params (role.id=279c255613df457cb2d5d9904dd6f12a, user.id=97cf0fbd7098457ba4dbc8ba2bc5291b, scope.system=all) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:35.260008 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad7175-3a2b-4e63-8c64-47328b538836 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:35.260008 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad7175-3a2b-4e63-8c64-47328b538836 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:35.264187 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 142/280] 10.222.0.75 () {56 vars in 1308 bytes} [Thu Jul 28 17:44:35 2022] GET /identity/v3/role_assignments?user.id=97cf0fbd7098457ba4dbc8ba2bc5291b&scope.system=all&role.id=279c255613df457cb2d5d9904dd6f12a => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:35.289590 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 139/281] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:44:35.312858 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad7175-3a2b-4e63-8c64-47328b538836 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:35.443402 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad7175-3a2b-4e63-8c64-47328b538836 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:35.479304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd75e8d-2810-471a-89c3-c68e9ea07c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:35.479956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd75e8d-2810-471a-89c3-c68e9ea07c4b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:35.480236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd75e8d-2810-471a-89c3-c68e9ea07c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:35.480512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd75e8d-2810-471a-89c3-c68e9ea07c4b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:35.491617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd75e8d-2810-471a-89c3-c68e9ea07c4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:35.496737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-ccd75e8d-2810-471a-89c3-c68e9ea07c4b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:44:35.496737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:35.496737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:35.496737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:35.496737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:35.496737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:35.496737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:35.496737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:35.496737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:35.496737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:35.496737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:35.496737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:35.496737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:35.496737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:35.496737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:35.496737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:35.497648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:35.497648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:35.497648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:35.497648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:35.497648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:35.497648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:35.497648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:35.497648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:35.497648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:35.497648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:35.497648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:35.497648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:35.497648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:35.497648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:35.497648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:35.497648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:35.498438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:35.498438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:35.498438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:35.498438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:35.498438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:35.498438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:35.498438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:35.498438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:35.498438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:35.498438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:35.498438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:44:35.498438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:35.498438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 143/282] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:35.508319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7338c8-ec3d-47cd-8b69-3aa01cca4fae None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:35.553092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:35.640592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7338c8-ec3d-47cd-8b69-3aa01cca4fae None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:35.683746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba47be0-9b55-47bc-9c74-e6b9627ea598 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:35.684064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba47be0-9b55-47bc-9c74-e6b9627ea598 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:35.684309 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba47be0-9b55-47bc-9c74-e6b9627ea598 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:35.685834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 144/283] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:44:35.692402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f5bef-c2ef-417e-80dd-00c06d42e660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:35.693119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f5bef-c2ef-417e-80dd-00c06d42e660 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:35.693457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f5bef-c2ef-417e-80dd-00c06d42e660 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:35.693672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f5bef-c2ef-417e-80dd-00c06d42e660 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:35.694664 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f5bef-c2ef-417e-80dd-00c06d42e660 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:35.695860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cedfe1-04de-43db-892d-2255a8acc979 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:35.696138 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cedfe1-04de-43db-892d-2255a8acc979 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:35.696407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cedfe1-04de-43db-892d-2255a8acc979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:35.701323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f5bef-c2ef-417e-80dd-00c06d42e660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:35.702754 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f5bef-c2ef-417e-80dd-00c06d42e660 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:35.724504 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-15cedfe1-04de-43db-892d-2255a8acc979 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:35.725741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-15cedfe1-04de-43db-892d-2255a8acc979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:35.727651 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 140/284] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:35.728503 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f5bef-c2ef-417e-80dd-00c06d42e660 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:35.814550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:35.852235 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 145/285] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:44:35.877351 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:35.884974 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cedfe1-04de-43db-892d-2255a8acc979 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:35.888890 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f5bef-c2ef-417e-80dd-00c06d42e660 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:35.960415 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb4faa-5eaf-48af-a8f9-167325b28ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:35.961575 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb4faa-5eaf-48af-a8f9-167325b28ebc None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:35.963057 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb4faa-5eaf-48af-a8f9-167325b28ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:35.963514 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb4faa-5eaf-48af-a8f9-167325b28ebc None admin] PATH_INFO: `/v3/users/f76074415825460cbddbca1d7ec98d3a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:35.965634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb4faa-5eaf-48af-a8f9-167325b28ebc None admin] RBAC: Authorizing `identity:get_user(user_id=f76074415825460cbddbca1d7ec98d3a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:35.967456 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb4faa-5eaf-48af-a8f9-167325b28ebc None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:35.969964 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 141/286] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:35 2022] GET /identity/v3/users/f76074415825460cbddbca1d7ec98d3a => generated 297 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:35.976832 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb4faa-5eaf-48af-a8f9-167325b28ebc None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:36.048930 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cedfe1-04de-43db-892d-2255a8acc979 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:36.090266 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793a44b-7ea7-4a6f-b0f9-7e631ed6bfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:36.091598 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793a44b-7ea7-4a6f-b0f9-7e631ed6bfd3 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:36.092249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793a44b-7ea7-4a6f-b0f9-7e631ed6bfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:36.092720 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793a44b-7ea7-4a6f-b0f9-7e631ed6bfd3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:36.110135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793a44b-7ea7-4a6f-b0f9-7e631ed6bfd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:36.125490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-4793a44b-7ea7-4a6f-b0f9-7e631ed6bfd3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:36.125490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:36.125490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:36.125490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:36.125490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:36.125490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:36.125490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:36.125490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:36.125490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:36.125490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:36.125490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:36.125490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:36.125490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:36.125490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:36.125490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:36.125490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:36.126441 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:36.126441 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:36.126441 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:36.126441 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:36.126441 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:36.126441 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:36.126441 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:36.126441 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:36.126441 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:36.126441 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:36.126441 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:36.126441 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:36.126441 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:36.126441 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:36.126441 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:36.126441 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:36.127226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:36.127226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:36.127226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:36.127226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:36.127226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:36.127226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:36.127226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:36.127226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:36.127226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:36.127226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:36.127226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:36.127226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:36.129798 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 146/287] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:44:36.135784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793a44b-7ea7-4a6f-b0f9-7e631ed6bfd3 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:36.182071 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb4faa-5eaf-48af-a8f9-167325b28ebc None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:36.219758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:36.229855 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c18746-a7a9-46bb-bfc3-f4fc8f5a019b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:36.235084 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c18746-a7a9-46bb-bfc3-f4fc8f5a019b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:36.235084 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c18746-a7a9-46bb-bfc3-f4fc8f5a019b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:36.235084 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c18746-a7a9-46bb-bfc3-f4fc8f5a019b None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:36.235084 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c18746-a7a9-46bb-bfc3-f4fc8f5a019b None admin] RBAC: Authorizing `identity:get_project(project_id=3747706d68904890975b5253c7f2b3a9)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:36.235084 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c18746-a7a9-46bb-bfc3-f4fc8f5a019b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:36.236427 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 142/288] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:35 2022] GET /identity/v3/projects/3747706d68904890975b5253c7f2b3a9 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:36.248834 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c18746-a7a9-46bb-bfc3-f4fc8f5a019b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:36.283611 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:36.340285 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793a44b-7ea7-4a6f-b0f9-7e631ed6bfd3 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:36.365420 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c18746-a7a9-46bb-bfc3-f4fc8f5a019b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:36.401230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcea91-7192-4d28-9ca9-e82cd2a4a696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:36.402545 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcea91-7192-4d28-9ca9-e82cd2a4a696 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:36.403005 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcea91-7192-4d28-9ca9-e82cd2a4a696 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:36.403674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcea91-7192-4d28-9ca9-e82cd2a4a696 None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9/users/f76074415825460cbddbca1d7ec98d3a/roles/b25f2feb715144eebde4711522cb8024` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:36.405901 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcea91-7192-4d28-9ca9-e82cd2a4a696 None admin] RBAC: Authorizing `identity:create_grant(project_id=3747706d68904890975b5253c7f2b3a9, user_id=f76074415825460cbddbca1d7ec98d3a, role_id=b25f2feb715144eebde4711522cb8024)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:36.407539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcea91-7192-4d28-9ca9-e82cd2a4a696 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:36.428920 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50772385-2780-4f72-ad98-163cb17c284c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:36.429849 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50772385-2780-4f72-ad98-163cb17c284c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:36.430371 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50772385-2780-4f72-ad98-163cb17c284c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:36.430836 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50772385-2780-4f72-ad98-163cb17c284c None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:36.431923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50772385-2780-4f72-ad98-163cb17c284c None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:36.432447 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50772385-2780-4f72-ad98-163cb17c284c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:36.434071 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50772385-2780-4f72-ad98-163cb17c284c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:36.443987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 147/289] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:36.449505 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50772385-2780-4f72-ad98-163cb17c284c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:36.513031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 143/290] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:44:36 2022] PUT /identity/v3/projects/3747706d68904890975b5253c7f2b3a9/users/f76074415825460cbddbca1d7ec98d3a/roles/b25f2feb715144eebde4711522cb8024 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:44:36.592478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50772385-2780-4f72-ad98-163cb17c284c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:36.594239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:36.643678 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104d8fb-53fb-4f03-9151-8425f0bf924e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:36.644353 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104d8fb-53fb-4f03-9151-8425f0bf924e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:36.644656 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104d8fb-53fb-4f03-9151-8425f0bf924e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:36.645534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104d8fb-53fb-4f03-9151-8425f0bf924e None admin] PATH_INFO: `/v3/users/f1a2c644931943709b7246165e75583f` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:36.646812 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104d8fb-53fb-4f03-9151-8425f0bf924e None admin] RBAC: Authorizing `identity:get_user(user_id=f1a2c644931943709b7246165e75583f)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:36.648336 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104d8fb-53fb-4f03-9151-8425f0bf924e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:36.650471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 148/291] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:36 2022] GET /identity/v3/users/f1a2c644931943709b7246165e75583f => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:36.656641 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcea91-7192-4d28-9ca9-e82cd2a4a696 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:36.777002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:36.787499 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcea91-7192-4d28-9ca9-e82cd2a4a696 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:36.823856 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4b5fe-f915-4ba1-8f70-2ec89cddcbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:36.824500 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4b5fe-f915-4ba1-8f70-2ec89cddcbed None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:36.824807 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4b5fe-f915-4ba1-8f70-2ec89cddcbed None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:36.825089 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4b5fe-f915-4ba1-8f70-2ec89cddcbed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:36.897266 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4b5fe-f915-4ba1-8f70-2ec89cddcbed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:36.898747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4b5fe-f915-4ba1-8f70-2ec89cddcbed None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:37.018341 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:37.037907 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 144/292] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:37.038065 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104d8fb-53fb-4f03-9151-8425f0bf924e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:37.167884 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104d8fb-53fb-4f03-9151-8425f0bf924e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:37.208908 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0420e8-c23d-4ef7-8c0c-fb392b456ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:37.209619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0420e8-c23d-4ef7-8c0c-fb392b456ffc None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:37.209908 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0420e8-c23d-4ef7-8c0c-fb392b456ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:37.210186 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0420e8-c23d-4ef7-8c0c-fb392b456ffc None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:37.211381 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0420e8-c23d-4ef7-8c0c-fb392b456ffc None admin] RBAC: Authorizing `identity:get_project(project_id=3747706d68904890975b5253c7f2b3a9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:37.212889 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0420e8-c23d-4ef7-8c0c-fb392b456ffc None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:37.214660 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 149/293] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:37 2022] GET /identity/v3/projects/3747706d68904890975b5253c7f2b3a9 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:37.220566 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4b5fe-f915-4ba1-8f70-2ec89cddcbed None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:37.358691 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4b5fe-f915-4ba1-8f70-2ec89cddcbed None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:37.407303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7f362-719c-4a8a-b946-f3af2f3edd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:37.407933 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7f362-719c-4a8a-b946-f3af2f3edd1e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:37.408217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7f362-719c-4a8a-b946-f3af2f3edd1e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:37.408494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7f362-719c-4a8a-b946-f3af2f3edd1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:37.409328 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7f362-719c-4a8a-b946-f3af2f3edd1e None admin] RBAC: Adding query filter params (role.id=279c255613df457cb2d5d9904dd6f12a, scope.project.id=3747706d68904890975b5253c7f2b3a9, user.id=f1a2c644931943709b7246165e75583f) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:37.409642 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7f362-719c-4a8a-b946-f3af2f3edd1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:37.411611 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7f362-719c-4a8a-b946-f3af2f3edd1e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:37.417804 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 145/294] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:44:37 2022] GET /identity/v3/role_assignments?user.id=f1a2c644931943709b7246165e75583f&scope.project.id=3747706d68904890975b5253c7f2b3a9&role.id=279c255613df457cb2d5d9904dd6f12a => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:37.746683 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182df4d-72f6-4f74-a06b-8ab8af1655d4 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:37.747194 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182df4d-72f6-4f74-a06b-8ab8af1655d4 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:37.747267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182df4d-72f6-4f74-a06b-8ab8af1655d4 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:37.748925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 150/295] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:37.756440 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76223b8a-7164-49a9-984f-490b019b320f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:37.756929 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76223b8a-7164-49a9-984f-490b019b320f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:37.757112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76223b8a-7164-49a9-984f-490b019b320f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:37.777580 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-76223b8a-7164-49a9-984f-490b019b320f None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:37.779127 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-76223b8a-7164-49a9-984f-490b019b320f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:37.786716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29868d9d-26cb-4ff9-bb2b-22517a227a8f None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:37.786997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29868d9d-26cb-4ff9-bb2b-22517a227a8f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:37.787279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29868d9d-26cb-4ff9-bb2b-22517a227a8f None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:37.788967 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 151/296] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:37.793732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ae881-ea5a-4806-8ac9-e03994f0a7f9 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:37.794093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ae881-ea5a-4806-8ac9-e03994f0a7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:37.794434 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ae881-ea5a-4806-8ac9-e03994f0a7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:37.824418 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c62ae881-ea5a-4806-8ac9-e03994f0a7f9 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:37.825063 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c62ae881-ea5a-4806-8ac9-e03994f0a7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:37.844100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:37.876773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:37.876963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 146/297] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:37.895540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76223b8a-7164-49a9-984f-490b019b320f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:37.930369 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 152/298] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:37.955353 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ae881-ea5a-4806-8ac9-e03994f0a7f9 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:38.013997 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76223b8a-7164-49a9-984f-490b019b320f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:38.052154 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d1acd-3b82-4cd2-b69b-4c49a08f75aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:38.052911 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d1acd-3b82-4cd2-b69b-4c49a08f75aa None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:38.053190 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d1acd-3b82-4cd2-b69b-4c49a08f75aa None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:38.053467 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d1acd-3b82-4cd2-b69b-4c49a08f75aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:38.065272 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d1acd-3b82-4cd2-b69b-4c49a08f75aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:38.070797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-d09d1acd-3b82-4cd2-b69b-4c49a08f75aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:38.070797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:38.070797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:38.070797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:38.070797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:38.070797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:38.070797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:38.070797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:38.070797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:38.070797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:38.070797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:38.070797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:38.070797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:38.070797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:38.070797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:38.070797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:38.071672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:38.071672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:38.071672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:38.071672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:38.071672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:38.071672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:38.071672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:38.071672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:38.071672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:38.071672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:38.071672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:38.071672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:38.071672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:38.071672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:38.071672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:38.071672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:38.072465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:38.072465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:38.072465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:38.072465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:38.072465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:38.072465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:38.072465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:38.072465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:38.072465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:38.072465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:38.072465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:38.072465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:38.072465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 147/299] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:44:38.077985 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d1acd-3b82-4cd2-b69b-4c49a08f75aa None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:38.082573 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ae881-ea5a-4806-8ac9-e03994f0a7f9 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:38.124101 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e21dd-0ee4-4cc8-b560-993bf840aa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:38.125489 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e21dd-0ee4-4cc8-b560-993bf840aa1e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:38.126281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e21dd-0ee4-4cc8-b560-993bf840aa1e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:38.126758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e21dd-0ee4-4cc8-b560-993bf840aa1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:38.129276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:38.140667 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e21dd-0ee4-4cc8-b560-993bf840aa1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:38.146909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-ff4e21dd-0ee4-4cc8-b560-993bf840aa1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:44:38.146909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:38.146909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:38.146909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:38.146909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:38.146909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:38.146909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:38.146909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:38.146909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:38.146909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:38.146909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:38.146909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:38.146909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:38.146909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:38.146909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:38.146909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:38.148028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:38.148028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:38.148028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:38.148028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:38.148028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:38.148028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:38.148028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:38.148028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:38.148028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:38.148028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:38.148028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:38.148028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:38.148028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:38.148028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:38.148028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:38.148028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:38.149007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:38.149007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:38.149007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:38.149007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:38.149007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:38.149007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:38.149007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:38.149007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:38.149007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:38.149007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:38.149007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:44:38.149007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:38.149007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 153/300] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:38.149802 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8e9b6-a2f1-44a7-bb83-1a65f6cdc5b0 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:38.149802 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8e9b6-a2f1-44a7-bb83-1a65f6cdc5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:38.149947 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8e9b6-a2f1-44a7-bb83-1a65f6cdc5b0 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:38.155214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 154/301] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:38.156799 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e62e35-be16-4314-a74e-6793a8cdc09a None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:38.157081 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e62e35-be16-4314-a74e-6793a8cdc09a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:38.157359 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e62e35-be16-4314-a74e-6793a8cdc09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:38.176842 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e4e62e35-be16-4314-a74e-6793a8cdc09a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:38.177869 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e4e62e35-be16-4314-a74e-6793a8cdc09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:38.200210 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d1acd-3b82-4cd2-b69b-4c49a08f75aa None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:38.202089 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:38.240642 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4804d-249f-4d5a-98ca-5d44d32a2c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:38.241300 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4804d-249f-4d5a-98ca-5d44d32a2c77 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:38.241587 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4804d-249f-4d5a-98ca-5d44d32a2c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:38.241857 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4804d-249f-4d5a-98ca-5d44d32a2c77 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:38.242585 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4804d-249f-4d5a-98ca-5d44d32a2c77 None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:38.242890 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4804d-249f-4d5a-98ca-5d44d32a2c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:38.244269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4804d-249f-4d5a-98ca-5d44d32a2c77 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:38.248701 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 155/302] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:38.249853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e62e35-be16-4314-a74e-6793a8cdc09a None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:38.260999 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 148/303] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:38.269974 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4804d-249f-4d5a-98ca-5d44d32a2c77 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:38.377080 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e62e35-be16-4314-a74e-6793a8cdc09a None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:38.391001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4804d-249f-4d5a-98ca-5d44d32a2c77 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:38.399330 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:38.415459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f28f5-7b6b-46b8-9110-2182c6eee8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:38.416311 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f28f5-7b6b-46b8-9110-2182c6eee8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:38.416601 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f28f5-7b6b-46b8-9110-2182c6eee8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:38.416910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f28f5-7b6b-46b8-9110-2182c6eee8a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:38.417700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f28f5-7b6b-46b8-9110-2182c6eee8a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:38.418026 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f28f5-7b6b-46b8-9110-2182c6eee8a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:38.419434 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f28f5-7b6b-46b8-9110-2182c6eee8a2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:38.432716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 156/304] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:38.432716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f28f5-7b6b-46b8-9110-2182c6eee8a2 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:38.434175 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7feaf2-0cd6-4bec-a5e7-56f27b55bb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:38.434849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7feaf2-0cd6-4bec-a5e7-56f27b55bb94 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:38.435133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7feaf2-0cd6-4bec-a5e7-56f27b55bb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:38.435412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7feaf2-0cd6-4bec-a5e7-56f27b55bb94 None admin] PATH_INFO: `/v3/users/97cf0fbd7098457ba4dbc8ba2bc5291b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:38.436636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7feaf2-0cd6-4bec-a5e7-56f27b55bb94 None admin] RBAC: Authorizing `identity:get_user(user_id=97cf0fbd7098457ba4dbc8ba2bc5291b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:38.438113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7feaf2-0cd6-4bec-a5e7-56f27b55bb94 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:38.439966 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 149/305] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:38 2022] GET /identity/v3/users/97cf0fbd7098457ba4dbc8ba2bc5291b => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:38.445075 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7feaf2-0cd6-4bec-a5e7-56f27b55bb94 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:38.456897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:38.546100 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f28f5-7b6b-46b8-9110-2182c6eee8a2 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:38.553278 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7feaf2-0cd6-4bec-a5e7-56f27b55bb94 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:38.585402 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43914e0-9502-4563-b302-69c0f98dd9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:38.586052 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43914e0-9502-4563-b302-69c0f98dd9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:38.586333 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43914e0-9502-4563-b302-69c0f98dd9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:38.586607 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43914e0-9502-4563-b302-69c0f98dd9f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:38.587738 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43914e0-9502-4563-b302-69c0f98dd9f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:38.589166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcfcf2-cff4-4355-8b43-14d2f33b61e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:38.589282 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43914e0-9502-4563-b302-69c0f98dd9f7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:38.589813 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcfcf2-cff4-4355-8b43-14d2f33b61e1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:38.590095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcfcf2-cff4-4355-8b43-14d2f33b61e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:38.590369 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcfcf2-cff4-4355-8b43-14d2f33b61e1 None admin] PATH_INFO: `/v3/users/3c86fa4af6254ec9ae2146d218d776a1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:38.595601 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 157/306] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:44:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:38.596293 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43914e0-9502-4563-b302-69c0f98dd9f7 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:38.605238 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcfcf2-cff4-4355-8b43-14d2f33b61e1 None admin] RBAC: Authorizing `identity:get_user(user_id=3c86fa4af6254ec9ae2146d218d776a1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:38.606755 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcfcf2-cff4-4355-8b43-14d2f33b61e1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:38.613058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 150/307] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:38 2022] GET /identity/v3/users/3c86fa4af6254ec9ae2146d218d776a1 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:38.613058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcfcf2-cff4-4355-8b43-14d2f33b61e1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:38.646174 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:38.708355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:38.720497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43914e0-9502-4563-b302-69c0f98dd9f7 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:38.721750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcfcf2-cff4-4355-8b43-14d2f33b61e1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:38.756888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a86e6-aa0f-4263-8eee-abe18002e8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:38.757559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a86e6-aa0f-4263-8eee-abe18002e8d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:38.757840 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a86e6-aa0f-4263-8eee-abe18002e8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:38.758174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a86e6-aa0f-4263-8eee-abe18002e8d6 None admin] PATH_INFO: `/v3/system/users/97cf0fbd7098457ba4dbc8ba2bc5291b/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:38.759674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a86e6-aa0f-4263-8eee-abe18002e8d6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=97cf0fbd7098457ba4dbc8ba2bc5291b, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:38.760213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d94f0-3ffb-4d0c-a234-f304e8bc7c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:38.760875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d94f0-3ffb-4d0c-a234-f304e8bc7c3a None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:38.761127 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a86e6-aa0f-4263-8eee-abe18002e8d6 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:38.761233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d94f0-3ffb-4d0c-a234-f304e8bc7c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:38.761426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d94f0-3ffb-4d0c-a234-f304e8bc7c3a None admin] PATH_INFO: `/v3/groups` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:38.762101 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d94f0-3ffb-4d0c-a234-f304e8bc7c3a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:38.763541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d94f0-3ffb-4d0c-a234-f304e8bc7c3a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:38.850103 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 158/308] 10.222.0.75 () {58 vars in 1334 bytes} [Thu Jul 28 17:44:38 2022] PUT /identity/v3/system/users/97cf0fbd7098457ba4dbc8ba2bc5291b/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:44:38.851044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a86e6-aa0f-4263-8eee-abe18002e8d6 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:38.890126 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 151/309] 10.222.0.75 () {60 vars in 1134 bytes} [Thu Jul 28 17:44:38 2022] POST /identity/v3/groups => generated 229 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:44:38.891809 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fc64c-5bbf-4e01-b7f6-9c131de92fce None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:38.892266 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fc64c-5bbf-4e01-b7f6-9c131de92fce None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:38.892802 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fc64c-5bbf-4e01-b7f6-9c131de92fce None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:38.894348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 152/310] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:38.905848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed30ffc-b26b-462c-b7ef-87a544e4289a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:38.905848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed30ffc-b26b-462c-b7ef-87a544e4289a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:38.905848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed30ffc-b26b-462c-b7ef-87a544e4289a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:38.924992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-eed30ffc-b26b-462c-b7ef-87a544e4289a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:38.927165 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-eed30ffc-b26b-462c-b7ef-87a544e4289a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:38.997062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a86e6-aa0f-4263-8eee-abe18002e8d6 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:39.022028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 153/311] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:39.039008 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd83bf3-8450-4a6d-b110-260545ca0a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:39.039648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd83bf3-8450-4a6d-b110-260545ca0a7e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:39.039930 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd83bf3-8450-4a6d-b110-260545ca0a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:39.040203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd83bf3-8450-4a6d-b110-260545ca0a7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:39.041058 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd83bf3-8450-4a6d-b110-260545ca0a7e None admin] RBAC: Adding query filter params (role.id=b25f2feb715144eebde4711522cb8024, user.id=3c86fa4af6254ec9ae2146d218d776a1, scope.system=all) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:39.041374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd83bf3-8450-4a6d-b110-260545ca0a7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:39.042883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd83bf3-8450-4a6d-b110-260545ca0a7e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:39.047983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed30ffc-b26b-462c-b7ef-87a544e4289a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:39.049230 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 159/312] 10.222.0.75 () {56 vars in 1308 bytes} [Thu Jul 28 17:44:38 2022] GET /identity/v3/role_assignments?user.id=3c86fa4af6254ec9ae2146d218d776a1&scope.system=all&role.id=b25f2feb715144eebde4711522cb8024 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:39.079226 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:39.171002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed30ffc-b26b-462c-b7ef-87a544e4289a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:39.211107 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f9bdf-9c82-49bd-a06b-521d9e0d9df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:39.211764 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f9bdf-9c82-49bd-a06b-521d9e0d9df2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:39.212045 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f9bdf-9c82-49bd-a06b-521d9e0d9df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:39.212318 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f9bdf-9c82-49bd-a06b-521d9e0d9df2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:39.224313 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f9bdf-9c82-49bd-a06b-521d9e0d9df2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:39.229462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-c33f9bdf-9c82-49bd-a06b-521d9e0d9df2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:44:39.229462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:39.229462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:39.229462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:39.229462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:39.229462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:39.229462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:39.229462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:39.229462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:39.229462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:39.229462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:39.229462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:39.229462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:39.229462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:39.229462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:39.229462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:39.230352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:39.230352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:39.230352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:39.230352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:39.230352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:39.230352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:39.230352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:39.230352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:39.230352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:39.230352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:39.230352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:39.230352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:39.230352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:39.230352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:39.230352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:39.230352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:39.231140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:39.231140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:39.231140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:39.231140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:39.231140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:39.231140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:39.231140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:39.231140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:39.231140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:39.231140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:39.231140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:44:39.231140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:39.231140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 154/313] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:39.236621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd83bf3-8450-4a6d-b110-260545ca0a7e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:39.256619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:39.342392 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd83bf3-8450-4a6d-b110-260545ca0a7e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:39.378779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc5be9-9e00-4e00-a87c-d39673a12a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:39.379462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc5be9-9e00-4e00-a87c-d39673a12a02 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:39.379743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc5be9-9e00-4e00-a87c-d39673a12a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:39.380073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc5be9-9e00-4e00-a87c-d39673a12a02 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:39.380818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc5be9-9e00-4e00-a87c-d39673a12a02 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:39.381180 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc5be9-9e00-4e00-a87c-d39673a12a02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:39.382581 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc5be9-9e00-4e00-a87c-d39673a12a02 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:39.393660 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 160/314] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:39.403588 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f9bdf-9c82-49bd-a06b-521d9e0d9df2 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:39.506790 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:39.517835 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f9bdf-9c82-49bd-a06b-521d9e0d9df2 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:39.554401 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5fab4-1836-4d25-a87e-a50812667e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:39.557806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5fab4-1836-4d25-a87e-a50812667e0d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:39.557806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5fab4-1836-4d25-a87e-a50812667e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:39.557806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5fab4-1836-4d25-a87e-a50812667e0d None admin] PATH_INFO: `/v3/users/f76074415825460cbddbca1d7ec98d3a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:39.564920 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5fab4-1836-4d25-a87e-a50812667e0d None admin] RBAC: Authorizing `identity:get_user(user_id=f76074415825460cbddbca1d7ec98d3a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:39.566936 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5fab4-1836-4d25-a87e-a50812667e0d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:39.568921 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 155/315] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:39 2022] GET /identity/v3/users/f76074415825460cbddbca1d7ec98d3a => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:39.574456 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc5be9-9e00-4e00-a87c-d39673a12a02 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:39.664081 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:39.685784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc5be9-9e00-4e00-a87c-d39673a12a02 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:39.721818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eaaafd-aa6b-49ff-82b8-8980312612b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:39.722458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eaaafd-aa6b-49ff-82b8-8980312612b1 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:39.722872 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eaaafd-aa6b-49ff-82b8-8980312612b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:39.723150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eaaafd-aa6b-49ff-82b8-8980312612b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:39.806442 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eaaafd-aa6b-49ff-82b8-8980312612b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:39.807844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eaaafd-aa6b-49ff-82b8-8980312612b1 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:39.886609 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:39.909710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 161/316] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:39.915340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5fab4-1836-4d25-a87e-a50812667e0d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:40.021452 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5fab4-1836-4d25-a87e-a50812667e0d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:40.061745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5e1bb-990e-4100-95d9-1d6aca38a607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:40.062314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5e1bb-990e-4100-95d9-1d6aca38a607 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:40.062599 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5e1bb-990e-4100-95d9-1d6aca38a607 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:40.062878 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5e1bb-990e-4100-95d9-1d6aca38a607 None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:40.065724 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5e1bb-990e-4100-95d9-1d6aca38a607 None admin] RBAC: Authorizing `identity:get_project(project_id=3747706d68904890975b5253c7f2b3a9)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:40.067762 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5e1bb-990e-4100-95d9-1d6aca38a607 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:40.069837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 156/317] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:39 2022] GET /identity/v3/projects/3747706d68904890975b5253c7f2b3a9 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:40.079393 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eaaafd-aa6b-49ff-82b8-8980312612b1 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:40.206551 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eaaafd-aa6b-49ff-82b8-8980312612b1 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:40.243812 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363798e-fdda-480c-bf65-3c4c35ad5552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:40.244444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363798e-fdda-480c-bf65-3c4c35ad5552 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:40.244726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363798e-fdda-480c-bf65-3c4c35ad5552 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:40.245028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363798e-fdda-480c-bf65-3c4c35ad5552 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:40.245836 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363798e-fdda-480c-bf65-3c4c35ad5552 None admin] RBAC: Adding query filter params (role.id=b25f2feb715144eebde4711522cb8024, scope.project.id=3747706d68904890975b5253c7f2b3a9, user.id=f76074415825460cbddbca1d7ec98d3a) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:40.246157 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363798e-fdda-480c-bf65-3c4c35ad5552 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:40.247637 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363798e-fdda-480c-bf65-3c4c35ad5552 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:40.254763 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 162/318] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:44:40 2022] GET /identity/v3/role_assignments?user.id=f76074415825460cbddbca1d7ec98d3a&scope.project.id=3747706d68904890975b5253c7f2b3a9&role.id=b25f2feb715144eebde4711522cb8024 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:41.070998 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa52b-e551-4e20-98e3-70cd25f78f88 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:41.071523 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa52b-e551-4e20-98e3-70cd25f78f88 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:41.071628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa52b-e551-4e20-98e3-70cd25f78f88 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:41.073070 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 157/319] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:41.077994 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7402a-d01d-470a-9f3f-e19ff9cd6cfe None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:41.078381 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7402a-d01d-470a-9f3f-e19ff9cd6cfe None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:41.078552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7402a-d01d-470a-9f3f-e19ff9cd6cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:41.096309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaff9c9-f09e-4b0d-9bab-e98f42139e64 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:41.096620 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaff9c9-f09e-4b0d-9bab-e98f42139e64 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:41.096716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-32b7402a-d01d-470a-9f3f-e19ff9cd6cfe None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:41.096952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaff9c9-f09e-4b0d-9bab-e98f42139e64 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:41.098478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-32b7402a-d01d-470a-9f3f-e19ff9cd6cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:41.099817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 158/320] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:44:41.103979 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6c8da-5cdb-476e-80af-083718b5bf32 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:41.104274 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6c8da-5cdb-476e-80af-083718b5bf32 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:41.104552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6c8da-5cdb-476e-80af-083718b5bf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:41.122781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-cbc6c8da-5cdb-476e-80af-083718b5bf32 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:41.123978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cbc6c8da-5cdb-476e-80af-083718b5bf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:41.134463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:41.137289 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:41.166019 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 163/321] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:41.167355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a924eb-0a17-449b-bfd0-affbe93f57ce None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:41.167609 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a924eb-0a17-449b-bfd0-affbe93f57ce None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:41.167885 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a924eb-0a17-449b-bfd0-affbe93f57ce None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:41.173143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 164/322] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:41.178474 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba9719-a6d9-4e27-b3c8-4e5e7f051f56 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:41.178758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba9719-a6d9-4e27-b3c8-4e5e7f051f56 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:41.179036 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba9719-a6d9-4e27-b3c8-4e5e7f051f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:41.193043 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 159/323] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:44:41.193893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6c8da-5cdb-476e-80af-083718b5bf32 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:41.197124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c6ba9719-a6d9-4e27-b3c8-4e5e7f051f56 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:41.198326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c6ba9719-a6d9-4e27-b3c8-4e5e7f051f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:41.265183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 165/324] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:41.265814 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba9719-a6d9-4e27-b3c8-4e5e7f051f56 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:41.295352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6c8da-5cdb-476e-80af-083718b5bf32 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:41.329026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eff8d2-a62e-4ad9-b1be-d80cdff4988a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:41.329610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eff8d2-a62e-4ad9-b1be-d80cdff4988a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:41.329892 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eff8d2-a62e-4ad9-b1be-d80cdff4988a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:41.330163 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eff8d2-a62e-4ad9-b1be-d80cdff4988a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:41.343157 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eff8d2-a62e-4ad9-b1be-d80cdff4988a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:41.348653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-46eff8d2-a62e-4ad9-b1be-d80cdff4988a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:41.348653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:41.348653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:41.348653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:41.348653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:41.348653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:41.348653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:41.348653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:41.348653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:41.348653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:41.348653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:41.348653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:41.348653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:41.348653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:41.348653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:41.348653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:41.349721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:41.349721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:41.349721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:41.349721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:41.349721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:41.349721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:41.349721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:41.349721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:41.349721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:41.349721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:41.349721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:41.349721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:41.349721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:41.349721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:41.349721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:41.349721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:41.350507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:41.350507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:41.350507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:41.350507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:41.350507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:41.350507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:41.350507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:41.350507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:41.350507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:41.350507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:41.350507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:41.350507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:41.350507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 160/325] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:41.351151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eff8d2-a62e-4ad9-b1be-d80cdff4988a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:41.366561 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:41.377133 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba9719-a6d9-4e27-b3c8-4e5e7f051f56 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:41.378879 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:41.411517 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7da4f-265e-4814-af7a-eca87793421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:41.412210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7da4f-265e-4814-af7a-eca87793421e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:41.412495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7da4f-265e-4814-af7a-eca87793421e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:41.412798 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7da4f-265e-4814-af7a-eca87793421e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:41.422856 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7da4f-265e-4814-af7a-eca87793421e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:41.428121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-37e7da4f-265e-4814-af7a-eca87793421e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:44:41.428121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:41.428121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:41.428121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:41.428121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:41.428121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:41.428121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:41.428121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:41.428121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:41.428121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:41.428121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:41.428121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:41.428121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:41.428121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:41.428121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:41.428121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:41.429220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:41.429220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:41.429220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:41.429220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:41.429220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:41.429220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:41.429220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:41.429220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:41.429220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:41.429220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:41.429220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:41.429220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:41.429220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:41.429220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:41.429220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:41.429220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:41.430495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:41.430495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:41.430495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:41.430495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:41.430495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:41.430495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:41.430495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:41.430495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:41.430495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:41.430495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:41.430495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:44:41.430495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:41.430495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 166/326] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:41.431351 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7da4f-265e-4814-af7a-eca87793421e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:41.459863 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eff8d2-a62e-4ad9-b1be-d80cdff4988a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:41.494284 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722f6b9-0149-4729-a967-4e375eb9e554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:41.494923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722f6b9-0149-4729-a967-4e375eb9e554 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:41.495202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722f6b9-0149-4729-a967-4e375eb9e554 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:41.495477 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722f6b9-0149-4729-a967-4e375eb9e554 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:41.496622 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722f6b9-0149-4729-a967-4e375eb9e554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:41.498100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722f6b9-0149-4729-a967-4e375eb9e554 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:41.499692 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 161/327] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:44:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:41.500448 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722f6b9-0149-4729-a967-4e375eb9e554 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:41.532818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7da4f-265e-4814-af7a-eca87793421e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:41.566101 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f39c85-2b84-43c5-9e7f-e2290cd97b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:41.566737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f39c85-2b84-43c5-9e7f-e2290cd97b5a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:41.567024 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f39c85-2b84-43c5-9e7f-e2290cd97b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:41.567298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f39c85-2b84-43c5-9e7f-e2290cd97b5a None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:41.568014 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f39c85-2b84-43c5-9e7f-e2290cd97b5a None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:41.568330 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f39c85-2b84-43c5-9e7f-e2290cd97b5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:41.569762 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f39c85-2b84-43c5-9e7f-e2290cd97b5a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:41.586190 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 167/328] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:41.586926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f39c85-2b84-43c5-9e7f-e2290cd97b5a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:41.614934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:41.620049 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:41.642942 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722f6b9-0149-4729-a967-4e375eb9e554 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:41.677575 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac9012-84b3-4680-8d27-ddb67ff3ff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:41.678198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac9012-84b3-4680-8d27-ddb67ff3ff3b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:41.678486 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac9012-84b3-4680-8d27-ddb67ff3ff3b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:41.678764 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac9012-84b3-4680-8d27-ddb67ff3ff3b None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:41.679486 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac9012-84b3-4680-8d27-ddb67ff3ff3b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:41.679796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac9012-84b3-4680-8d27-ddb67ff3ff3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:41.681215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac9012-84b3-4680-8d27-ddb67ff3ff3b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:41.691258 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 162/329] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:41.691665 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f39c85-2b84-43c5-9e7f-e2290cd97b5a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:41.692051 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac9012-84b3-4680-8d27-ddb67ff3ff3b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:41.726123 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943aadb3-9d11-4b12-94c2-dc40f605ffee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:41.726763 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aadb3-9d11-4b12-94c2-dc40f605ffee None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:41.727024 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aadb3-9d11-4b12-94c2-dc40f605ffee None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:41.727298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aadb3-9d11-4b12-94c2-dc40f605ffee None admin] PATH_INFO: `/v3/groups` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:41.727947 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943aadb3-9d11-4b12-94c2-dc40f605ffee None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:41.729422 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943aadb3-9d11-4b12-94c2-dc40f605ffee None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:41.791343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac9012-84b3-4680-8d27-ddb67ff3ff3b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:41.823722 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54066b6-4b0c-4fb9-bc62-ed7ffc1e7206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:41.824358 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54066b6-4b0c-4fb9-bc62-ed7ffc1e7206 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:41.824644 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54066b6-4b0c-4fb9-bc62-ed7ffc1e7206 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:41.824955 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54066b6-4b0c-4fb9-bc62-ed7ffc1e7206 None admin] PATH_INFO: `/v3/users/97cf0fbd7098457ba4dbc8ba2bc5291b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:41.826129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54066b6-4b0c-4fb9-bc62-ed7ffc1e7206 None admin] RBAC: Authorizing `identity:get_user(user_id=97cf0fbd7098457ba4dbc8ba2bc5291b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:41.827575 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54066b6-4b0c-4fb9-bc62-ed7ffc1e7206 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:41.829202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 163/330] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:41 2022] GET /identity/v3/users/97cf0fbd7098457ba4dbc8ba2bc5291b => generated 293 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:41.830042 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54066b6-4b0c-4fb9-bc62-ed7ffc1e7206 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:41.839891 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 168/331] 10.222.0.75 () {60 vars in 1134 bytes} [Thu Jul 28 17:44:41 2022] POST /identity/v3/groups => generated 226 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:44:41.839891 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943aadb3-9d11-4b12-94c2-dc40f605ffee None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:41.840416 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:41.945529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54066b6-4b0c-4fb9-bc62-ed7ffc1e7206 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:41.948251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:41.965602 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943aadb3-9d11-4b12-94c2-dc40f605ffee None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:41.985261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddb521-06e6-4d5d-9e20-dc79f155dbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:41.986171 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddb521-06e6-4d5d-9e20-dc79f155dbc1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:41.986766 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddb521-06e6-4d5d-9e20-dc79f155dbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:41.987044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddb521-06e6-4d5d-9e20-dc79f155dbc1 None admin] PATH_INFO: `/v3/users/3c86fa4af6254ec9ae2146d218d776a1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:41.989095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddb521-06e6-4d5d-9e20-dc79f155dbc1 None admin] RBAC: Authorizing `identity:get_user(user_id=3c86fa4af6254ec9ae2146d218d776a1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:41.990675 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddb521-06e6-4d5d-9e20-dc79f155dbc1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:41.992501 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 164/332] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:41 2022] GET /identity/v3/users/3c86fa4af6254ec9ae2146d218d776a1 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:41.997873 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddb521-06e6-4d5d-9e20-dc79f155dbc1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:42.009443 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be9382-a978-4ae2-8947-6c6ddbb31700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:42.010057 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be9382-a978-4ae2-8947-6c6ddbb31700 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:42.010164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be9382-a978-4ae2-8947-6c6ddbb31700 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:42.010368 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be9382-a978-4ae2-8947-6c6ddbb31700 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:42.014954 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be9382-a978-4ae2-8947-6c6ddbb31700 None admin] RBAC: Adding query filter params (role.id=279c255613df457cb2d5d9904dd6f12a, user.id=97cf0fbd7098457ba4dbc8ba2bc5291b, scope.system=all) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:42.014954 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be9382-a978-4ae2-8947-6c6ddbb31700 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:42.014954 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be9382-a978-4ae2-8947-6c6ddbb31700 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:42.028478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 169/333] 10.222.0.75 () {56 vars in 1308 bytes} [Thu Jul 28 17:44:41 2022] GET /identity/v3/role_assignments?user.id=97cf0fbd7098457ba4dbc8ba2bc5291b&scope.system=all&role.id=279c255613df457cb2d5d9904dd6f12a => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:42.100425 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:42.130486 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddb521-06e6-4d5d-9e20-dc79f155dbc1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:42.175657 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638492a-7447-4bdc-8f91-35edcc0d3648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:42.176347 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638492a-7447-4bdc-8f91-35edcc0d3648 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:42.176626 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638492a-7447-4bdc-8f91-35edcc0d3648 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:42.176932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638492a-7447-4bdc-8f91-35edcc0d3648 None admin] PATH_INFO: `/v3/system/users/3c86fa4af6254ec9ae2146d218d776a1/roles/b25f2feb715144eebde4711522cb8024` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:42.178423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638492a-7447-4bdc-8f91-35edcc0d3648 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3c86fa4af6254ec9ae2146d218d776a1, role_id=b25f2feb715144eebde4711522cb8024)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:42.179814 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638492a-7447-4bdc-8f91-35edcc0d3648 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:42.264610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 165/334] 10.222.0.75 () {58 vars in 1334 bytes} [Thu Jul 28 17:44:41 2022] PUT /identity/v3/system/users/3c86fa4af6254ec9ae2146d218d776a1/roles/b25f2feb715144eebde4711522cb8024 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:44:44.199741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd46f5f-59af-48d9-a5ae-77489a34f4ad None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:44.200927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd46f5f-59af-48d9-a5ae-77489a34f4ad None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:44.201433 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd46f5f-59af-48d9-a5ae-77489a34f4ad None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:44.203016 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 170/335] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:44.208801 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00729170-4b30-49c7-9031-9e8217331dff None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:44.209255 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00729170-4b30-49c7-9031-9e8217331dff None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:44.209361 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00729170-4b30-49c7-9031-9e8217331dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:44.238733 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-00729170-4b30-49c7-9031-9e8217331dff None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:44.240286 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-00729170-4b30-49c7-9031-9e8217331dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:44.325545 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 166/336] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:44.372088 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd46f5f-59af-48d9-a5ae-77489a34f4ad None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:44.541634 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd46f5f-59af-48d9-a5ae-77489a34f4ad None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:44.560710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55867773-a868-4a21-9a8d-906e6fbe3f3a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:44.561378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55867773-a868-4a21-9a8d-906e6fbe3f3a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:44.561938 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55867773-a868-4a21-9a8d-906e6fbe3f3a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:44.563766 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 167/337] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:44.572451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c2ef9-faa6-4691-a49a-77ea1bd6e17a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:44.573013 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c2ef9-faa6-4691-a49a-77ea1bd6e17a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:44.573316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c2ef9-faa6-4691-a49a-77ea1bd6e17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:44.589492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91536b11-8157-4a4f-a475-2a7a775ed237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:44.590724 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91536b11-8157-4a4f-a475-2a7a775ed237 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:44.591214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91536b11-8157-4a4f-a475-2a7a775ed237 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:44.591690 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91536b11-8157-4a4f-a475-2a7a775ed237 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:44.606750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9c5c2ef9-faa6-4691-a49a-77ea1bd6e17a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:44.608305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9c5c2ef9-faa6-4691-a49a-77ea1bd6e17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:44.616789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91536b11-8157-4a4f-a475-2a7a775ed237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:44.619281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-91536b11-8157-4a4f-a475-2a7a775ed237 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:44.619281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:44.619281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:44.619281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:44.619281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:44.619281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:44.619281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:44.619281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:44.619281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:44.619281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:44.619281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:44.619281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:44.619281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:44.619281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:44.619281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:44.619281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:44.620211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:44.620211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:44.620211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:44.620211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:44.620211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:44.620211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:44.620211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:44.620211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:44.620211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:44.620211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:44.620211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:44.620211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:44.620211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:44.620211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:44.620211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:44.620211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:44.621062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:44.621062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:44.621062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:44.621062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:44.621062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:44.621062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:44.621062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:44.621062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:44.621062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:44.621062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:44.621062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:44.621062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:44.621062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 171/338] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:44.632006 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91536b11-8157-4a4f-a475-2a7a775ed237 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:44.641075 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:44.745605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:44.757884 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 168/339] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:44:44.795935 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c2ef9-faa6-4691-a49a-77ea1bd6e17a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:44.820187 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91536b11-8157-4a4f-a475-2a7a775ed237 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:44.886418 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339cf9d3-2f4f-4809-a4e1-9f841dec7edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:44.887064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cf9d3-2f4f-4809-a4e1-9f841dec7edb None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:44.887343 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cf9d3-2f4f-4809-a4e1-9f841dec7edb None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:44.887703 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cf9d3-2f4f-4809-a4e1-9f841dec7edb None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:44.888439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339cf9d3-2f4f-4809-a4e1-9f841dec7edb None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:44.888742 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339cf9d3-2f4f-4809-a4e1-9f841dec7edb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:44.890229 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339cf9d3-2f4f-4809-a4e1-9f841dec7edb None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:44.908319 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 172/340] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:44.916145 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339cf9d3-2f4f-4809-a4e1-9f841dec7edb None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:45.001152 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c2ef9-faa6-4691-a49a-77ea1bd6e17a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:45.046935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:45.085018 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f04f42-c86b-4e50-aa50-c88e675869b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:45.085702 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f04f42-c86b-4e50-aa50-c88e675869b0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:45.086098 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f04f42-c86b-4e50-aa50-c88e675869b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:45.086285 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f04f42-c86b-4e50-aa50-c88e675869b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:45.108203 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f04f42-c86b-4e50-aa50-c88e675869b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:45.116495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-85f04f42-c86b-4e50-aa50-c88e675869b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:45.116495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:45.116495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:45.116495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:45.116495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:45.116495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:45.116495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:45.116495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:45.116495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:45.116495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:45.116495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:45.116495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:45.116495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:45.116495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:45.116495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:45.116495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:45.117437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:45.117437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:45.117437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:45.117437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:45.117437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:45.117437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:45.117437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:45.117437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:45.117437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:45.117437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:45.117437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:45.117437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:45.117437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:45.117437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:45.117437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:45.117437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:45.118211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:45.118211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:45.118211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:45.118211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:45.118211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:45.118211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:45.118211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:45.118211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:45.118211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:45.118211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:45.118211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:45.118211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:45.118810 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 169/341] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:44:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:44:45.119806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066327ec-97b4-44f0-8106-04e2c4d18d26 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:45.120094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066327ec-97b4-44f0-8106-04e2c4d18d26 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:45.120371 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066327ec-97b4-44f0-8106-04e2c4d18d26 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:45.122408 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 170/342] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:45.127394 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339cf9d3-2f4f-4809-a4e1-9f841dec7edb None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:45.131080 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574fea5-b038-4a4d-8d20-40bd274fb174 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:45.132239 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574fea5-b038-4a4d-8d20-40bd274fb174 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:45.132687 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574fea5-b038-4a4d-8d20-40bd274fb174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:45.166785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d574fea5-b038-4a4d-8d20-40bd274fb174 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:45.168260 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d574fea5-b038-4a4d-8d20-40bd274fb174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:45.193434 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606aef2f-b8a1-4f5d-a538-65a4ffb3fee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:45.194311 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606aef2f-b8a1-4f5d-a538-65a4ffb3fee4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:45.194775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606aef2f-b8a1-4f5d-a538-65a4ffb3fee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:45.195214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606aef2f-b8a1-4f5d-a538-65a4ffb3fee4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:45.256719 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:45.275012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 171/343] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:45.279709 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574fea5-b038-4a4d-8d20-40bd274fb174 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:45.322605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606aef2f-b8a1-4f5d-a538-65a4ffb3fee4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:45.324676 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606aef2f-b8a1-4f5d-a538-65a4ffb3fee4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:45.419276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574fea5-b038-4a4d-8d20-40bd274fb174 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:45.423048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:45.467484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16160357-6cf7-4bb9-9eba-ce8d09c8aed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:45.468792 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16160357-6cf7-4bb9-9eba-ce8d09c8aed1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:45.469140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16160357-6cf7-4bb9-9eba-ce8d09c8aed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:45.469716 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16160357-6cf7-4bb9-9eba-ce8d09c8aed1 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:45.470704 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16160357-6cf7-4bb9-9eba-ce8d09c8aed1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:45.471327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16160357-6cf7-4bb9-9eba-ce8d09c8aed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:45.473695 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16160357-6cf7-4bb9-9eba-ce8d09c8aed1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:45.478389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 173/344] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:45.479889 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9cbfc-8f28-4108-881b-32e9122b838b None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:45.480386 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9cbfc-8f28-4108-881b-32e9122b838b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:45.483913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9cbfc-8f28-4108-881b-32e9122b838b None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:45.491351 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 174/345] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:45 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:45.493730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 172/346] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:44:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:45.493870 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9cbfc-8f28-4108-881b-32e9122b838b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:45.494955 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16160357-6cf7-4bb9-9eba-ce8d09c8aed1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:45.568207 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:45.638732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9cbfc-8f28-4108-881b-32e9122b838b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:45.639863 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16160357-6cf7-4bb9-9eba-ce8d09c8aed1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:45.691838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132b79d-e7af-4754-b223-e62ae2875245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:45.692066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850b101-41f1-434c-963a-418273cc7ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:45.692632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850b101-41f1-434c-963a-418273cc7ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:45.692965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850b101-41f1-434c-963a-418273cc7ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:45.693244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850b101-41f1-434c-963a-418273cc7ea8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:45.693527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132b79d-e7af-4754-b223-e62ae2875245 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:45.693949 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132b79d-e7af-4754-b223-e62ae2875245 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:45.694410 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132b79d-e7af-4754-b223-e62ae2875245 None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:45.695756 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132b79d-e7af-4754-b223-e62ae2875245 None admin] RBAC: Authorizing `identity:get_project(project_id=005e84bc135b44f088d0ad047d11daf7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:45.698195 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132b79d-e7af-4754-b223-e62ae2875245 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:45.700799 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 173/347] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:45 2022] GET /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:45.702270 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7bbfc-f546-40a3-8a2a-b75485f687be None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:45.702714 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7bbfc-f546-40a3-8a2a-b75485f687be None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:45.703146 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7bbfc-f546-40a3-8a2a-b75485f687be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:45.711378 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850b101-41f1-434c-963a-418273cc7ea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:45.717427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-c850b101-41f1-434c-963a-418273cc7ea8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:45.717427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:45.717427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:45.717427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:45.717427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:45.717427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:45.717427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:45.717427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:45.717427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:45.717427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:45.717427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:45.717427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:45.717427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:45.717427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:45.717427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:45.717427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:45.718514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:45.718514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:45.718514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:45.718514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:45.718514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:45.718514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:45.718514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:45.718514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:45.718514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:45.718514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:45.718514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:45.718514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:45.718514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:45.718514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:45.718514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:45.718514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:45.721632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:45.721632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:45.721632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:45.721632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:45.721632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:45.721632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:45.721632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:45.721632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:45.721632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:45.721632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:45.721632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:45.721632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:45.721632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 175/348] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:45.721632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850b101-41f1-434c-963a-418273cc7ea8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:45.736348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-77a7bbfc-f546-40a3-8a2a-b75485f687be None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:45.738680 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-77a7bbfc-f546-40a3-8a2a-b75485f687be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:45.751913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:45.855104 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 174/349] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:45.856536 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7bbfc-f546-40a3-8a2a-b75485f687be None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:45.899833 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850b101-41f1-434c-963a-418273cc7ea8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:45.926885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:45.954673 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf1e5d-7430-42a2-ba67-3a955ab8cc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:45.954673 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf1e5d-7430-42a2-ba67-3a955ab8cc2b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:45.954673 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf1e5d-7430-42a2-ba67-3a955ab8cc2b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:45.954673 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf1e5d-7430-42a2-ba67-3a955ab8cc2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:46.003863 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7bbfc-f546-40a3-8a2a-b75485f687be None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:46.044653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52001ce4-414d-46c6-887c-fd3007fbdf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:46.045824 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52001ce4-414d-46c6-887c-fd3007fbdf52 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:46.046262 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52001ce4-414d-46c6-887c-fd3007fbdf52 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:46.046805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52001ce4-414d-46c6-887c-fd3007fbdf52 None admin] PATH_INFO: `/v3/groups/24f7eaf311534a6595a927d1ceb82370` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:46.050864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf1e5d-7430-42a2-ba67-3a955ab8cc2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:46.052376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf1e5d-7430-42a2-ba67-3a955ab8cc2b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:46.053613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52001ce4-414d-46c6-887c-fd3007fbdf52 None admin] RBAC: Authorizing `identity:get_group(group_id=24f7eaf311534a6595a927d1ceb82370)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:46.055223 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52001ce4-414d-46c6-887c-fd3007fbdf52 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:46.057693 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 175/350] 10.222.0.75 () {56 vars in 1180 bytes} [Thu Jul 28 17:44:45 2022] GET /identity/v3/groups/24f7eaf311534a6595a927d1ceb82370 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:46.058101 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52001ce4-414d-46c6-887c-fd3007fbdf52 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:46.086557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:46.185184 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 176/351] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:46.186074 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf1e5d-7430-42a2-ba67-3a955ab8cc2b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:46.192177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52001ce4-414d-46c6-887c-fd3007fbdf52 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:46.207397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:46.234687 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2eb3b5-1f3c-43c8-b418-9cf6d4bf1cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:46.235437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eb3b5-1f3c-43c8-b418-9cf6d4bf1cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:46.235722 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eb3b5-1f3c-43c8-b418-9cf6d4bf1cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:46.236000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eb3b5-1f3c-43c8-b418-9cf6d4bf1cb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:46.236841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2eb3b5-1f3c-43c8-b418-9cf6d4bf1cb8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:46.237432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2eb3b5-1f3c-43c8-b418-9cf6d4bf1cb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:46.238681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2eb3b5-1f3c-43c8-b418-9cf6d4bf1cb8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:46.252515 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 176/352] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:46.253829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381980d7-e2f2-417c-83f2-f70560633b61 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:46.254123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381980d7-e2f2-417c-83f2-f70560633b61 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:46.254438 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381980d7-e2f2-417c-83f2-f70560633b61 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:46.255804 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 177/353] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:46.257666 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381980d7-e2f2-417c-83f2-f70560633b61 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:46.303844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf1e5d-7430-42a2-ba67-3a955ab8cc2b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:46.330756 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:46.349318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec633cc-c7cd-456f-b3a1-04e74abade4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:46.351032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec633cc-c7cd-456f-b3a1-04e74abade4f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:46.351032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec633cc-c7cd-456f-b3a1-04e74abade4f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:46.351032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec633cc-c7cd-456f-b3a1-04e74abade4f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:46.365667 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec633cc-c7cd-456f-b3a1-04e74abade4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:46.371723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-fec633cc-c7cd-456f-b3a1-04e74abade4f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:44:46.371723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:46.371723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:46.371723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:46.371723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:46.371723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:46.371723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:46.371723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:46.371723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:46.371723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:46.371723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:46.371723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:46.371723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:46.371723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:46.371723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:46.371723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:46.372617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:46.372617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:46.372617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:46.372617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:46.372617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:46.372617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:46.372617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:46.372617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:46.372617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:46.372617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:46.372617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:46.372617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:46.372617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:46.372617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:46.372617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:46.372617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:46.373466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:46.373466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:46.373466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:46.373466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:46.373466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:46.373466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:46.373466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:46.373466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:46.373466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:46.373466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:46.373466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:44:46.373466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:46.373466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 177/354] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:46.375467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec7569-1410-43aa-9a77-3e379f5465d9 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:46.375467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec7569-1410-43aa-9a77-3e379f5465d9 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:46.376110 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec7569-1410-43aa-9a77-3e379f5465d9 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:46.376888 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381980d7-e2f2-417c-83f2-f70560633b61 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:46.377798 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 178/355] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:46.379167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec7569-1410-43aa-9a77-3e379f5465d9 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:46.425352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a88a18-1101-4350-96f6-2018f91148cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:46.426457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a88a18-1101-4350-96f6-2018f91148cb None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:46.427078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a88a18-1101-4350-96f6-2018f91148cb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:46.427511 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a88a18-1101-4350-96f6-2018f91148cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:46.428976 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a88a18-1101-4350-96f6-2018f91148cb None admin] RBAC: Adding query filter params (group.id=24f7eaf311534a6595a927d1ceb82370, role.id=279c255613df457cb2d5d9904dd6f12a, scope.project.id=005e84bc135b44f088d0ad047d11daf7) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:46.429465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a88a18-1101-4350-96f6-2018f91148cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:46.431412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a88a18-1101-4350-96f6-2018f91148cb None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:46.439188 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 178/356] 10.222.0.75 () {56 vars in 1376 bytes} [Thu Jul 28 17:44:46 2022] GET /identity/v3/role_assignments?group.id=24f7eaf311534a6595a927d1ceb82370&scope.project.id=005e84bc135b44f088d0ad047d11daf7&role.id=279c255613df457cb2d5d9904dd6f12a => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:46.440290 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a88a18-1101-4350-96f6-2018f91148cb None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:46.497019 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:46.517581 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec7569-1410-43aa-9a77-3e379f5465d9 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:46.563817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdd5f4-d7fc-4f3d-bdf0-008692a04931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:46.565003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdd5f4-d7fc-4f3d-bdf0-008692a04931 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:46.565525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdd5f4-d7fc-4f3d-bdf0-008692a04931 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:46.566593 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdd5f4-d7fc-4f3d-bdf0-008692a04931 None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:46.568034 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdd5f4-d7fc-4f3d-bdf0-008692a04931 None admin] RBAC: Authorizing `identity:get_project(project_id=005e84bc135b44f088d0ad047d11daf7)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:46.570010 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdd5f4-d7fc-4f3d-bdf0-008692a04931 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:46.572020 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 179/357] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:46 2022] GET /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:46.575019 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b22532-c6a5-4996-aeae-d19e33469c2d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:46.575766 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b22532-c6a5-4996-aeae-d19e33469c2d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:46.576235 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b22532-c6a5-4996-aeae-d19e33469c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:46.593649 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a88a18-1101-4350-96f6-2018f91148cb None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:46.600599 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-83b22532-c6a5-4996-aeae-d19e33469c2d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:46.602155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-83b22532-c6a5-4996-aeae-d19e33469c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:46.640624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cf044-8483-430b-a32d-cfe536dc748c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:46.641436 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cf044-8483-430b-a32d-cfe536dc748c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:46.641724 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cf044-8483-430b-a32d-cfe536dc748c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:46.642001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cf044-8483-430b-a32d-cfe536dc748c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:46.664639 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:46.690809 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 180/358] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:46.692342 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b22532-c6a5-4996-aeae-d19e33469c2d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:46.746509 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92cf044-8483-430b-a32d-cfe536dc748c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:46.746509 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92cf044-8483-430b-a32d-cfe536dc748c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:46.794755 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:46.824685 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b22532-c6a5-4996-aeae-d19e33469c2d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:46.867133 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73c98f-996b-409f-b3d0-83aa3d4bc0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:46.867765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73c98f-996b-409f-b3d0-83aa3d4bc0ca None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:46.868045 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73c98f-996b-409f-b3d0-83aa3d4bc0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:46.868321 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73c98f-996b-409f-b3d0-83aa3d4bc0ca None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:46.869077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73c98f-996b-409f-b3d0-83aa3d4bc0ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:46.869384 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73c98f-996b-409f-b3d0-83aa3d4bc0ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:46.870792 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73c98f-996b-409f-b3d0-83aa3d4bc0ca None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:46.880952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 179/359] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:46.881448 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 181/360] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:46.882667 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507492a-1361-4967-88b2-948aa68dfe9e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:46.882793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73c98f-996b-409f-b3d0-83aa3d4bc0ca None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:46.885334 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507492a-1361-4967-88b2-948aa68dfe9e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:46.885334 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507492a-1361-4967-88b2-948aa68dfe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:46.905751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9507492a-1361-4967-88b2-948aa68dfe9e None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:46.908074 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9507492a-1361-4967-88b2-948aa68dfe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:46.941955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:46.992718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 180/361] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:46.993158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507492a-1361-4967-88b2-948aa68dfe9e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:47.018131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73c98f-996b-409f-b3d0-83aa3d4bc0ca None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:47.063937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bc857-a301-44a7-bd12-13e8c140dced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:47.064601 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bc857-a301-44a7-bd12-13e8c140dced None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:47.064957 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bc857-a301-44a7-bd12-13e8c140dced None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:47.065234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bc857-a301-44a7-bd12-13e8c140dced None admin] PATH_INFO: `/v3/groups/24f7eaf311534a6595a927d1ceb82370` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:47.067824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bc857-a301-44a7-bd12-13e8c140dced None admin] RBAC: Authorizing `identity:get_group(group_id=24f7eaf311534a6595a927d1ceb82370)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:47.069328 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bc857-a301-44a7-bd12-13e8c140dced None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:47.075350 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:47.076678 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 182/362] 10.222.0.75 () {56 vars in 1180 bytes} [Thu Jul 28 17:44:46 2022] GET /identity/v3/groups/24f7eaf311534a6595a927d1ceb82370 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:47.077731 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bc857-a301-44a7-bd12-13e8c140dced None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:47.120842 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507492a-1361-4967-88b2-948aa68dfe9e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:47.161327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1caf6-5572-4ddb-a7de-135fb7c314b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:47.162169 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1caf6-5572-4ddb-a7de-135fb7c314b4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:47.162522 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1caf6-5572-4ddb-a7de-135fb7c314b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:47.162804 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1caf6-5572-4ddb-a7de-135fb7c314b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:47.178825 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1caf6-5572-4ddb-a7de-135fb7c314b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:47.183815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-55b1caf6-5572-4ddb-a7de-135fb7c314b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:47.183815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:47.183815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:47.183815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:47.183815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:47.183815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:47.183815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:47.183815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:47.183815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:47.183815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:47.183815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:47.183815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:47.183815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:47.183815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:47.183815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:47.183815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:47.184909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:47.184909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:47.184909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:47.184909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:47.184909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:47.184909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:47.184909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:47.184909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:47.184909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:47.184909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:47.184909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:47.184909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:47.184909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:47.184909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:47.184909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:47.184909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:47.185820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:47.185820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:47.185820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:47.185820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:47.185820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:47.185820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:47.185820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:47.185820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:47.185820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:47.185820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:47.185820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:47.185820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:47.186509 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 181/363] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:44:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:47.187306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1caf6-5572-4ddb-a7de-135fb7c314b4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:47.206266 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bc857-a301-44a7-bd12-13e8c140dced None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:47.222808 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:47.245966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcd559-48a8-48dc-92c3-4057f7660a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:47.246625 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcd559-48a8-48dc-92c3-4057f7660a34 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:47.246906 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcd559-48a8-48dc-92c3-4057f7660a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:47.247180 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcd559-48a8-48dc-92c3-4057f7660a34 None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:47.248343 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcd559-48a8-48dc-92c3-4057f7660a34 None admin] RBAC: Authorizing `identity:get_project(project_id=3747706d68904890975b5253c7f2b3a9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:47.249880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcd559-48a8-48dc-92c3-4057f7660a34 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:47.251841 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 183/364] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:47 2022] GET /identity/v3/projects/3747706d68904890975b5253c7f2b3a9 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:47.252624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcd559-48a8-48dc-92c3-4057f7660a34 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:47.314155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1caf6-5572-4ddb-a7de-135fb7c314b4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:47.360004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:47.373363 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f0dd5-b4fb-4593-bdd9-f6a9e0f1f8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:47.374332 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f0dd5-b4fb-4593-bdd9-f6a9e0f1f8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:47.374781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f0dd5-b4fb-4593-bdd9-f6a9e0f1f8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:47.375226 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f0dd5-b4fb-4593-bdd9-f6a9e0f1f8a1 None admin] PATH_INFO: `/v3/users/3c86fa4af6254ec9ae2146d218d776a1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:47.377504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f0dd5-b4fb-4593-bdd9-f6a9e0f1f8a1 None admin] RBAC: Authorizing `identity:get_user(user_id=3c86fa4af6254ec9ae2146d218d776a1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:47.379596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f0dd5-b4fb-4593-bdd9-f6a9e0f1f8a1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:47.381282 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 182/365] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:47 2022] GET /identity/v3/users/3c86fa4af6254ec9ae2146d218d776a1 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:47.382057 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f0dd5-b4fb-4593-bdd9-f6a9e0f1f8a1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:47.395969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcd559-48a8-48dc-92c3-4057f7660a34 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:47.440829 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c73e1-f69d-4c8e-9069-bb008c2c78d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:47.441500 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c73e1-f69d-4c8e-9069-bb008c2c78d5 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:47.442191 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c73e1-f69d-4c8e-9069-bb008c2c78d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:47.442473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c73e1-f69d-4c8e-9069-bb008c2c78d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:47.454860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c73e1-f69d-4c8e-9069-bb008c2c78d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:47.460987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-c92c73e1-f69d-4c8e-9069-bb008c2c78d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:47.460987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:47.460987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:47.460987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:47.460987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:47.460987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:47.460987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:47.460987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:47.460987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:47.460987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:47.460987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:47.460987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:47.460987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:47.460987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:47.460987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:47.460987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:47.461834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:47.461834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:47.461834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:47.461834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:47.461834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:47.461834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:47.461834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:47.461834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:47.461834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:47.461834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:47.461834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:47.461834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:47.461834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:47.461834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:47.461834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:47.461834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:47.462621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:47.462621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:47.462621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:47.462621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:47.462621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:47.462621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:47.462621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:47.462621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:47.462621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:47.462621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:47.462621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:47.462621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:47.462621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 184/366] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:44:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:47.463264 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c73e1-f69d-4c8e-9069-bb008c2c78d5 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:47.513241 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f0dd5-b4fb-4593-bdd9-f6a9e0f1f8a1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:47.522556 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:47.568174 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773586f-f04e-4080-8f2c-ac3ed7a42b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:47.568799 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773586f-f04e-4080-8f2c-ac3ed7a42b3d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:47.569096 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773586f-f04e-4080-8f2c-ac3ed7a42b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:47.569372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773586f-f04e-4080-8f2c-ac3ed7a42b3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:47.570179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773586f-f04e-4080-8f2c-ac3ed7a42b3d None admin] RBAC: Adding query filter params (group.id=24f7eaf311534a6595a927d1ceb82370, role.id=e2024b6eae3d49f09caa7d4275eb88bc, scope.project.id=005e84bc135b44f088d0ad047d11daf7) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:47.570489 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773586f-f04e-4080-8f2c-ac3ed7a42b3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:47.571926 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773586f-f04e-4080-8f2c-ac3ed7a42b3d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:47.578971 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 183/367] 10.222.0.75 () {56 vars in 1376 bytes} [Thu Jul 28 17:44:47 2022] GET /identity/v3/role_assignments?group.id=24f7eaf311534a6595a927d1ceb82370&scope.project.id=005e84bc135b44f088d0ad047d11daf7&role.id=e2024b6eae3d49f09caa7d4275eb88bc => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:47.579581 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773586f-f04e-4080-8f2c-ac3ed7a42b3d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:47.598909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c73e1-f69d-4c8e-9069-bb008c2c78d5 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:47.647623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca888e5b-ddc1-4d78-9d11-442b221eed48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:47.648279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca888e5b-ddc1-4d78-9d11-442b221eed48 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:47.648624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca888e5b-ddc1-4d78-9d11-442b221eed48 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:47.648968 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca888e5b-ddc1-4d78-9d11-442b221eed48 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:47.649766 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca888e5b-ddc1-4d78-9d11-442b221eed48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:47.650081 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca888e5b-ddc1-4d78-9d11-442b221eed48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:47.652251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca888e5b-ddc1-4d78-9d11-442b221eed48 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:47.664593 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 185/368] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:44:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:47.666199 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca888e5b-ddc1-4d78-9d11-442b221eed48 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:47.674547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:47.726195 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773586f-f04e-4080-8f2c-ac3ed7a42b3d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:47.771020 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92263af2-adfd-4c0a-940f-dcf4b18a97c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:47.772122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92263af2-adfd-4c0a-940f-dcf4b18a97c1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:47.773414 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92263af2-adfd-4c0a-940f-dcf4b18a97c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:47.773931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92263af2-adfd-4c0a-940f-dcf4b18a97c1 None admin] PATH_INFO: `/v3/groups/24f7eaf311534a6595a927d1ceb82370` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:47.776249 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92263af2-adfd-4c0a-940f-dcf4b18a97c1 None admin] RBAC: Authorizing `identity:get_group(group_id=24f7eaf311534a6595a927d1ceb82370)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:47.778888 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92263af2-adfd-4c0a-940f-dcf4b18a97c1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:47.781301 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 184/369] 10.222.0.75 () {56 vars in 1180 bytes} [Thu Jul 28 17:44:47 2022] GET /identity/v3/groups/24f7eaf311534a6595a927d1ceb82370 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:47.782888 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92263af2-adfd-4c0a-940f-dcf4b18a97c1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:47.808108 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca888e5b-ddc1-4d78-9d11-442b221eed48 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:47.810323 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:47.850763 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805892a7-7643-4834-8fc9-fdf630e8485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:47.851668 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805892a7-7643-4834-8fc9-fdf630e8485e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:47.852063 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805892a7-7643-4834-8fc9-fdf630e8485e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:47.852431 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805892a7-7643-4834-8fc9-fdf630e8485e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:47.853413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805892a7-7643-4834-8fc9-fdf630e8485e None admin] RBAC: Adding query filter params (role.id=b25f2feb715144eebde4711522cb8024, user.id=3c86fa4af6254ec9ae2146d218d776a1, scope.system=all) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:47.853833 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805892a7-7643-4834-8fc9-fdf630e8485e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:47.855532 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805892a7-7643-4834-8fc9-fdf630e8485e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:47.878245 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 186/370] 10.222.0.75 () {56 vars in 1308 bytes} [Thu Jul 28 17:44:47 2022] GET /identity/v3/role_assignments?user.id=3c86fa4af6254ec9ae2146d218d776a1&scope.system=all&role.id=b25f2feb715144eebde4711522cb8024 => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:47.880413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805892a7-7643-4834-8fc9-fdf630e8485e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:47.960953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92263af2-adfd-4c0a-940f-dcf4b18a97c1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:48.024863 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:48.050934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21ec10-a93b-4aa4-a816-4bdc544c4c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:48.051825 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21ec10-a93b-4aa4-a816-4bdc544c4c23 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:48.052281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21ec10-a93b-4aa4-a816-4bdc544c4c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:48.052735 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21ec10-a93b-4aa4-a816-4bdc544c4c23 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:48.053507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21ec10-a93b-4aa4-a816-4bdc544c4c23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:48.053822 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21ec10-a93b-4aa4-a816-4bdc544c4c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:48.055221 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21ec10-a93b-4aa4-a816-4bdc544c4c23 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:48.074740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 185/371] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:48.074740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21ec10-a93b-4aa4-a816-4bdc544c4c23 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:48.075671 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805892a7-7643-4834-8fc9-fdf630e8485e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:48.142808 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c1e17-b02a-431e-a34f-4c74e3fc6a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:48.143497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c1e17-b02a-431e-a34f-4c74e3fc6a61 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:48.143787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c1e17-b02a-431e-a34f-4c74e3fc6a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:48.144638 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c1e17-b02a-431e-a34f-4c74e3fc6a61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:48.182532 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:48.231178 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21ec10-a93b-4aa4-a816-4bdc544c4c23 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:48.243912 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c1e17-b02a-431e-a34f-4c74e3fc6a61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:48.245852 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c1e17-b02a-431e-a34f-4c74e3fc6a61 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:48.286796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9eaa18-5c52-4ea1-afe4-e1879c4c4437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:48.287361 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9eaa18-5c52-4ea1-afe4-e1879c4c4437 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:48.287649 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9eaa18-5c52-4ea1-afe4-e1879c4c4437 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:48.287930 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9eaa18-5c52-4ea1-afe4-e1879c4c4437 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:48.288739 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9eaa18-5c52-4ea1-afe4-e1879c4c4437 None admin] RBAC: Adding query filter params (group.id=24f7eaf311534a6595a927d1ceb82370, role.id=279c255613df457cb2d5d9904dd6f12a, scope.project.id=3747706d68904890975b5253c7f2b3a9) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:48.289085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9eaa18-5c52-4ea1-afe4-e1879c4c4437 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:48.290900 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9eaa18-5c52-4ea1-afe4-e1879c4c4437 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:48.301038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 186/372] 10.222.0.75 () {56 vars in 1376 bytes} [Thu Jul 28 17:44:48 2022] GET /identity/v3/role_assignments?group.id=24f7eaf311534a6595a927d1ceb82370&scope.project.id=3747706d68904890975b5253c7f2b3a9&role.id=279c255613df457cb2d5d9904dd6f12a => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:48.301038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9eaa18-5c52-4ea1-afe4-e1879c4c4437 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:48.373441 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:48.429217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9eaa18-5c52-4ea1-afe4-e1879c4c4437 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:48.470787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfea336-84e2-49db-96c9-0741f84aa375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:48.471432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfea336-84e2-49db-96c9-0741f84aa375 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:48.471751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfea336-84e2-49db-96c9-0741f84aa375 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:48.472029 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfea336-84e2-49db-96c9-0741f84aa375 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:48.479834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 187/373] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:48.489862 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c1e17-b02a-431e-a34f-4c74e3fc6a61 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:48.567530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfea336-84e2-49db-96c9-0741f84aa375 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:48.570288 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfea336-84e2-49db-96c9-0741f84aa375 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:48.638385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:48.701996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c1e17-b02a-431e-a34f-4c74e3fc6a61 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:48.712061 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:48.770127 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9202f3-9165-49c6-9d4c-d4fc3c439b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:48.770791 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9202f3-9165-49c6-9d4c-d4fc3c439b00 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:48.771072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9202f3-9165-49c6-9d4c-d4fc3c439b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:48.771348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9202f3-9165-49c6-9d4c-d4fc3c439b00 None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:48.773641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9202f3-9165-49c6-9d4c-d4fc3c439b00 None admin] RBAC: Authorizing `identity:get_project(project_id=3747706d68904890975b5253c7f2b3a9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:48.776109 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9202f3-9165-49c6-9d4c-d4fc3c439b00 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:48.778279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 188/374] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:48 2022] GET /identity/v3/projects/3747706d68904890975b5253c7f2b3a9 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:48.785728 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9202f3-9165-49c6-9d4c-d4fc3c439b00 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:48.798477 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 187/375] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:48.804223 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfea336-84e2-49db-96c9-0741f84aa375 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:48.946789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9202f3-9165-49c6-9d4c-d4fc3c439b00 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:48.997361 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfea336-84e2-49db-96c9-0741f84aa375 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:49.001514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:49.010750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f228d5-f3e5-4dfb-a011-8a89db4675d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:49.016972 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f228d5-f3e5-4dfb-a011-8a89db4675d6 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:49.016972 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f228d5-f3e5-4dfb-a011-8a89db4675d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:49.016972 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f228d5-f3e5-4dfb-a011-8a89db4675d6 None admin] PATH_INFO: `/v3/groups/24f7eaf311534a6595a927d1ceb82370` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:49.016972 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f228d5-f3e5-4dfb-a011-8a89db4675d6 None admin] RBAC: Authorizing `identity:get_group(group_id=24f7eaf311534a6595a927d1ceb82370)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:49.016972 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f228d5-f3e5-4dfb-a011-8a89db4675d6 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:49.017515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 189/376] 10.222.0.75 () {56 vars in 1180 bytes} [Thu Jul 28 17:44:48 2022] GET /identity/v3/groups/24f7eaf311534a6595a927d1ceb82370 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:49.019003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91727b-0c18-43b2-aaad-b4bcfaf2eb81 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:49.019290 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91727b-0c18-43b2-aaad-b4bcfaf2eb81 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:49.019568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91727b-0c18-43b2-aaad-b4bcfaf2eb81 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:49.021985 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 190/377] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:49.028775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1b2fb-a0bc-4418-802a-5011f8ae3198 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:49.029157 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1b2fb-a0bc-4418-802a-5011f8ae3198 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:49.029504 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1b2fb-a0bc-4418-802a-5011f8ae3198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:49.054520 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0bc1b2fb-a0bc-4418-802a-5011f8ae3198 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:49.054910 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186154f-a0ef-4a6a-b862-3ce0a5d8d27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:49.055747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186154f-a0ef-4a6a-b862-3ce0a5d8d27b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:49.055970 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0bc1b2fb-a0bc-4418-802a-5011f8ae3198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:49.056323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186154f-a0ef-4a6a-b862-3ce0a5d8d27b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:49.056734 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186154f-a0ef-4a6a-b862-3ce0a5d8d27b None admin] PATH_INFO: `/v3/projects/7ee435a1a9d946639c722d848ce39bd1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:49.058191 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186154f-a0ef-4a6a-b862-3ce0a5d8d27b None admin] RBAC: Authorizing `identity:get_project(project_id=7ee435a1a9d946639c722d848ce39bd1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:49.060017 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186154f-a0ef-4a6a-b862-3ce0a5d8d27b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:49.061926 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 188/378] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:48 2022] GET /identity/v3/projects/7ee435a1a9d946639c722d848ce39bd1 => generated 344 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:49.062870 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186154f-a0ef-4a6a-b862-3ce0a5d8d27b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:49.097241 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:49.154966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 191/379] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:49.156433 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1b2fb-a0bc-4418-802a-5011f8ae3198 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:49.183796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186154f-a0ef-4a6a-b862-3ce0a5d8d27b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:49.222525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab6dc5-bfa6-4f06-9218-e7a3f93be19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:49.223551 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab6dc5-bfa6-4f06-9218-e7a3f93be19b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:49.224024 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab6dc5-bfa6-4f06-9218-e7a3f93be19b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:49.224521 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab6dc5-bfa6-4f06-9218-e7a3f93be19b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:49.225533 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab6dc5-bfa6-4f06-9218-e7a3f93be19b None admin] RBAC: Adding query filter params (group.id=24f7eaf311534a6595a927d1ceb82370, role.id=e2024b6eae3d49f09caa7d4275eb88bc, scope.project.id=3747706d68904890975b5253c7f2b3a9) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:49.226100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab6dc5-bfa6-4f06-9218-e7a3f93be19b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:49.227844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab6dc5-bfa6-4f06-9218-e7a3f93be19b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:49.234195 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 189/380] 10.222.0.75 () {56 vars in 1376 bytes} [Thu Jul 28 17:44:49 2022] GET /identity/v3/role_assignments?group.id=24f7eaf311534a6595a927d1ceb82370&scope.project.id=3747706d68904890975b5253c7f2b3a9&role.id=e2024b6eae3d49f09caa7d4275eb88bc => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:49.235268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab6dc5-bfa6-4f06-9218-e7a3f93be19b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:49.288838 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1b2fb-a0bc-4418-802a-5011f8ae3198 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:49.319773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:49.327968 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b309154-276d-457d-85bc-324cf92b2d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:49.328537 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b309154-276d-457d-85bc-324cf92b2d71 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:49.328852 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b309154-276d-457d-85bc-324cf92b2d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:49.329129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b309154-276d-457d-85bc-324cf92b2d71 None admin] PATH_INFO: `/v3/groups/28ddfb31e6d24f76a6b5f00770815764` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:49.336648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b309154-276d-457d-85bc-324cf92b2d71 None admin] RBAC: Authorizing `identity:get_group(group_id=28ddfb31e6d24f76a6b5f00770815764)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:49.338652 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:49.339095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b309154-276d-457d-85bc-324cf92b2d71 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:49.341170 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 192/381] 10.222.0.75 () {56 vars in 1180 bytes} [Thu Jul 28 17:44:49 2022] GET /identity/v3/groups/28ddfb31e6d24f76a6b5f00770815764 => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:49.348045 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b309154-276d-457d-85bc-324cf92b2d71 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:49.364134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab6dc5-bfa6-4f06-9218-e7a3f93be19b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:49.453506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a934d50-9d7a-4076-80d1-bde782ddaaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:49.454894 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a934d50-9d7a-4076-80d1-bde782ddaaa1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:49.455433 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a934d50-9d7a-4076-80d1-bde782ddaaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:49.455836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a934d50-9d7a-4076-80d1-bde782ddaaa1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:49.481809 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a934d50-9d7a-4076-80d1-bde782ddaaa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:49.485153 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b309154-276d-457d-85bc-324cf92b2d71 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:49.488091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-3a934d50-9d7a-4076-80d1-bde782ddaaa1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:49.488091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:49.488091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:49.488091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:49.488091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:49.488091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:49.488091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:49.488091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:49.488091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:49.488091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:49.488091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:49.488091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:49.488091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:49.488091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:49.488091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:49.488091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:49.489181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:49.489181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:49.489181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:49.489181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:49.489181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:49.489181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:49.489181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:49.489181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:49.489181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:49.489181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:49.489181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:49.489181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:49.489181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:49.489181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:49.489181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:49.489181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:49.490158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:49.490158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:49.490158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:49.490158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:49.490158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:49.490158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:49.490158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:49.490158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:49.490158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:49.490158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:49.490158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:49.490158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:49.500840 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 190/382] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:49.507111 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a934d50-9d7a-4076-80d1-bde782ddaaa1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:49.526867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb8c8f-b195-455a-802a-8bb36a9e91a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:49.527648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb8c8f-b195-455a-802a-8bb36a9e91a4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:49.527998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb8c8f-b195-455a-802a-8bb36a9e91a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:49.528419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb8c8f-b195-455a-802a-8bb36a9e91a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:49.529869 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb8c8f-b195-455a-802a-8bb36a9e91a4 None admin] RBAC: Adding query filter params (group.id=28ddfb31e6d24f76a6b5f00770815764, role.id=d371062e071845ffa4570a76d40dff88, scope.project.id=7ee435a1a9d946639c722d848ce39bd1) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:49.530257 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb8c8f-b195-455a-802a-8bb36a9e91a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:49.531796 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb8c8f-b195-455a-802a-8bb36a9e91a4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:49.539264 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 193/383] 10.222.0.75 () {56 vars in 1376 bytes} [Thu Jul 28 17:44:49 2022] GET /identity/v3/role_assignments?group.id=28ddfb31e6d24f76a6b5f00770815764&scope.project.id=7ee435a1a9d946639c722d848ce39bd1&role.id=d371062e071845ffa4570a76d40dff88 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:49.655366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a934d50-9d7a-4076-80d1-bde782ddaaa1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:49.712884 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfad20-6e08-4a13-a7b0-f88f923aa810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:49.714013 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfad20-6e08-4a13-a7b0-f88f923aa810 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:49.714531 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfad20-6e08-4a13-a7b0-f88f923aa810 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:49.715031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfad20-6e08-4a13-a7b0-f88f923aa810 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:49.716003 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfad20-6e08-4a13-a7b0-f88f923aa810 None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:49.716525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfad20-6e08-4a13-a7b0-f88f923aa810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:49.718176 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfad20-6e08-4a13-a7b0-f88f923aa810 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:49.732046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 191/384] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:49.737425 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb8c8f-b195-455a-802a-8bb36a9e91a4 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:49.832047 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:49.882620 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30fe9f-50ee-4863-996b-9f67f311a6e4 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:49.882940 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30fe9f-50ee-4863-996b-9f67f311a6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:49.883175 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30fe9f-50ee-4863-996b-9f67f311a6e4 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:49.884523 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 192/385] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:44:49.889817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5c5d8-78a6-452a-9ea9-e6625c59da83 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:49.890111 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5c5d8-78a6-452a-9ea9-e6625c59da83 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:49.890396 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5c5d8-78a6-452a-9ea9-e6625c59da83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:49.892623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb8c8f-b195-455a-802a-8bb36a9e91a4 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:49.918330 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-76b5c5d8-78a6-452a-9ea9-e6625c59da83 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:49.919529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-76b5c5d8-78a6-452a-9ea9-e6625c59da83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:49.921702 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:49.960611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a54f6-e968-49fd-963c-604dc61cadbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:49.961583 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a54f6-e968-49fd-963c-604dc61cadbb None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:49.962037 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a54f6-e968-49fd-963c-604dc61cadbb None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:49.962507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a54f6-e968-49fd-963c-604dc61cadbb None admin] PATH_INFO: `/v3/groups/24f7eaf311534a6595a927d1ceb82370` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:49.964885 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a54f6-e968-49fd-963c-604dc61cadbb None admin] RBAC: Authorizing `identity:get_group(group_id=24f7eaf311534a6595a927d1ceb82370)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:49.966518 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a54f6-e968-49fd-963c-604dc61cadbb None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:49.968285 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 194/386] 10.222.0.75 () {56 vars in 1180 bytes} [Thu Jul 28 17:44:49 2022] GET /identity/v3/groups/24f7eaf311534a6595a927d1ceb82370 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:49.974319 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a54f6-e968-49fd-963c-604dc61cadbb None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:50.064118 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 193/387] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:44:50.087530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5c5d8-78a6-452a-9ea9-e6625c59da83 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:50.129078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a54f6-e968-49fd-963c-604dc61cadbb None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:50.153202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:50.165969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88681d9-d423-4c0f-bb12-675710542b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:50.166632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88681d9-d423-4c0f-bb12-675710542b9d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:50.166914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88681d9-d423-4c0f-bb12-675710542b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:50.167190 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88681d9-d423-4c0f-bb12-675710542b9d None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:50.168374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88681d9-d423-4c0f-bb12-675710542b9d None admin] RBAC: Authorizing `identity:get_project(project_id=005e84bc135b44f088d0ad047d11daf7)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:50.171545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88681d9-d423-4c0f-bb12-675710542b9d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:50.173280 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 195/388] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:49 2022] GET /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:50.181561 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88681d9-d423-4c0f-bb12-675710542b9d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:50.276939 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5c5d8-78a6-452a-9ea9-e6625c59da83 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:50.326338 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88681d9-d423-4c0f-bb12-675710542b9d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:50.349486 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f6b47-ed05-4875-9be3-2300eecda6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:50.350333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f6b47-ed05-4875-9be3-2300eecda6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:50.350708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f6b47-ed05-4875-9be3-2300eecda6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:50.351123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f6b47-ed05-4875-9be3-2300eecda6c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:50.371425 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a85d9b-a3b5-476b-b971-88a005eb949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:50.372207 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f6b47-ed05-4875-9be3-2300eecda6c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:50.372706 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a85d9b-a3b5-476b-b971-88a005eb949e None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:50.373251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a85d9b-a3b5-476b-b971-88a005eb949e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:50.373704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a85d9b-a3b5-476b-b971-88a005eb949e None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7/groups/24f7eaf311534a6595a927d1ceb82370/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:50.375928 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a85d9b-a3b5-476b-b971-88a005eb949e None admin] RBAC: Authorizing `identity:create_grant(project_id=005e84bc135b44f088d0ad047d11daf7, group_id=24f7eaf311534a6595a927d1ceb82370, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:50.377613 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a85d9b-a3b5-476b-b971-88a005eb949e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:50.385110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:50.390340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-0c2f6b47-ed05-4875-9be3-2300eecda6c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:50.390340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:50.390340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:50.390340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:50.390340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:50.390340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:50.390340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:50.390340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:50.390340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:50.390340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:50.390340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:50.390340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:50.390340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:50.390340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:50.390340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:50.390340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:50.391217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:50.391217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:50.391217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:50.391217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:50.391217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:50.391217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:50.391217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:50.391217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:50.391217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:50.391217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:50.391217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:50.391217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:50.391217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:50.391217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:50.391217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:50.391217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:50.392047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:50.392047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:50.392047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:50.392047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:50.392047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:50.392047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:50.392047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:50.392047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:50.392047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:50.392047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:50.392047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:50.392047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:50.395140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 194/389] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:44:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:50.401251 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f6b47-ed05-4875-9be3-2300eecda6c6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:50.458103 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 196/390] 10.222.0.75 () {58 vars in 1442 bytes} [Thu Jul 28 17:44:50 2022] PUT /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7/groups/24f7eaf311534a6595a927d1ceb82370/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:44:50.528806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f6b47-ed05-4875-9be3-2300eecda6c6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:50.568203 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d8eeb-ea27-488f-9884-fdd26bc331b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:50.569201 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d8eeb-ea27-488f-9884-fdd26bc331b3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:50.569644 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d8eeb-ea27-488f-9884-fdd26bc331b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:50.570062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d8eeb-ea27-488f-9884-fdd26bc331b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:50.571063 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d8eeb-ea27-488f-9884-fdd26bc331b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:50.571606 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d8eeb-ea27-488f-9884-fdd26bc331b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:50.573243 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d8eeb-ea27-488f-9884-fdd26bc331b3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:50.583076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 195/391] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:44:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:50.588359 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a85d9b-a3b5-476b-b971-88a005eb949e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:50.667614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:50.726370 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a85d9b-a3b5-476b-b971-88a005eb949e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:50.764846 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6f4f3-ea66-4636-b6d8-07007c155018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:50.765747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6f4f3-ea66-4636-b6d8-07007c155018 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:50.766182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6f4f3-ea66-4636-b6d8-07007c155018 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:50.766628 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6f4f3-ea66-4636-b6d8-07007c155018 None admin] PATH_INFO: `/v3/groups/24f7eaf311534a6595a927d1ceb82370` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:50.767941 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6f4f3-ea66-4636-b6d8-07007c155018 None admin] RBAC: Authorizing `identity:get_group(group_id=24f7eaf311534a6595a927d1ceb82370)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:50.770105 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6f4f3-ea66-4636-b6d8-07007c155018 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:50.772248 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 197/392] 10.222.0.75 () {56 vars in 1180 bytes} [Thu Jul 28 17:44:50 2022] GET /identity/v3/groups/24f7eaf311534a6595a927d1ceb82370 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:50.777604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d8eeb-ea27-488f-9884-fdd26bc331b3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:50.842372 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd8059-8101-4a62-84ed-4a3656e313a6 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:50.842963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd8059-8101-4a62-84ed-4a3656e313a6 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:50.843437 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd8059-8101-4a62-84ed-4a3656e313a6 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:50.845271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 198/393] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:50.858186 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d6382-17da-45f7-af74-df8612235388 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:50.858767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d6382-17da-45f7-af74-df8612235388 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:50.859326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d6382-17da-45f7-af74-df8612235388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:50.869221 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:50.893014 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e02d6382-17da-45f7-af74-df8612235388 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:50.896851 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e02d6382-17da-45f7-af74-df8612235388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:50.938814 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d8eeb-ea27-488f-9884-fdd26bc331b3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:51.003940 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce5181-485a-425c-976f-e1c16a715d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:51.004601 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce5181-485a-425c-976f-e1c16a715d90 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:51.004909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce5181-485a-425c-976f-e1c16a715d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:51.005185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce5181-485a-425c-976f-e1c16a715d90 None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:51.006998 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce5181-485a-425c-976f-e1c16a715d90 None admin] RBAC: Authorizing `identity:get_project(project_id=005e84bc135b44f088d0ad047d11daf7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:51.008440 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce5181-485a-425c-976f-e1c16a715d90 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:51.011307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 196/394] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:50 2022] GET /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:51.017807 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce5181-485a-425c-976f-e1c16a715d90 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:51.034113 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 199/395] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:51.059709 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d6382-17da-45f7-af74-df8612235388 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:51.139361 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce5181-485a-425c-976f-e1c16a715d90 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:51.169166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:51.169394 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:51.174613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a97524-1d2b-4473-a45f-921613d31791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:51.176109 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a97524-1d2b-4473-a45f-921613d31791 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:51.176532 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a97524-1d2b-4473-a45f-921613d31791 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:51.176987 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a97524-1d2b-4473-a45f-921613d31791 None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7/groups/24f7eaf311534a6595a927d1ceb82370/roles/e2024b6eae3d49f09caa7d4275eb88bc` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:51.183187 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a97524-1d2b-4473-a45f-921613d31791 None admin] RBAC: Authorizing `identity:create_grant(project_id=005e84bc135b44f088d0ad047d11daf7, group_id=24f7eaf311534a6595a927d1ceb82370, role_id=e2024b6eae3d49f09caa7d4275eb88bc)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:51.186134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a97524-1d2b-4473-a45f-921613d31791 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:51.235218 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d6382-17da-45f7-af74-df8612235388 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:51.273157 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67736cc5-9c00-40d9-bd4b-cb2ac8e0b4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:51.274117 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67736cc5-9c00-40d9-bd4b-cb2ac8e0b4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:51.274543 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67736cc5-9c00-40d9-bd4b-cb2ac8e0b4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:51.275020 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67736cc5-9c00-40d9-bd4b-cb2ac8e0b4e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:51.280199 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 197/396] 10.222.0.75 () {58 vars in 1442 bytes} [Thu Jul 28 17:44:51 2022] PUT /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7/groups/24f7eaf311534a6595a927d1ceb82370/roles/e2024b6eae3d49f09caa7d4275eb88bc => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:44:51.292349 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67736cc5-9c00-40d9-bd4b-cb2ac8e0b4e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:51.297926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-67736cc5-9c00-40d9-bd4b-cb2ac8e0b4e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:51.297926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:51.297926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:51.297926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:51.297926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:51.297926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:51.297926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:51.297926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:51.297926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:51.297926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:51.297926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:51.297926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:51.297926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:51.297926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:51.297926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:51.297926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:51.298980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:51.298980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:51.298980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:51.298980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:51.298980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:51.298980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:51.298980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:51.298980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:51.298980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:51.298980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:51.298980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:51.298980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:51.298980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:51.298980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:51.298980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:51.298980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:51.300495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:51.300495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:51.300495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:51.300495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:51.300495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:51.300495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:51.300495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:51.300495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:51.300495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:51.300495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:51.300495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:51.300495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:51.302918 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 200/397] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:51.309341 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a97524-1d2b-4473-a45f-921613d31791 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:51.465283 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a97524-1d2b-4473-a45f-921613d31791 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:51.502499 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a244514-c537-4ace-beb2-505625295d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:51.503417 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a244514-c537-4ace-beb2-505625295d0a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:51.503838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a244514-c537-4ace-beb2-505625295d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:51.504269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a244514-c537-4ace-beb2-505625295d0a None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:51.505153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a244514-c537-4ace-beb2-505625295d0a None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:51.505597 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a244514-c537-4ace-beb2-505625295d0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:51.507103 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a244514-c537-4ace-beb2-505625295d0a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:51.516385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 198/398] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:51.524466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67736cc5-9c00-40d9-bd4b-cb2ac8e0b4e4 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:51.635455 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67736cc5-9c00-40d9-bd4b-cb2ac8e0b4e4 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:51.646275 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:51.672953 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b2307-e0eb-4d79-bf2e-16d86423b772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:51.673826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b2307-e0eb-4d79-bf2e-16d86423b772 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:51.674251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b2307-e0eb-4d79-bf2e-16d86423b772 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:51.674698 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b2307-e0eb-4d79-bf2e-16d86423b772 None admin] PATH_INFO: `/v3/groups/24f7eaf311534a6595a927d1ceb82370` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:51.676103 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b2307-e0eb-4d79-bf2e-16d86423b772 None admin] RBAC: Authorizing `identity:get_group(group_id=24f7eaf311534a6595a927d1ceb82370)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:51.677750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b2307-e0eb-4d79-bf2e-16d86423b772 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:51.679503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 201/399] 10.222.0.75 () {56 vars in 1180 bytes} [Thu Jul 28 17:44:51 2022] GET /identity/v3/groups/24f7eaf311534a6595a927d1ceb82370 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:51.685575 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a244514-c537-4ace-beb2-505625295d0a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:51.755419 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:51.820766 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a244514-c537-4ace-beb2-505625295d0a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:51.865982 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a8cb7-3320-4cd9-bea9-6cfcff6b2fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:51.866968 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a8cb7-3320-4cd9-bea9-6cfcff6b2fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:51.867448 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a8cb7-3320-4cd9-bea9-6cfcff6b2fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:51.867926 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a8cb7-3320-4cd9-bea9-6cfcff6b2fc6 None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:51.870132 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a8cb7-3320-4cd9-bea9-6cfcff6b2fc6 None admin] RBAC: Authorizing `identity:get_project(project_id=3747706d68904890975b5253c7f2b3a9)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:51.871864 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a8cb7-3320-4cd9-bea9-6cfcff6b2fc6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:51.873909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 199/400] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:51 2022] GET /identity/v3/projects/3747706d68904890975b5253c7f2b3a9 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:51.880062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b2307-e0eb-4d79-bf2e-16d86423b772 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:51.952446 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1392d1-b108-44d7-859f-12e8f43642b7 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:51.953092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1392d1-b108-44d7-859f-12e8f43642b7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:51.953857 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1392d1-b108-44d7-859f-12e8f43642b7 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:51.955992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 200/401] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:44:51.961819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752074be-5b1c-407d-83a2-c9c074b54e75 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:51.962112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752074be-5b1c-407d-83a2-c9c074b54e75 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:51.962420 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752074be-5b1c-407d-83a2-c9c074b54e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:51.993655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-752074be-5b1c-407d-83a2-c9c074b54e75 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:51.995861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-752074be-5b1c-407d-83a2-c9c074b54e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:52.013701 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b2307-e0eb-4d79-bf2e-16d86423b772 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:52.052349 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d71282-8dc0-4b8d-8032-4afcd310e022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:52.052806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d71282-8dc0-4b8d-8032-4afcd310e022 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:52.053098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d71282-8dc0-4b8d-8032-4afcd310e022 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:52.053379 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d71282-8dc0-4b8d-8032-4afcd310e022 None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9/groups/24f7eaf311534a6595a927d1ceb82370/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:52.055447 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d71282-8dc0-4b8d-8032-4afcd310e022 None admin] RBAC: Authorizing `identity:create_grant(project_id=3747706d68904890975b5253c7f2b3a9, group_id=24f7eaf311534a6595a927d1ceb82370, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:52.056946 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d71282-8dc0-4b8d-8032-4afcd310e022 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:52.082128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 201/402] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:44:52.083796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dafed9-5399-4725-a4d0-941a4985e826 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:52.084332 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dafed9-5399-4725-a4d0-941a4985e826 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:52.084888 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dafed9-5399-4725-a4d0-941a4985e826 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:52.086800 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 202/403] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:52.098039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3d419-a023-465b-8899-d722468214bd None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:52.098612 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3d419-a023-465b-8899-d722468214bd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:52.099122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3d419-a023-465b-8899-d722468214bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:52.118952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-13b3d419-a023-465b-8899-d722468214bd None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:52.120499 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-13b3d419-a023-465b-8899-d722468214bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:52.167842 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 202/404] 10.222.0.75 () {58 vars in 1442 bytes} [Thu Jul 28 17:44:51 2022] PUT /identity/v3/projects/3747706d68904890975b5253c7f2b3a9/groups/24f7eaf311534a6595a927d1ceb82370/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:44:52.169219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:52.170308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d71282-8dc0-4b8d-8032-4afcd310e022 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:52.231959 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 203/405] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:44:52.256394 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:52.256614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3d419-a023-465b-8899-d722468214bd None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:52.382547 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d71282-8dc0-4b8d-8032-4afcd310e022 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:52.423127 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa656f44-34b0-4192-9a6c-38ffb34756fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:52.424164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa656f44-34b0-4192-9a6c-38ffb34756fa None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:52.424655 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa656f44-34b0-4192-9a6c-38ffb34756fa None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:52.425172 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa656f44-34b0-4192-9a6c-38ffb34756fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:52.437834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa656f44-34b0-4192-9a6c-38ffb34756fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:52.445296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-fa656f44-34b0-4192-9a6c-38ffb34756fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:52.445296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:52.445296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:52.445296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:52.445296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:52.445296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:52.445296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:52.445296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:52.445296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:52.445296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:52.445296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:52.445296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:52.445296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:52.445296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:52.445296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:52.445296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:52.446210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:52.446210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:52.446210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:52.446210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:52.446210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:52.446210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:52.446210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:52.446210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:52.446210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:52.446210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:52.446210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:52.446210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:52.446210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:52.446210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:52.446210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:52.446210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:52.446983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:52.446983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:52.446983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:52.446983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:52.446983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:52.446983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:52.446983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:52.446983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:52.446983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:52.446983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:52.446983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:52.446983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:52.450157 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 203/406] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:44:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:52.455384 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa656f44-34b0-4192-9a6c-38ffb34756fa None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:52.466692 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3d419-a023-465b-8899-d722468214bd None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:52.541515 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3650cd5-9588-4dc0-8b6b-2f9f4d64a0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:52.543214 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3650cd5-9588-4dc0-8b6b-2f9f4d64a0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:52.545429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3650cd5-9588-4dc0-8b6b-2f9f4d64a0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:52.545978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3650cd5-9588-4dc0-8b6b-2f9f4d64a0a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:52.568403 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3650cd5-9588-4dc0-8b6b-2f9f4d64a0a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:52.583297 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-b3650cd5-9588-4dc0-8b6b-2f9f4d64a0a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:52.583297 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:52.583297 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:52.583297 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:52.583297 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:52.583297 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:52.583297 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:52.583297 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:52.583297 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:52.583297 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:52.583297 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:52.583297 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:52.583297 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:52.583297 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:52.583297 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:52.583297 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:52.584269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:52.584269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:52.584269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:52.584269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:52.584269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:52.584269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:52.584269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:52.584269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:52.584269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:52.584269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:52.584269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:52.584269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:52.584269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:52.584269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:52.584269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:52.584269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:52.585083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:52.585083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:52.585083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:52.585083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:52.585083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:52.585083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:52.585083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:52.585083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:52.585083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:52.585083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:52.585083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:52.585083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:52.589175 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 204/407] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:44:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:44:52.598649 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3650cd5-9588-4dc0-8b6b-2f9f4d64a0a7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:52.627832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:52.638711 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa656f44-34b0-4192-9a6c-38ffb34756fa None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:52.672363 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:52.714666 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7b7bb-1dad-46c1-b10d-1f6cbaf868e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:52.716609 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7b7bb-1dad-46c1-b10d-1f6cbaf868e8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:52.717789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7b7bb-1dad-46c1-b10d-1f6cbaf868e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:52.718285 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7b7bb-1dad-46c1-b10d-1f6cbaf868e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:52.719254 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7b7bb-1dad-46c1-b10d-1f6cbaf868e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:52.720181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7b7bb-1dad-46c1-b10d-1f6cbaf868e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:52.723726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7b7bb-1dad-46c1-b10d-1f6cbaf868e8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:52.742654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 204/408] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:52.748236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7b7bb-1dad-46c1-b10d-1f6cbaf868e8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:52.796213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3650cd5-9588-4dc0-8b6b-2f9f4d64a0a7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:52.859169 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a70c1-4682-4cc5-b097-de0c653c7e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:52.860822 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a70c1-4682-4cc5-b097-de0c653c7e63 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:52.861456 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a70c1-4682-4cc5-b097-de0c653c7e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:52.863416 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a70c1-4682-4cc5-b097-de0c653c7e63 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:52.864384 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a70c1-4682-4cc5-b097-de0c653c7e63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:52.865102 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a70c1-4682-4cc5-b097-de0c653c7e63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:52.866787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a70c1-4682-4cc5-b097-de0c653c7e63 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:52.884043 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 205/409] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:44:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:52.887174 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a70c1-4682-4cc5-b097-de0c653c7e63 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:52.937375 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7b7bb-1dad-46c1-b10d-1f6cbaf868e8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:52.975402 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568133b1-9b57-41ed-bc3a-b05e53d81899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:52.976394 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568133b1-9b57-41ed-bc3a-b05e53d81899 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:52.976905 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568133b1-9b57-41ed-bc3a-b05e53d81899 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:52.977400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568133b1-9b57-41ed-bc3a-b05e53d81899 None admin] PATH_INFO: `/v3/groups/28ddfb31e6d24f76a6b5f00770815764` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:52.978715 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568133b1-9b57-41ed-bc3a-b05e53d81899 None admin] RBAC: Authorizing `identity:get_group(group_id=28ddfb31e6d24f76a6b5f00770815764)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:52.980411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568133b1-9b57-41ed-bc3a-b05e53d81899 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:52.982571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 205/410] 10.222.0.75 () {56 vars in 1180 bytes} [Thu Jul 28 17:44:52 2022] GET /identity/v3/groups/28ddfb31e6d24f76a6b5f00770815764 => generated 229 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:52.984001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2eacf-d691-4aba-8575-7db9205ebc95 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:52.984521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2eacf-d691-4aba-8575-7db9205ebc95 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:52.985013 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2eacf-d691-4aba-8575-7db9205ebc95 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:52.986748 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 206/411] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:52.988169 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2eacf-d691-4aba-8575-7db9205ebc95 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:53.018662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:53.043779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:53.047976 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a70c1-4682-4cc5-b097-de0c653c7e63 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:53.089155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d192de-bebc-4b20-94b1-21b3569605f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:53.090101 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d192de-bebc-4b20-94b1-21b3569605f8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:53.090543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d192de-bebc-4b20-94b1-21b3569605f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:53.090988 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d192de-bebc-4b20-94b1-21b3569605f8 None admin] PATH_INFO: `/v3/groups/24f7eaf311534a6595a927d1ceb82370` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:53.092903 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d192de-bebc-4b20-94b1-21b3569605f8 None admin] RBAC: Authorizing `identity:get_group(group_id=24f7eaf311534a6595a927d1ceb82370)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:53.095148 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d192de-bebc-4b20-94b1-21b3569605f8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:53.098198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 206/412] 10.222.0.75 () {56 vars in 1180 bytes} [Thu Jul 28 17:44:52 2022] GET /identity/v3/groups/24f7eaf311534a6595a927d1ceb82370 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:53.099694 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2690c-56dc-43d6-9489-7949a4b68eb7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:53.100142 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2690c-56dc-43d6-9489-7949a4b68eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:53.100606 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2690c-56dc-43d6-9489-7949a4b68eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:53.123273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2eacf-d691-4aba-8575-7db9205ebc95 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:53.124436 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-31c2690c-56dc-43d6-9489-7949a4b68eb7 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:53.126852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-31c2690c-56dc-43d6-9489-7949a4b68eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:53.166978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323586c-e110-43e9-85c8-eb85a17e0e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:53.167868 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323586c-e110-43e9-85c8-eb85a17e0e1b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:53.168321 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323586c-e110-43e9-85c8-eb85a17e0e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:53.168668 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323586c-e110-43e9-85c8-eb85a17e0e1b None admin] PATH_INFO: `/v3/projects/7ee435a1a9d946639c722d848ce39bd1` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:53.170026 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323586c-e110-43e9-85c8-eb85a17e0e1b None admin] RBAC: Authorizing `identity:get_project(project_id=7ee435a1a9d946639c722d848ce39bd1)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:53.172906 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323586c-e110-43e9-85c8-eb85a17e0e1b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:53.175545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 207/413] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:52 2022] GET /identity/v3/projects/7ee435a1a9d946639c722d848ce39bd1 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:53.176802 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323586c-e110-43e9-85c8-eb85a17e0e1b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:53.216317 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 207/414] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:53.217278 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2690c-56dc-43d6-9489-7949a4b68eb7 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:53.283526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:53.296225 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323586c-e110-43e9-85c8-eb85a17e0e1b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:53.340231 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625ac43-0625-4547-9b2e-d0801488708d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:53.340915 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625ac43-0625-4547-9b2e-d0801488708d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:53.341202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625ac43-0625-4547-9b2e-d0801488708d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:53.341479 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625ac43-0625-4547-9b2e-d0801488708d None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:53.342646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625ac43-0625-4547-9b2e-d0801488708d None admin] RBAC: Authorizing `identity:get_project(project_id=3747706d68904890975b5253c7f2b3a9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:53.344658 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625ac43-0625-4547-9b2e-d0801488708d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:53.345320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:53.350176 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2690c-56dc-43d6-9489-7949a4b68eb7 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:53.352834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 208/415] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:53 2022] GET /identity/v3/projects/3747706d68904890975b5253c7f2b3a9 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:53.354092 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625ac43-0625-4547-9b2e-d0801488708d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:53.392821 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42e40b-064d-4333-b14c-b686f8ee1388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:53.393473 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42e40b-064d-4333-b14c-b686f8ee1388 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:53.394488 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42e40b-064d-4333-b14c-b686f8ee1388 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:53.394734 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42e40b-064d-4333-b14c-b686f8ee1388 None admin] PATH_INFO: `/v3/projects/7ee435a1a9d946639c722d848ce39bd1/groups/28ddfb31e6d24f76a6b5f00770815764/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:53.396708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42e40b-064d-4333-b14c-b686f8ee1388 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ee435a1a9d946639c722d848ce39bd1, group_id=28ddfb31e6d24f76a6b5f00770815764, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:53.398285 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42e40b-064d-4333-b14c-b686f8ee1388 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:53.473818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625ac43-0625-4547-9b2e-d0801488708d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:53.509369 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fb31e-cb68-43cf-8f7d-77241bdfab2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:53.510015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fb31e-cb68-43cf-8f7d-77241bdfab2d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:53.510300 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fb31e-cb68-43cf-8f7d-77241bdfab2d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:53.510566 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fb31e-cb68-43cf-8f7d-77241bdfab2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:53.522568 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 208/416] 10.222.0.75 () {58 vars in 1442 bytes} [Thu Jul 28 17:44:53 2022] PUT /identity/v3/projects/7ee435a1a9d946639c722d848ce39bd1/groups/28ddfb31e6d24f76a6b5f00770815764/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:44:53.522568 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42e40b-064d-4333-b14c-b686f8ee1388 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:53.529798 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fb31e-cb68-43cf-8f7d-77241bdfab2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:53.542195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-9f0fb31e-cb68-43cf-8f7d-77241bdfab2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:53.542195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:53.542195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:53.542195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:53.542195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:53.542195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:53.542195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:53.542195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:53.542195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:53.542195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:53.542195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:53.542195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:53.542195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:53.542195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:53.542195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:53.542195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:53.543189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:53.543189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:53.543189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:53.543189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:53.543189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:53.543189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:53.543189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:53.543189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:53.543189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:53.543189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:53.543189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:53.543189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:53.543189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:53.543189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:53.543189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:53.543189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:53.544462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:53.544462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:53.544462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:53.544462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:53.544462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:53.544462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:53.544462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:53.544462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:53.544462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:53.544462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:53.544462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:53.544462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:53.544462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 209/417] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:53.551829 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fb31e-cb68-43cf-8f7d-77241bdfab2d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:53.601222 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:53.741149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42e40b-064d-4333-b14c-b686f8ee1388 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:53.758797 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fb31e-cb68-43cf-8f7d-77241bdfab2d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:53.786420 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ed4fe-e73d-4e78-acac-3f2bc84c5de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:53.787540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ed4fe-e73d-4e78-acac-3f2bc84c5de1 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:53.787827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ed4fe-e73d-4e78-acac-3f2bc84c5de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:53.788108 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ed4fe-e73d-4e78-acac-3f2bc84c5de1 None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9/groups/24f7eaf311534a6595a927d1ceb82370/roles/e2024b6eae3d49f09caa7d4275eb88bc` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:53.791257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ed4fe-e73d-4e78-acac-3f2bc84c5de1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3747706d68904890975b5253c7f2b3a9, group_id=24f7eaf311534a6595a927d1ceb82370, role_id=e2024b6eae3d49f09caa7d4275eb88bc)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:53.793784 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ed4fe-e73d-4e78-acac-3f2bc84c5de1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:53.800119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1639bd-2814-4d1d-8721-01a63ca48035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:53.801297 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1639bd-2814-4d1d-8721-01a63ca48035 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:53.802360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1639bd-2814-4d1d-8721-01a63ca48035 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:53.802864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1639bd-2814-4d1d-8721-01a63ca48035 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:53.803784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1639bd-2814-4d1d-8721-01a63ca48035 None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:53.804237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1639bd-2814-4d1d-8721-01a63ca48035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:53.807292 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1639bd-2814-4d1d-8721-01a63ca48035 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:53.815766 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 210/418] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:53.817329 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b63a6b-a02f-4ad6-b86a-fd6c08c4ae15 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:53.817741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b63a6b-a02f-4ad6-b86a-fd6c08c4ae15 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:53.818189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b63a6b-a02f-4ad6-b86a-fd6c08c4ae15 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:53.819954 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 211/419] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:53.821876 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b63a6b-a02f-4ad6-b86a-fd6c08c4ae15 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:53.907904 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 209/420] 10.222.0.75 () {58 vars in 1442 bytes} [Thu Jul 28 17:44:53 2022] PUT /identity/v3/projects/3747706d68904890975b5253c7f2b3a9/groups/24f7eaf311534a6595a927d1ceb82370/roles/e2024b6eae3d49f09caa7d4275eb88bc => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:44:53.916965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f967cbb-9de6-4f48-98e9-dd5f2be3528d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:53.916965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f967cbb-9de6-4f48-98e9-dd5f2be3528d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:53.916965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f967cbb-9de6-4f48-98e9-dd5f2be3528d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:53.932084 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:53.954418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6f967cbb-9de6-4f48-98e9-dd5f2be3528d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:53.955683 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6f967cbb-9de6-4f48-98e9-dd5f2be3528d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:53.977486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b63a6b-a02f-4ad6-b86a-fd6c08c4ae15 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:53.994681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:54.061518 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5af88a-90c4-4aba-bb58-0b198628d959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:54.062168 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5af88a-90c4-4aba-bb58-0b198628d959 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:54.062456 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5af88a-90c4-4aba-bb58-0b198628d959 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:54.062738 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5af88a-90c4-4aba-bb58-0b198628d959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:54.080293 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 210/421] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:54.124194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f967cbb-9de6-4f48-98e9-dd5f2be3528d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:54.171765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5af88a-90c4-4aba-bb58-0b198628d959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:54.174190 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5af88a-90c4-4aba-bb58-0b198628d959 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:54.304636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:54.329338 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 212/422] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:44:54.331211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5af88a-90c4-4aba-bb58-0b198628d959 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:54.366717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f967cbb-9de6-4f48-98e9-dd5f2be3528d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:54.422335 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b641d4-6e64-4abc-8ab8-7cdc251adcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:54.423711 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b641d4-6e64-4abc-8ab8-7cdc251adcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:54.424297 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b641d4-6e64-4abc-8ab8-7cdc251adcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:54.425302 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b641d4-6e64-4abc-8ab8-7cdc251adcf8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:54.438881 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b641d4-6e64-4abc-8ab8-7cdc251adcf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:54.446493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-a5b641d4-6e64-4abc-8ab8-7cdc251adcf8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:54.446493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:54.446493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:54.446493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:54.446493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:54.446493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:54.446493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:54.446493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:54.446493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:54.446493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:54.446493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:54.446493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:54.446493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:54.446493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:54.446493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:54.446493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:54.447442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:54.447442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:54.447442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:54.447442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:54.447442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:54.447442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:54.447442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:54.447442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:54.447442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:54.447442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:54.447442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:54.447442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:54.447442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:54.447442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:54.447442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:54.447442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:54.448320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:54.448320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:54.448320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:54.448320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:54.448320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:54.448320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:54.448320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:54.448320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:54.448320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:54.448320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:54.448320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:54.448320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:54.450519 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 211/423] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:44:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:44:54.451558 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73e77d-f7fa-435e-85d5-66663b42b034 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:54.451846 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73e77d-f7fa-435e-85d5-66663b42b034 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:54.452125 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73e77d-f7fa-435e-85d5-66663b42b034 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:54.455148 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 212/424] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:54.456039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73e77d-f7fa-435e-85d5-66663b42b034 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:54.470421 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:54.479473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5af88a-90c4-4aba-bb58-0b198628d959 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:54.525968 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b104a7f-79cd-43f7-bf00-04d874ab8551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:54.527177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b104a7f-79cd-43f7-bf00-04d874ab8551 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:54.527860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b104a7f-79cd-43f7-bf00-04d874ab8551 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:54.528331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b104a7f-79cd-43f7-bf00-04d874ab8551 None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:54.530259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b104a7f-79cd-43f7-bf00-04d874ab8551 None admin] RBAC: Authorizing `identity:get_project(project_id=005e84bc135b44f088d0ad047d11daf7)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:54.532140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b104a7f-79cd-43f7-bf00-04d874ab8551 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:54.540941 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 213/425] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:54 2022] GET /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:54.542190 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0cd01-2484-4578-a687-a863ee269c5b None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:54.542486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0cd01-2484-4578-a687-a863ee269c5b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:54.542751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0cd01-2484-4578-a687-a863ee269c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:54.561539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-90e0cd01-2484-4578-a687-a863ee269c5b None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:54.562679 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-90e0cd01-2484-4578-a687-a863ee269c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:54.583953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73e77d-f7fa-435e-85d5-66663b42b034 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:54.612172 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:54.630892 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7cb4f-8a8a-4375-b11b-a06fec34b8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:54.631762 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7cb4f-8a8a-4375-b11b-a06fec34b8eb None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:54.632223 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7cb4f-8a8a-4375-b11b-a06fec34b8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:54.632586 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7cb4f-8a8a-4375-b11b-a06fec34b8eb None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:54.633431 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7cb4f-8a8a-4375-b11b-a06fec34b8eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:54.633848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7cb4f-8a8a-4375-b11b-a06fec34b8eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:54.634133 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 214/426] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:54.635115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0cd01-2484-4578-a687-a863ee269c5b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:54.635821 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7cb4f-8a8a-4375-b11b-a06fec34b8eb None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:54.646334 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 213/427] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:44:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:54.651810 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7cb4f-8a8a-4375-b11b-a06fec34b8eb None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:54.750649 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:54.759745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0cd01-2484-4578-a687-a863ee269c5b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:54.783702 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7cb4f-8a8a-4375-b11b-a06fec34b8eb None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:54.798990 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8248a-c727-439f-94fa-0b2b9bcdc658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:54.799659 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8248a-c727-439f-94fa-0b2b9bcdc658 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:54.799980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8248a-c727-439f-94fa-0b2b9bcdc658 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:54.800256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8248a-c727-439f-94fa-0b2b9bcdc658 None admin] PATH_INFO: `/v3/groups/24f7eaf311534a6595a927d1ceb82370` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:54.801540 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8248a-c727-439f-94fa-0b2b9bcdc658 None admin] RBAC: Authorizing `identity:get_group(group_id=24f7eaf311534a6595a927d1ceb82370)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:54.803081 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8248a-c727-439f-94fa-0b2b9bcdc658 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:54.804813 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 215/428] 10.222.0.75 () {56 vars in 1180 bytes} [Thu Jul 28 17:44:54 2022] GET /identity/v3/groups/24f7eaf311534a6595a927d1ceb82370 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:54.812049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8248a-c727-439f-94fa-0b2b9bcdc658 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:54.829684 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fd0e4-a720-49fa-bb30-71085d2ea98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:54.830955 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fd0e4-a720-49fa-bb30-71085d2ea98f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:54.831968 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fd0e4-a720-49fa-bb30-71085d2ea98f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:54.832736 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fd0e4-a720-49fa-bb30-71085d2ea98f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:54.867999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:54.923745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8248a-c727-439f-94fa-0b2b9bcdc658 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:54.929303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2fd0e4-a720-49fa-bb30-71085d2ea98f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:54.931432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2fd0e4-a720-49fa-bb30-71085d2ea98f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:54.966029 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cd7b0-6649-472e-9a88-b5f1b7e6c61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:54.967026 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cd7b0-6649-472e-9a88-b5f1b7e6c61e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:54.967427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cd7b0-6649-472e-9a88-b5f1b7e6c61e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:54.967720 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cd7b0-6649-472e-9a88-b5f1b7e6c61e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:54.982848 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cd7b0-6649-472e-9a88-b5f1b7e6c61e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:54.990201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-f76cd7b0-6649-472e-9a88-b5f1b7e6c61e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:54.990201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:54.990201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:54.990201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:54.990201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:54.990201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:54.990201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:54.990201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:54.990201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:54.990201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:54.990201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:54.990201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:54.990201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:54.990201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:54.990201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:54.990201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:54.991060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:54.991060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:54.991060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:54.991060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:54.991060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:54.991060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:54.991060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:54.991060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:54.991060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:54.991060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:54.991060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:54.991060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:54.991060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:54.991060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:54.991060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:54.991060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:54.991844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:54.991844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:54.991844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:54.991844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:54.991844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:54.991844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:54.991844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:54.991844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:54.991844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:54.991844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:54.991844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:44:54.991844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:54.991844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 216/429] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:54.992481 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cd7b0-6649-472e-9a88-b5f1b7e6c61e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:55.023700 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:55.071262 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 214/430] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:44:55.072601 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fd0e4-a720-49fa-bb30-71085d2ea98f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:55.136180 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cd7b0-6649-472e-9a88-b5f1b7e6c61e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:55.147918 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:55.175716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70b4cd-cd50-4647-9034-d2328a356d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:55.176345 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70b4cd-cd50-4647-9034-d2328a356d93 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:55.176636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70b4cd-cd50-4647-9034-d2328a356d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:55.177098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70b4cd-cd50-4647-9034-d2328a356d93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:55.177910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70b4cd-cd50-4647-9034-d2328a356d93 None admin] RBAC: Adding query filter params (group.id=24f7eaf311534a6595a927d1ceb82370, role.id=279c255613df457cb2d5d9904dd6f12a, scope.project.id=005e84bc135b44f088d0ad047d11daf7) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:55.178438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70b4cd-cd50-4647-9034-d2328a356d93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:55.179792 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70b4cd-cd50-4647-9034-d2328a356d93 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:55.186084 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 217/431] 10.222.0.75 () {56 vars in 1376 bytes} [Thu Jul 28 17:44:54 2022] GET /identity/v3/role_assignments?group.id=24f7eaf311534a6595a927d1ceb82370&scope.project.id=005e84bc135b44f088d0ad047d11daf7&role.id=279c255613df457cb2d5d9904dd6f12a => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:55.186887 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70b4cd-cd50-4647-9034-d2328a356d93 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:55.212332 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fd0e4-a720-49fa-bb30-71085d2ea98f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:55.276253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0b932-8ec1-4888-ae43-4b86b0e8cf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:55.279149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0b932-8ec1-4888-ae43-4b86b0e8cf3c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:55.279474 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0b932-8ec1-4888-ae43-4b86b0e8cf3c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:55.279750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0b932-8ec1-4888-ae43-4b86b0e8cf3c None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:55.280573 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0b932-8ec1-4888-ae43-4b86b0e8cf3c None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:55.280913 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0b932-8ec1-4888-ae43-4b86b0e8cf3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:55.282337 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0b932-8ec1-4888-ae43-4b86b0e8cf3c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:55.303809 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 215/432] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:44:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:55.309661 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0b932-8ec1-4888-ae43-4b86b0e8cf3c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:55.353965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70b4cd-cd50-4647-9034-d2328a356d93 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:55.384911 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:55.423163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72377fdf-8c1b-434a-b760-f0fb4d2f6266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:55.423830 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72377fdf-8c1b-434a-b760-f0fb4d2f6266 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:55.424169 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72377fdf-8c1b-434a-b760-f0fb4d2f6266 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:55.424450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72377fdf-8c1b-434a-b760-f0fb4d2f6266 None admin] PATH_INFO: `/v3/projects/005e84bc135b44f088d0ad047d11daf7` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:55.426982 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72377fdf-8c1b-434a-b760-f0fb4d2f6266 None admin] RBAC: Authorizing `identity:get_project(project_id=005e84bc135b44f088d0ad047d11daf7)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:55.428453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72377fdf-8c1b-434a-b760-f0fb4d2f6266 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:55.431728 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 218/433] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:55 2022] GET /identity/v3/projects/005e84bc135b44f088d0ad047d11daf7 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:55.436884 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72377fdf-8c1b-434a-b760-f0fb4d2f6266 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:55.485883 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0b932-8ec1-4888-ae43-4b86b0e8cf3c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:55.493849 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:55.534961 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78062aa4-c708-4c25-9dce-70198f743139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:55.536376 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78062aa4-c708-4c25-9dce-70198f743139 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:55.536881 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78062aa4-c708-4c25-9dce-70198f743139 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:55.537694 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78062aa4-c708-4c25-9dce-70198f743139 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:55.568610 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72377fdf-8c1b-434a-b760-f0fb4d2f6266 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:55.625659 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78062aa4-c708-4c25-9dce-70198f743139 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:55.628415 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78062aa4-c708-4c25-9dce-70198f743139 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:55.632553 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc3179-9990-42ed-a7ec-6c30ba4533bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:55.633242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc3179-9990-42ed-a7ec-6c30ba4533bf None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:55.633522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc3179-9990-42ed-a7ec-6c30ba4533bf None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:55.633801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc3179-9990-42ed-a7ec-6c30ba4533bf None admin] PATH_INFO: `/v3/groups/24f7eaf311534a6595a927d1ceb82370` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:55.636929 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc3179-9990-42ed-a7ec-6c30ba4533bf None admin] RBAC: Authorizing `identity:get_group(group_id=24f7eaf311534a6595a927d1ceb82370)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:55.638438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc3179-9990-42ed-a7ec-6c30ba4533bf None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:55.640393 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 219/434] 10.222.0.75 () {56 vars in 1180 bytes} [Thu Jul 28 17:44:55 2022] GET /identity/v3/groups/24f7eaf311534a6595a927d1ceb82370 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:55.649069 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc3179-9990-42ed-a7ec-6c30ba4533bf None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:55.693968 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:55.796814 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 216/435] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:55.797455 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc3179-9990-42ed-a7ec-6c30ba4533bf None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:55.802893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78062aa4-c708-4c25-9dce-70198f743139 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:55.813779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:55.856092 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bd9d5-2af9-4817-95f8-ad62e5338bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:55.857012 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bd9d5-2af9-4817-95f8-ad62e5338bba None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:55.857402 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bd9d5-2af9-4817-95f8-ad62e5338bba None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:55.857781 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bd9d5-2af9-4817-95f8-ad62e5338bba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:55.858891 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bd9d5-2af9-4817-95f8-ad62e5338bba None admin] RBAC: Adding query filter params (group.id=24f7eaf311534a6595a927d1ceb82370, role.id=e2024b6eae3d49f09caa7d4275eb88bc, scope.project.id=005e84bc135b44f088d0ad047d11daf7) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:55.859108 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bd9d5-2af9-4817-95f8-ad62e5338bba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:55.860722 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bd9d5-2af9-4817-95f8-ad62e5338bba None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:55.868157 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 220/436] 10.222.0.75 () {56 vars in 1376 bytes} [Thu Jul 28 17:44:55 2022] GET /identity/v3/role_assignments?group.id=24f7eaf311534a6595a927d1ceb82370&scope.project.id=005e84bc135b44f088d0ad047d11daf7&role.id=e2024b6eae3d49f09caa7d4275eb88bc => generated 611 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:55.869666 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca6193-6975-4d8a-ae7f-437ff27901da None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:55.871743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca6193-6975-4d8a-ae7f-437ff27901da None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:55.871743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca6193-6975-4d8a-ae7f-437ff27901da None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:55.871938 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 221/437] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:55.878860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b0628-ec1b-49e8-b0a4-da1899bb7bee None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:55.879057 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b0628-ec1b-49e8-b0a4-da1899bb7bee None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:55.879326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b0628-ec1b-49e8-b0a4-da1899bb7bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:55.901893 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-7f6b0628-ec1b-49e8-b0a4-da1899bb7bee None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:55.903245 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7f6b0628-ec1b-49e8-b0a4-da1899bb7bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:55.967318 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78062aa4-c708-4c25-9dce-70198f743139 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:56.003431 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:56.009375 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92b782-b9fa-441c-b038-762ba6582cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:56.010438 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92b782-b9fa-441c-b038-762ba6582cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:56.010925 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92b782-b9fa-441c-b038-762ba6582cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:56.011427 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92b782-b9fa-441c-b038-762ba6582cc9 None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:56.013233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92b782-b9fa-441c-b038-762ba6582cc9 None admin] RBAC: Authorizing `identity:get_project(project_id=3747706d68904890975b5253c7f2b3a9)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:56.015042 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92b782-b9fa-441c-b038-762ba6582cc9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:56.021515 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 217/439] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:55 2022] GET /identity/v3/projects/3747706d68904890975b5253c7f2b3a9 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:56.024834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 222/439] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:56.028133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92b782-b9fa-441c-b038-762ba6582cc9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:56.047622 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b0628-ec1b-49e8-b0a4-da1899bb7bee None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:56.169446 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92b782-b9fa-441c-b038-762ba6582cc9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:56.185911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b0628-ec1b-49e8-b0a4-da1899bb7bee None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:56.188462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:56.214420 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd4461-ce83-486f-a024-d07582498d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:56.218282 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd4461-ce83-486f-a024-d07582498d0b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:56.218282 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd4461-ce83-486f-a024-d07582498d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:56.218282 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd4461-ce83-486f-a024-d07582498d0b None admin] PATH_INFO: `/v3/groups/24f7eaf311534a6595a927d1ceb82370` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:56.218282 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd4461-ce83-486f-a024-d07582498d0b None admin] RBAC: Authorizing `identity:get_group(group_id=24f7eaf311534a6595a927d1ceb82370)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:56.222294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd4461-ce83-486f-a024-d07582498d0b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:56.226172 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 218/440] 10.222.0.75 () {56 vars in 1180 bytes} [Thu Jul 28 17:44:56 2022] GET /identity/v3/groups/24f7eaf311534a6595a927d1ceb82370 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:56.226297 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e959dc-9301-4601-a5a4-e1f0eeb32236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:56.226390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e959dc-9301-4601-a5a4-e1f0eeb32236 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:56.227522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e959dc-9301-4601-a5a4-e1f0eeb32236 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:56.227522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e959dc-9301-4601-a5a4-e1f0eeb32236 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:56.227729 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117b951-4cb9-456e-b9d4-0ff7eac6d973 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:56.227729 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117b951-4cb9-456e-b9d4-0ff7eac6d973 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:56.227874 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117b951-4cb9-456e-b9d4-0ff7eac6d973 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:56.232852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 219/441] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:56.234425 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117b951-4cb9-456e-b9d4-0ff7eac6d973 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:56.243089 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e959dc-9301-4601-a5a4-e1f0eeb32236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:56.248151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-f1e959dc-9301-4601-a5a4-e1f0eeb32236 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:56.248151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:56.248151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:56.248151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:56.248151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:56.248151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:56.248151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:56.248151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:56.248151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:56.248151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:56.248151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:56.248151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:56.248151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:56.248151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:56.248151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:56.248151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:56.249776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:56.249776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:56.249776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:56.249776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:56.249776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:56.249776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:56.249776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:56.249776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:56.249776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:56.249776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:56.249776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:56.249776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:56.249776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:56.249776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:56.249776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:56.249776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:56.250569 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:56.250569 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:56.250569 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:56.250569 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:56.250569 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:56.250569 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:56.250569 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:56.250569 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:56.250569 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:56.250569 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:56.250569 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:56.250569 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:44:56.250569 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 223/442] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:44:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:56.250569 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0f88a-37c9-4bdc-96dc-17d6b74594df None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:56.251286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0f88a-37c9-4bdc-96dc-17d6b74594df None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:56.251286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0f88a-37c9-4bdc-96dc-17d6b74594df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:56.283317 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-ada0f88a-37c9-4bdc-96dc-17d6b74594df None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:56.283317 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ada0f88a-37c9-4bdc-96dc-17d6b74594df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:56.347464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:56.369939 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 224/443] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:44:56.371510 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0f88a-37c9-4bdc-96dc-17d6b74594df None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:56.401830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117b951-4cb9-456e-b9d4-0ff7eac6d973 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:56.439877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597477a-4a74-4890-ad31-82907b8e6325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:56.440443 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597477a-4a74-4890-ad31-82907b8e6325 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:56.440722 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597477a-4a74-4890-ad31-82907b8e6325 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:56.441025 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597477a-4a74-4890-ad31-82907b8e6325 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:56.441814 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597477a-4a74-4890-ad31-82907b8e6325 None admin] RBAC: Adding query filter params (group.id=24f7eaf311534a6595a927d1ceb82370, role.id=279c255613df457cb2d5d9904dd6f12a, scope.project.id=3747706d68904890975b5253c7f2b3a9) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:56.442120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597477a-4a74-4890-ad31-82907b8e6325 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:56.443542 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597477a-4a74-4890-ad31-82907b8e6325 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:56.449600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 220/444] 10.222.0.75 () {56 vars in 1376 bytes} [Thu Jul 28 17:44:56 2022] GET /identity/v3/role_assignments?group.id=24f7eaf311534a6595a927d1ceb82370&scope.project.id=3747706d68904890975b5253c7f2b3a9&role.id=279c255613df457cb2d5d9904dd6f12a => generated 611 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:56.450274 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597477a-4a74-4890-ad31-82907b8e6325 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:56.490727 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:56.498241 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0f88a-37c9-4bdc-96dc-17d6b74594df None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:56.538742 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3fc67-e263-4de0-b6f0-f5acd51c4537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:56.539372 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3fc67-e263-4de0-b6f0-f5acd51c4537 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:56.539655 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3fc67-e263-4de0-b6f0-f5acd51c4537 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:56.539930 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3fc67-e263-4de0-b6f0-f5acd51c4537 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:56.540660 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3fc67-e263-4de0-b6f0-f5acd51c4537 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:56.540992 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3fc67-e263-4de0-b6f0-f5acd51c4537 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:56.542419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3fc67-e263-4de0-b6f0-f5acd51c4537 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:56.552604 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 225/445] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:56.558147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3fc67-e263-4de0-b6f0-f5acd51c4537 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:56.570421 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597477a-4a74-4890-ad31-82907b8e6325 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:56.605557 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:56.613184 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300302d-fb9c-4727-8e02-1e34084a63d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:56.614117 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300302d-fb9c-4727-8e02-1e34084a63d5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:56.614117 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300302d-fb9c-4727-8e02-1e34084a63d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:56.614401 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300302d-fb9c-4727-8e02-1e34084a63d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:56.628806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300302d-fb9c-4727-8e02-1e34084a63d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:56.634002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-3300302d-fb9c-4727-8e02-1e34084a63d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:56.634002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:56.634002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:56.634002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:56.634002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:56.634002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:56.634002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:56.634002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:56.634002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:56.634002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:56.634002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:56.634002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:56.634002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:56.634002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:56.634002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:56.634002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:56.637819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:56.637819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:56.637819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:56.637819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:56.637819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:56.637819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:56.637819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:56.637819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:56.637819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:56.637819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:56.637819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:56.637819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:56.637819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:56.637819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:56.637819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:56.637819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:56.638596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:56.638596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:56.638596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:56.638596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:56.638596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:56.638596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:56.638596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:56.638596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:56.638596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:56.638596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:56.638596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:44:56.638596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:44:56.638596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 221/446] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:44:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:56.641500 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300302d-fb9c-4727-8e02-1e34084a63d5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:56.684478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3fc67-e263-4de0-b6f0-f5acd51c4537 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:56.720633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bcd8c-886d-4232-a2f7-cb323b6a3932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:56.721304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bcd8c-886d-4232-a2f7-cb323b6a3932 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:56.722145 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bcd8c-886d-4232-a2f7-cb323b6a3932 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:56.722423 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bcd8c-886d-4232-a2f7-cb323b6a3932 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:56.751245 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:56.769682 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300302d-fb9c-4727-8e02-1e34084a63d5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:56.805858 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bcd8c-886d-4232-a2f7-cb323b6a3932 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:56.808007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d50764-7052-4d2a-9956-38997604d305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:56.808007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d50764-7052-4d2a-9956-38997604d305 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:56.808192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bcd8c-886d-4232-a2f7-cb323b6a3932 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:56.808285 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d50764-7052-4d2a-9956-38997604d305 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:56.808285 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d50764-7052-4d2a-9956-38997604d305 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:56.810082 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d50764-7052-4d2a-9956-38997604d305 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:56.810082 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d50764-7052-4d2a-9956-38997604d305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:56.810350 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d50764-7052-4d2a-9956-38997604d305 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:56.819386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 222/447] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:44:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:56.824925 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d50764-7052-4d2a-9956-38997604d305 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:56.881829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:56.909672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 226/448] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:44:56.915020 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bcd8c-886d-4232-a2f7-cb323b6a3932 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:56.925475 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d50764-7052-4d2a-9956-38997604d305 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:56.960620 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec4cd6-ac72-482f-a610-862a003c8e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:56.961271 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec4cd6-ac72-482f-a610-862a003c8e3b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:56.961551 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec4cd6-ac72-482f-a610-862a003c8e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:56.961825 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec4cd6-ac72-482f-a610-862a003c8e3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:56.969942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:57.011921 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bcd8c-886d-4232-a2f7-cb323b6a3932 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:57.030191 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec4cd6-ac72-482f-a610-862a003c8e3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:57.031669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec4cd6-ac72-482f-a610-862a003c8e3b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:57.048504 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbbfff-2022-4af5-bced-67ed6bdfffe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:57.049206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbbfff-2022-4af5-bced-67ed6bdfffe9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:57.049494 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbbfff-2022-4af5-bced-67ed6bdfffe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:57.049771 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbbfff-2022-4af5-bced-67ed6bdfffe9 None admin] PATH_INFO: `/v3/projects/7ee435a1a9d946639c722d848ce39bd1` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:57.050939 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbbfff-2022-4af5-bced-67ed6bdfffe9 None admin] RBAC: Authorizing `identity:get_project(project_id=7ee435a1a9d946639c722d848ce39bd1)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:57.052411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbbfff-2022-4af5-bced-67ed6bdfffe9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:57.054129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 227/449] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:56 2022] GET /identity/v3/projects/7ee435a1a9d946639c722d848ce39bd1 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:57.059539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbbfff-2022-4af5-bced-67ed6bdfffe9 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:57.086371 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:57.129664 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 223/450] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:44:57.135244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec4cd6-ac72-482f-a610-862a003c8e3b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:57.160447 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbbfff-2022-4af5-bced-67ed6bdfffe9 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:57.183594 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:57.194686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce648e0-700f-492e-8af4-0a601800ff07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:57.195323 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce648e0-700f-492e-8af4-0a601800ff07 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:57.195609 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce648e0-700f-492e-8af4-0a601800ff07 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:57.198354 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce648e0-700f-492e-8af4-0a601800ff07 None admin] PATH_INFO: `/v3/groups/28ddfb31e6d24f76a6b5f00770815764` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:57.198354 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce648e0-700f-492e-8af4-0a601800ff07 None admin] RBAC: Authorizing `identity:get_group(group_id=28ddfb31e6d24f76a6b5f00770815764)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:57.198757 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce648e0-700f-492e-8af4-0a601800ff07 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:57.200339 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 228/451] 10.222.0.75 () {56 vars in 1180 bytes} [Thu Jul 28 17:44:57 2022] GET /identity/v3/groups/28ddfb31e6d24f76a6b5f00770815764 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:57.206770 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce648e0-700f-492e-8af4-0a601800ff07 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:57.233612 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec4cd6-ac72-482f-a610-862a003c8e3b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:57.267808 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74193beb-dde5-4087-b84e-b71c87036ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:57.268415 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74193beb-dde5-4087-b84e-b71c87036ade None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:57.268698 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74193beb-dde5-4087-b84e-b71c87036ade None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:57.269002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74193beb-dde5-4087-b84e-b71c87036ade None admin] PATH_INFO: `/v3/projects/3747706d68904890975b5253c7f2b3a9` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:57.270165 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74193beb-dde5-4087-b84e-b71c87036ade None admin] RBAC: Authorizing `identity:get_project(project_id=3747706d68904890975b5253c7f2b3a9)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:57.271605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74193beb-dde5-4087-b84e-b71c87036ade None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:57.273449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 224/452] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:57 2022] GET /identity/v3/projects/3747706d68904890975b5253c7f2b3a9 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:57.279132 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74193beb-dde5-4087-b84e-b71c87036ade None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:57.302826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:57.306977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce648e0-700f-492e-8af4-0a601800ff07 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:57.347018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abac42-f52d-45eb-99bc-247ac3d965f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:57.347642 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abac42-f52d-45eb-99bc-247ac3d965f0 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:57.347924 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abac42-f52d-45eb-99bc-247ac3d965f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:57.348194 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abac42-f52d-45eb-99bc-247ac3d965f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:57.349012 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abac42-f52d-45eb-99bc-247ac3d965f0 None admin] RBAC: Adding query filter params (group.id=28ddfb31e6d24f76a6b5f00770815764, role.id=d371062e071845ffa4570a76d40dff88, scope.project.id=7ee435a1a9d946639c722d848ce39bd1) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:57.349321 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abac42-f52d-45eb-99bc-247ac3d965f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:57.350759 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abac42-f52d-45eb-99bc-247ac3d965f0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:57.356601 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 229/453] 10.222.0.75 () {56 vars in 1376 bytes} [Thu Jul 28 17:44:57 2022] GET /identity/v3/role_assignments?group.id=28ddfb31e6d24f76a6b5f00770815764&scope.project.id=7ee435a1a9d946639c722d848ce39bd1&role.id=d371062e071845ffa4570a76d40dff88 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:57.388882 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74193beb-dde5-4087-b84e-b71c87036ade None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:57.426276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bb548-514d-4771-ba68-a5448e17981f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:57.426960 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bb548-514d-4771-ba68-a5448e17981f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:57.427241 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bb548-514d-4771-ba68-a5448e17981f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:57.427515 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bb548-514d-4771-ba68-a5448e17981f None admin] PATH_INFO: `/v3/groups/24f7eaf311534a6595a927d1ceb82370` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:57.428829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290bb548-514d-4771-ba68-a5448e17981f None admin] RBAC: Authorizing `identity:get_group(group_id=24f7eaf311534a6595a927d1ceb82370)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:57.430298 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290bb548-514d-4771-ba68-a5448e17981f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:57.431967 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 225/454] 10.222.0.75 () {56 vars in 1180 bytes} [Thu Jul 28 17:44:57 2022] GET /identity/v3/groups/24f7eaf311534a6595a927d1ceb82370 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:57.438105 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abac42-f52d-45eb-99bc-247ac3d965f0 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:57.497312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:57.542311 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abac42-f52d-45eb-99bc-247ac3d965f0 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:57.576540 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c24247-d6ff-433b-a4dc-b6fd2ac0fbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:57.577184 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c24247-d6ff-433b-a4dc-b6fd2ac0fbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:57.577467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c24247-d6ff-433b-a4dc-b6fd2ac0fbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:57.577738 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c24247-d6ff-433b-a4dc-b6fd2ac0fbe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:57.578525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c24247-d6ff-433b-a4dc-b6fd2ac0fbe0 None admin] RBAC: Adding query filter params (group.id=24f7eaf311534a6595a927d1ceb82370, role.id=e2024b6eae3d49f09caa7d4275eb88bc, scope.project.id=3747706d68904890975b5253c7f2b3a9) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:57.578834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c24247-d6ff-433b-a4dc-b6fd2ac0fbe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:57.580284 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c24247-d6ff-433b-a4dc-b6fd2ac0fbe0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:57.586031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 230/455] 10.222.0.75 () {56 vars in 1376 bytes} [Thu Jul 28 17:44:57 2022] GET /identity/v3/role_assignments?group.id=24f7eaf311534a6595a927d1ceb82370&scope.project.id=3747706d68904890975b5253c7f2b3a9&role.id=e2024b6eae3d49f09caa7d4275eb88bc => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:00.152413 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2e36b-b53b-4d60-ac16-5dc87b0fe340 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:00.152976 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2e36b-b53b-4d60-ac16-5dc87b0fe340 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:00.152976 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2e36b-b53b-4d60-ac16-5dc87b0fe340 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:00.154566 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 226/456] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:00.160049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac743a-5fed-4116-867d-ffd66e0122b6 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:00.160435 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac743a-5fed-4116-867d-ffd66e0122b6 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:00.160611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac743a-5fed-4116-867d-ffd66e0122b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:00.188765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-a8ac743a-5fed-4116-867d-ffd66e0122b6 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:00.190021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a8ac743a-5fed-4116-867d-ffd66e0122b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:00.286942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 231/457] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:00.319698 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2e36b-b53b-4d60-ac16-5dc87b0fe340 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:00.400167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895c946-5fa1-4296-a2be-c8dcc7dc26dd None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:00.400770 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895c946-5fa1-4296-a2be-c8dcc7dc26dd None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:00.401107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895c946-5fa1-4296-a2be-c8dcc7dc26dd None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:00.402755 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 232/458] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:00.411089 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbee06-7e6a-41ed-a625-0d0fc3656987 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:00.411656 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbee06-7e6a-41ed-a625-0d0fc3656987 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:00.412130 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbee06-7e6a-41ed-a625-0d0fc3656987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:00.437209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:00.447623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-a2dbee06-7e6a-41ed-a625-0d0fc3656987 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:00.449133 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a2dbee06-7e6a-41ed-a625-0d0fc3656987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:00.452089 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2e36b-b53b-4d60-ac16-5dc87b0fe340 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:00.499196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8b3b8-e186-4ebb-8deb-eb99e7a3aab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:00.501162 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8b3b8-e186-4ebb-8deb-eb99e7a3aab4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:00.501653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8b3b8-e186-4ebb-8deb-eb99e7a3aab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:00.502126 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8b3b8-e186-4ebb-8deb-eb99e7a3aab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:00.512163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:00.518390 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8b3b8-e186-4ebb-8deb-eb99e7a3aab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:00.520844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8b3b8-e186-4ebb-8deb-eb99e7a3aab4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:00.539932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-c7c8b3b8-e186-4ebb-8deb-eb99e7a3aab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:00.539932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:00.539932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:00.539932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:00.539932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:00.539932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:00.539932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:00.539932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:00.539932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:00.539932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:00.539932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:00.539932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:00.539932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:00.539932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:00.539932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:00.540853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:00.540853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:00.540853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:00.540853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:00.540853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:00.540853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:00.540853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:00.540853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:00.540853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:00.540853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:00.540853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:00.540853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:00.540853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:00.540853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:00.540853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:00.540853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:00.540853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:00.541679 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:00.541679 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:00.541679 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:00.541679 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:00.541920 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 233/459] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:00.542313 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95349c67-a516-4918-8a48-cf8ddce9321e None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:00.542550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95349c67-a516-4918-8a48-cf8ddce9321e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:00.542829 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95349c67-a516-4918-8a48-cf8ddce9321e None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:00.544224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 227/460] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:00.544454 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 234/461] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:00.550321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8b3b8-e186-4ebb-8deb-eb99e7a3aab4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:00.566690 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a30be0-825b-4056-a022-bfd843a87e85 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:00.567024 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a30be0-825b-4056-a022-bfd843a87e85 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:00.567304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a30be0-825b-4056-a022-bfd843a87e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:00.589320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d2a30be0-825b-4056-a022-bfd843a87e85 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:00.590598 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d2a30be0-825b-4056-a022-bfd843a87e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:00.664570 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8b3b8-e186-4ebb-8deb-eb99e7a3aab4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:00.692856 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 235/462] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:45:00.694028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a30be0-825b-4056-a022-bfd843a87e85 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:00.721052 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e85fa6-100e-420a-a2cf-e1d0971fe4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:00.722368 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e85fa6-100e-420a-a2cf-e1d0971fe4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:00.722652 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e85fa6-100e-420a-a2cf-e1d0971fe4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:00.723219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e85fa6-100e-420a-a2cf-e1d0971fe4c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:00.723611 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e85fa6-100e-420a-a2cf-e1d0971fe4c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:00.723917 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e85fa6-100e-420a-a2cf-e1d0971fe4c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:00.725338 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e85fa6-100e-420a-a2cf-e1d0971fe4c3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:00.739070 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 228/463] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:00.739909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e85fa6-100e-420a-a2cf-e1d0971fe4c3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:00.747241 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:00.830940 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a30be0-825b-4056-a022-bfd843a87e85 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:00.842532 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:00.866373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e85fa6-100e-420a-a2cf-e1d0971fe4c3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:00.867591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78746ac2-f986-48ac-b674-ec4bfbbd5d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:00.868240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78746ac2-f986-48ac-b674-ec4bfbbd5d45 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:00.868518 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78746ac2-f986-48ac-b674-ec4bfbbd5d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:00.868904 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78746ac2-f986-48ac-b674-ec4bfbbd5d45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:00.879984 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78746ac2-f986-48ac-b674-ec4bfbbd5d45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:00.881597 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78746ac2-f986-48ac-b674-ec4bfbbd5d45 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:00.900486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-78746ac2-f986-48ac-b674-ec4bfbbd5d45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:00.900486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:00.900486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:00.900486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:00.900486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:00.900486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:00.900486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:00.900486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:00.900486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:00.900486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:00.900486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:00.900486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:00.900486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:00.900486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:00.900486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:00.901411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:00.901411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:00.901411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:00.901411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:00.901411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:00.901411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:00.901411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:00.901411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:00.901411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:00.901411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:00.901411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:00.901411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:00.901411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:00.901411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:00.901411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:00.901411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:00.901411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:00.907411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:00.907411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:00.907411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:00.907411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:00.907411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 236/464] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:00.907411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78746ac2-f986-48ac-b674-ec4bfbbd5d45 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:00.918864 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a026fe5-a149-4cfa-ae37-95d156f3fc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:00.920217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a026fe5-a149-4cfa-ae37-95d156f3fc93 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:00.921207 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a026fe5-a149-4cfa-ae37-95d156f3fc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:00.921967 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a026fe5-a149-4cfa-ae37-95d156f3fc93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:00.934447 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a026fe5-a149-4cfa-ae37-95d156f3fc93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:00.935912 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a026fe5-a149-4cfa-ae37-95d156f3fc93 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:00.952202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-3a026fe5-a149-4cfa-ae37-95d156f3fc93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:00.952202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:00.952202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:00.952202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:00.952202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:00.952202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:00.952202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:00.952202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:00.952202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:00.952202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:00.952202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:00.952202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:00.952202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:00.952202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:00.952202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:00.953120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:00.953120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:00.953120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:00.953120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:00.953120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:00.953120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:00.953120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:00.953120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:00.953120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:00.953120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:00.953120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:00.953120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:00.953120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:00.953120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:00.953120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:00.953120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:00.953120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:00.959134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:00.959134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:00.959134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:00.959134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:00.959134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 229/465] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:00.959134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a026fe5-a149-4cfa-ae37-95d156f3fc93 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:01.022164 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:01.022530 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78746ac2-f986-48ac-b674-ec4bfbbd5d45 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:01.058617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d9992-0137-41c8-a509-255b900aa499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:01.059244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d9992-0137-41c8-a509-255b900aa499 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:01.059530 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d9992-0137-41c8-a509-255b900aa499 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:01.059803 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d9992-0137-41c8-a509-255b900aa499 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:01.060482 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d9992-0137-41c8-a509-255b900aa499 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:01.061981 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d9992-0137-41c8-a509-255b900aa499 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:01.070694 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a026fe5-a149-4cfa-ae37-95d156f3fc93 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:01.104946 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4f8d3-113a-4436-a542-c8a6c27d343c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:01.105571 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4f8d3-113a-4436-a542-c8a6c27d343c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:01.105852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4f8d3-113a-4436-a542-c8a6c27d343c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:01.106126 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4f8d3-113a-4436-a542-c8a6c27d343c None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:01.106858 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4f8d3-113a-4436-a542-c8a6c27d343c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:01.107169 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4f8d3-113a-4436-a542-c8a6c27d343c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:01.108539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4f8d3-113a-4436-a542-c8a6c27d343c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:01.121130 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 230/466] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:01.121953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4f8d3-113a-4436-a542-c8a6c27d343c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:01.188841 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 237/467] 10.222.0.75 () {60 vars in 1132 bytes} [Thu Jul 28 17:45:00 2022] POST /identity/v3/users => generated 246 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:45:01.190545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27000f4-73bc-40af-94ce-8bd3f11f1e9b None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:01.190844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27000f4-73bc-40af-94ce-8bd3f11f1e9b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:01.191126 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27000f4-73bc-40af-94ce-8bd3f11f1e9b None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:01.196646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 238/468] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:01.196646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27000f4-73bc-40af-94ce-8bd3f11f1e9b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:01.226547 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:01.244872 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4f8d3-113a-4436-a542-c8a6c27d343c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:01.263609 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:01.287676 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fe6db-35f4-4ce3-a5df-d5746787ab52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:01.288718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fe6db-35f4-4ce3-a5df-d5746787ab52 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:01.289226 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fe6db-35f4-4ce3-a5df-d5746787ab52 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:01.289795 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fe6db-35f4-4ce3-a5df-d5746787ab52 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:01.290705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fe6db-35f4-4ce3-a5df-d5746787ab52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:01.291216 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fe6db-35f4-4ce3-a5df-d5746787ab52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:01.292985 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fe6db-35f4-4ce3-a5df-d5746787ab52 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:01.307479 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 231/469] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:01.309308 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa430180-dc7b-4369-9748-7ac5ff0a2ebb None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:01.309783 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa430180-dc7b-4369-9748-7ac5ff0a2ebb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:01.310251 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa430180-dc7b-4369-9748-7ac5ff0a2ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:01.329928 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fa430180-dc7b-4369-9748-7ac5ff0a2ebb None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:01.331557 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fa430180-dc7b-4369-9748-7ac5ff0a2ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:01.346650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27000f4-73bc-40af-94ce-8bd3f11f1e9b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:01.394396 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e8c3f-c298-4995-88b4-351a4f83e27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:01.395058 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e8c3f-c298-4995-88b4-351a4f83e27a None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:01.395345 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e8c3f-c298-4995-88b4-351a4f83e27a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:01.395623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e8c3f-c298-4995-88b4-351a4f83e27a None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:01.396321 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e8c3f-c298-4995-88b4-351a4f83e27a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:01.398379 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e8c3f-c298-4995-88b4-351a4f83e27a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:01.435945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 232/470] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:01.437141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa430180-dc7b-4369-9748-7ac5ff0a2ebb None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:01.492374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 239/471] 10.222.0.75 () {60 vars in 1132 bytes} [Thu Jul 28 17:45:01 2022] POST /identity/v3/users => generated 248 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:45:01.493576 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e8c3f-c298-4995-88b4-351a4f83e27a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:01.559197 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa430180-dc7b-4369-9748-7ac5ff0a2ebb None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:01.561852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:01.598326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a6687-1b50-4c30-b35f-5f2454421754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:01.598970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a6687-1b50-4c30-b35f-5f2454421754 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:01.599248 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a6687-1b50-4c30-b35f-5f2454421754 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:01.599520 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a6687-1b50-4c30-b35f-5f2454421754 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:01.600221 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a6687-1b50-4c30-b35f-5f2454421754 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:01.601735 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a6687-1b50-4c30-b35f-5f2454421754 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:01.613160 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:01.638054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e8c3f-c298-4995-88b4-351a4f83e27a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:01.689304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8429d-155f-4b2f-83bd-de9ef7ab85c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:01.690522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8429d-155f-4b2f-83bd-de9ef7ab85c4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:01.691555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8429d-155f-4b2f-83bd-de9ef7ab85c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:01.691555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8429d-155f-4b2f-83bd-de9ef7ab85c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:01.711409 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8429d-155f-4b2f-83bd-de9ef7ab85c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:01.713024 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8429d-155f-4b2f-83bd-de9ef7ab85c4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:01.733745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-69a8429d-155f-4b2f-83bd-de9ef7ab85c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:01.733745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:01.733745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:01.733745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:01.733745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:01.733745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:01.733745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:01.733745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:01.733745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:01.733745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:01.733745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:01.733745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:01.733745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:01.733745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:01.733745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:01.734653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:01.734653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:01.734653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:01.734653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:01.734653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:01.734653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:01.734653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:01.734653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:01.734653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:01.734653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:01.734653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:01.734653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:01.734653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:01.734653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:01.734653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:01.734653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:01.734653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:01.735482 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:01.735482 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:01.735482 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:01.735482 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:01.735482 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 240/472] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:01.737409 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bffdb-3320-4fc6-9168-439daa2accb7 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:01.737752 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bffdb-3320-4fc6-9168-439daa2accb7 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:01.738033 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bffdb-3320-4fc6-9168-439daa2accb7 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:01.739416 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 241/473] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:01.744096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bffdb-3320-4fc6-9168-439daa2accb7 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:01.780168 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 233/474] 10.222.0.75 () {60 vars in 1132 bytes} [Thu Jul 28 17:45:01 2022] POST /identity/v3/users => generated 248 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:45:01.781679 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99752016-15cf-4ea2-8109-aa3d1ab148de None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:01.782024 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99752016-15cf-4ea2-8109-aa3d1ab148de None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:01.782306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99752016-15cf-4ea2-8109-aa3d1ab148de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:01.811446 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-99752016-15cf-4ea2-8109-aa3d1ab148de None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:01.813136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-99752016-15cf-4ea2-8109-aa3d1ab148de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:01.929983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bffdb-3320-4fc6-9168-439daa2accb7 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:01.944904 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 234/475] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:01.977974 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:01.982211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d6222-9e1f-40ed-8b3e-287f70e257af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:01.982847 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d6222-9e1f-40ed-8b3e-287f70e257af None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:01.983128 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d6222-9e1f-40ed-8b3e-287f70e257af None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:01.983395 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d6222-9e1f-40ed-8b3e-287f70e257af None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:01.984159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d6222-9e1f-40ed-8b3e-287f70e257af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:01.984467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d6222-9e1f-40ed-8b3e-287f70e257af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:01.985892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d6222-9e1f-40ed-8b3e-287f70e257af None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:01.999286 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99752016-15cf-4ea2-8109-aa3d1ab148de None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:02.005256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 242/476] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:02.010799 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d6222-9e1f-40ed-8b3e-287f70e257af None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:02.106881 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:02.120797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99752016-15cf-4ea2-8109-aa3d1ab148de None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:02.138910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d6222-9e1f-40ed-8b3e-287f70e257af None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:02.158079 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a53f7-a998-42ef-8c46-8bfa4593c8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:02.159740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a53f7-a998-42ef-8c46-8bfa4593c8df None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:02.160220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a53f7-a998-42ef-8c46-8bfa4593c8df None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:02.160729 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a53f7-a998-42ef-8c46-8bfa4593c8df None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:02.162551 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a53f7-a998-42ef-8c46-8bfa4593c8df None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:02.164260 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a53f7-a998-42ef-8c46-8bfa4593c8df None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:02.183737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d97662-71f1-43c7-8821-bc64e36c4bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:02.184367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d97662-71f1-43c7-8821-bc64e36c4bbd None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:02.184645 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d97662-71f1-43c7-8821-bc64e36c4bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:02.184948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d97662-71f1-43c7-8821-bc64e36c4bbd None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:02.185635 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d97662-71f1-43c7-8821-bc64e36c4bbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:02.187203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d97662-71f1-43c7-8821-bc64e36c4bbd None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:02.225039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.sql.core [None req-349a53f7-a998-42ef-8c46-8bfa4593c8df None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 17:45:02.225039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 17:45:02.225039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [parameters: {'id': '762e55d41e0743918f0e49f9dbff3893', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 17:45:02.225039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80420) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 17:45:02.250559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-349a53f7-a998-42ef-8c46-8bfa4593c8df None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 17:45:02.250559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:02.250559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 17:45:02.250559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 17:45:02.250559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 17:45:02.250559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 17:45:02.250559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 17:45:02.250559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 17:45:02.250559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 17:45:02.250559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application conn.query(q) Jul 28 17:45:02.250559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 17:45:02.250559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 17:45:02.250559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 17:45:02.250559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result.read() Jul 28 17:45:02.250559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 17:45:02.251838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 17:45:02.251838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 17:45:02.251838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 17:45:02.251838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 17:45:02.251838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 17:45:02.251838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 17:45:02.251838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 17:45:02.251838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 17:45:02.251838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:02.251838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 17:45:02.251838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:02.251838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:02.251838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 17:45:02.251838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 17:45:02.251838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 28 17:45:02.251838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return ref.to_dict() Jul 28 17:45:02.251838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 17:45:02.251838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application next(self.gen) Jul 28 17:45:02.253348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 17:45:02.253348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application yield resource Jul 28 17:45:02.253348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 17:45:02.253348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application next(self.gen) Jul 28 17:45:02.253348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 17:45:02.253348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 17:45:02.253348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 17:45:02.253348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 17:45:02.253348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 17:45:02.253348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise self.value Jul 28 17:45:02.253348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 17:45:02.253348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 17:45:02.253348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 17:45:02.253348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application session.commit() Jul 28 17:45:02.253348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 17:45:02.253348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 17:45:02.253348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 17:45:02.254177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 17:45:02.254177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 17:45:02.254177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.session.flush() Jul 28 17:45:02.254177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 17:45:02.254177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 17:45:02.254177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 17:45:02.254177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 17:45:02.254177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 17:45:02.254177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application compat.raise_( Jul 28 17:45:02.254177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 17:45:02.254177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception Jul 28 17:45:02.254177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 17:45:02.254177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 17:45:02.254177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 17:45:02.254177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 17:45:02.254177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 17:45:02.254177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 17:45:02.256022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 17:45:02.256022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 17:45:02.256022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 17:45:02.256022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 17:45:02.256022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 17:45:02.256022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 17:45:02.256022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 17:45:02.256022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 17:45:02.256022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 17:45:02.256022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 17:45:02.256022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 17:45:02.256022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 17:45:02.256022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 17:45:02.256022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 17:45:02.256022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 17:45:02.256022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception Jul 28 17:45:02.258031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 17:45:02.258031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 17:45:02.258031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 17:45:02.258031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 17:45:02.258031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 17:45:02.258031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 17:45:02.258031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 17:45:02.258031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application conn.query(q) Jul 28 17:45:02.258031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 17:45:02.258031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 17:45:02.258031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 17:45:02.258031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result.read() Jul 28 17:45:02.258031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 17:45:02.258031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 17:45:02.258031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 17:45:02.258031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 17:45:02.259875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 17:45:02.259875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 17:45:02.259875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 17:45:02.259875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 17:45:02.259875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 17:45:02.259875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 17:45:02.259875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [parameters: {'id': '762e55d41e0743918f0e49f9dbff3893', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 17:45:02.259875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 17:45:02.259875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:02.259875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:02.259875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:02.259875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:02.259875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:02.259875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:02.259875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:02.259875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:02.262048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:02.262048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:02.262048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:02.262048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:02.262048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:02.262048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:02.262048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 28 17:45:02.262048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 28 17:45:02.262048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:02.262048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:02.262048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 28 17:45:02.262048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 28 17:45:02.262048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 17:45:02.262048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 17:45:02.262048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 17:45:02.262048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:02.263994 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 235/477] 10.222.0.75 () {60 vars in 1131 bytes} [Thu Jul 28 17:45:01 2022] POST /identity/v3/roles => generated 144 bytes in 253 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:02.263994 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a53f7-a998-42ef-8c46-8bfa4593c8df None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:02.317719 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 243/478] 10.222.0.75 () {60 vars in 1132 bytes} [Thu Jul 28 17:45:02 2022] POST /identity/v3/users => generated 249 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:45:02.386731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a53f7-a998-42ef-8c46-8bfa4593c8df None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:02.428398 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a38b8a-4359-475e-b8db-dcc8d34f9c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:02.429462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a38b8a-4359-475e-b8db-dcc8d34f9c57 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:02.429960 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a38b8a-4359-475e-b8db-dcc8d34f9c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:02.430427 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a38b8a-4359-475e-b8db-dcc8d34f9c57 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:02.442891 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a38b8a-4359-475e-b8db-dcc8d34f9c57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:02.448304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-52a38b8a-4359-475e-b8db-dcc8d34f9c57 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:45:02.448304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:02.448304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:02.448304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:02.448304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:02.448304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:02.448304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:02.448304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:02.448304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:02.448304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:02.448304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:02.448304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:02.448304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:02.448304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:02.448304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:02.448304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:02.449268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:02.449268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:02.449268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:02.449268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:02.449268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:02.449268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:02.449268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:02.449268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:02.449268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:02.449268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:02.449268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:02.449268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:02.449268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:02.449268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:02.449268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:02.449268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:02.450050 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:02.450050 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:02.450050 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:02.450050 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:02.450050 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:02.450050 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:02.450050 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:02.450050 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:02.450050 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:02.450050 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:02.450050 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:45:02.450050 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:02.452872 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 236/479] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:45:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:02.460844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d97662-71f1-43c7-8821-bc64e36c4bbd None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:02.537473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:02.598269 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d97662-71f1-43c7-8821-bc64e36c4bbd None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:02.636338 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49ea1a-8373-4d57-8cad-b257cacd42b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:02.637001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49ea1a-8373-4d57-8cad-b257cacd42b9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:02.637342 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49ea1a-8373-4d57-8cad-b257cacd42b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:02.637623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49ea1a-8373-4d57-8cad-b257cacd42b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:02.638406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49ea1a-8373-4d57-8cad-b257cacd42b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:02.638718 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49ea1a-8373-4d57-8cad-b257cacd42b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:02.640125 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49ea1a-8373-4d57-8cad-b257cacd42b9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:02.649518 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 244/480] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:03.602301 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b196b-ed3b-4872-9e81-abb71e646ddc None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:03.603805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b196b-ed3b-4872-9e81-abb71e646ddc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:03.604323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b196b-ed3b-4872-9e81-abb71e646ddc None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:03.606437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 237/481] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:03.613027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fab6f8-1a8c-4786-b271-e27a1e9cd37f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:03.613857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fab6f8-1a8c-4786-b271-e27a1e9cd37f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:03.614326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fab6f8-1a8c-4786-b271-e27a1e9cd37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:03.641721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-74fab6f8-1a8c-4786-b271-e27a1e9cd37f None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:03.643347 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-74fab6f8-1a8c-4786-b271-e27a1e9cd37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:03.733760 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 245/482] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:45:03.777949 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b196b-ed3b-4872-9e81-abb71e646ddc None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:03.802353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:03.921027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b196b-ed3b-4872-9e81-abb71e646ddc None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:03.970288 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfb817-e658-4418-b00f-4e52cc5cf72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:03.970993 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfb817-e658-4418-b00f-4e52cc5cf72a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:03.971824 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfb817-e658-4418-b00f-4e52cc5cf72a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:03.972094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfb817-e658-4418-b00f-4e52cc5cf72a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:03.985917 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfb817-e658-4418-b00f-4e52cc5cf72a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:03.990956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-7dcfb817-e658-4418-b00f-4e52cc5cf72a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:03.990956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:03.990956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:03.990956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:03.990956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:03.990956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:03.990956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:03.990956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:03.990956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:03.990956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:03.990956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:03.990956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:03.990956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:03.990956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:03.990956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:03.990956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:03.991880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:03.991880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:03.991880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:03.991880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:03.991880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:03.991880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:03.991880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:03.991880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:03.991880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:03.991880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:03.991880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:03.991880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:03.991880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:03.991880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:03.991880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:03.991880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:03.992671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:03.992671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:03.992671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:03.992671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:03.992671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:03.992671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:03.992671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:03.992671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:03.992671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:03.992671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:03.992671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:03.992671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:03.992671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 238/483] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:03.998515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fab6f8-1a8c-4786-b271-e27a1e9cd37f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:04.048374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:04.055873 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae2ccb-ad67-47c4-a455-4cb2500fa595 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:04.056161 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae2ccb-ad67-47c4-a455-4cb2500fa595 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:04.056442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae2ccb-ad67-47c4-a455-4cb2500fa595 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:04.058152 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 239/484] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:45:04.063197 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa79817-b6e3-4b65-aeeb-4c4c35ead542 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:04.063485 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa79817-b6e3-4b65-aeeb-4c4c35ead542 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:04.063767 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa79817-b6e3-4b65-aeeb-4c4c35ead542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:04.083906 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0fa79817-b6e3-4b65-aeeb-4c4c35ead542 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:04.085166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0fa79817-b6e3-4b65-aeeb-4c4c35ead542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:04.181983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fab6f8-1a8c-4786-b271-e27a1e9cd37f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:04.216217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 240/485] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:45:04.242593 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20cad1-4a72-4b31-8730-d5e07084324e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:04.243230 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20cad1-4a72-4b31-8730-d5e07084324e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:04.243433 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa79817-b6e3-4b65-aeeb-4c4c35ead542 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:04.243537 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20cad1-4a72-4b31-8730-d5e07084324e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:04.243767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20cad1-4a72-4b31-8730-d5e07084324e None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:04.244496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20cad1-4a72-4b31-8730-d5e07084324e None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:04.244821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20cad1-4a72-4b31-8730-d5e07084324e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:04.247370 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20cad1-4a72-4b31-8730-d5e07084324e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:04.261148 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:04.266612 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 246/486] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:04.272606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20cad1-4a72-4b31-8730-d5e07084324e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:04.430067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa79817-b6e3-4b65-aeeb-4c4c35ead542 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:04.432519 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:04.439326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20cad1-4a72-4b31-8730-d5e07084324e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:04.478748 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bff7b-bb87-4986-8172-5b08910832c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:04.480037 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bff7b-bb87-4986-8172-5b08910832c9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:04.480626 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bff7b-bb87-4986-8172-5b08910832c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:04.481104 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91d8b4-7596-4fdc-9d6f-b1d1ac9f86cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:04.481474 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bff7b-bb87-4986-8172-5b08910832c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:04.481767 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91d8b4-7596-4fdc-9d6f-b1d1ac9f86cd None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:04.482055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91d8b4-7596-4fdc-9d6f-b1d1ac9f86cd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:04.482333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91d8b4-7596-4fdc-9d6f-b1d1ac9f86cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:04.496662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bff7b-bb87-4986-8172-5b08910832c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:04.498520 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bff7b-bb87-4986-8172-5b08910832c9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:04.499687 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91d8b4-7596-4fdc-9d6f-b1d1ac9f86cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:04.506583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-0b91d8b4-7596-4fdc-9d6f-b1d1ac9f86cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:04.506583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:04.506583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:04.506583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:04.506583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:04.506583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:04.506583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:04.506583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:04.506583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:04.506583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:04.506583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:04.506583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:04.506583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:04.506583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:04.506583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:04.506583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:04.507547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:04.507547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:04.507547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:04.507547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:04.507547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:04.507547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:04.507547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:04.507547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:04.507547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:04.507547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:04.507547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:04.507547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:04.507547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:04.507547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:04.507547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:04.507547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:04.508349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:04.508349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:04.508349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:04.508349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:04.508349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:04.508349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:04.508349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:04.508349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:04.508349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:04.508349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:04.508349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:04.508349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:04.508349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 241/487] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:04.513378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620a176-951b-4341-978a-b75e34e6b298 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:04.513908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620a176-951b-4341-978a-b75e34e6b298 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:04.515241 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620a176-951b-4341-978a-b75e34e6b298 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:04.516700 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 242/488] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:04.519972 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620a176-951b-4341-978a-b75e34e6b298 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:04.526793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-828bff7b-bb87-4986-8172-5b08910832c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:04.526793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:04.526793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:04.526793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:04.526793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:04.526793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:04.526793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:04.526793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:04.526793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:04.526793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:04.526793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:04.526793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:04.526793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:04.526793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:04.526793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:04.531729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:04.531729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:04.531729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:04.531729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:04.531729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:04.531729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:04.531729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:04.531729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:04.531729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:04.531729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:04.531729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:04.531729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:04.531729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:04.531729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:04.531729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:04.531729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:04.531729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:04.532572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:04.532572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:04.532572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:04.532572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:04.532572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 247/489] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:04.532572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c13fdd-25cd-4cd7-938a-a6f9b0bd194e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:04.532572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c13fdd-25cd-4cd7-938a-a6f9b0bd194e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:04.532572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c13fdd-25cd-4cd7-938a-a6f9b0bd194e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:04.549005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-85c13fdd-25cd-4cd7-938a-a6f9b0bd194e None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:04.549005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-85c13fdd-25cd-4cd7-938a-a6f9b0bd194e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:04.606989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:04.652650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 248/490] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:04.653971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c13fdd-25cd-4cd7-938a-a6f9b0bd194e None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:04.665593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620a176-951b-4341-978a-b75e34e6b298 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:04.709098 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b7b7e-1fac-419c-b2d7-809422ccee30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:04.710080 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b7b7e-1fac-419c-b2d7-809422ccee30 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:04.710566 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b7b7e-1fac-419c-b2d7-809422ccee30 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:04.711136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b7b7e-1fac-419c-b2d7-809422ccee30 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:04.712311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b7b7e-1fac-419c-b2d7-809422ccee30 None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:04.712858 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b7b7e-1fac-419c-b2d7-809422ccee30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:04.714543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b7b7e-1fac-419c-b2d7-809422ccee30 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:04.725431 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 243/491] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:04.730967 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b7b7e-1fac-419c-b2d7-809422ccee30 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:04.745682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:04.770388 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c13fdd-25cd-4cd7-938a-a6f9b0bd194e None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:04.812278 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfddbad-0cd9-4833-962e-0e6db544d862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:04.812958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfddbad-0cd9-4833-962e-0e6db544d862 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:04.813257 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfddbad-0cd9-4833-962e-0e6db544d862 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:04.813516 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfddbad-0cd9-4833-962e-0e6db544d862 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:04.814237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfddbad-0cd9-4833-962e-0e6db544d862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:04.814536 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfddbad-0cd9-4833-962e-0e6db544d862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:04.816633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfddbad-0cd9-4833-962e-0e6db544d862 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:04.830594 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 249/492] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:04.832251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfddbad-0cd9-4833-962e-0e6db544d862 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:04.852212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b7b7e-1fac-419c-b2d7-809422ccee30 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:04.883918 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:04.894765 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fe05d-f2a1-4695-a8bc-1b5262ffc483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:04.895760 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fe05d-f2a1-4695-a8bc-1b5262ffc483 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:04.896268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fe05d-f2a1-4695-a8bc-1b5262ffc483 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:04.896820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fe05d-f2a1-4695-a8bc-1b5262ffc483 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:04.909616 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fe05d-f2a1-4695-a8bc-1b5262ffc483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:04.917833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-d66fe05d-f2a1-4695-a8bc-1b5262ffc483 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:04.917833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:04.917833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:04.917833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:04.917833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:04.917833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:04.917833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:04.917833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:04.917833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:04.917833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:04.917833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:04.917833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:04.917833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:04.917833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:04.917833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:04.917833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:04.918745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:04.918745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:04.918745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:04.918745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:04.918745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:04.918745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:04.918745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:04.918745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:04.918745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:04.918745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:04.918745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:04.918745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:04.918745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:04.918745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:04.918745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:04.918745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:04.919636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:04.919636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:04.919636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:04.919636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:04.919636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:04.919636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:04.919636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:04.919636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:04.919636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:04.919636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:04.919636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:04.919636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:04.922548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 244/493] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:04.923798 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fe05d-f2a1-4695-a8bc-1b5262ffc483 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:04.965991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfddbad-0cd9-4833-962e-0e6db544d862 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:05.006100 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187b785-cef1-43b5-bd2b-66b2b7de4ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:05.006855 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187b785-cef1-43b5-bd2b-66b2b7de4ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:05.007146 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187b785-cef1-43b5-bd2b-66b2b7de4ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:05.007442 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187b785-cef1-43b5-bd2b-66b2b7de4ea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:05.017539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:05.021478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187b785-cef1-43b5-bd2b-66b2b7de4ea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:05.023294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187b785-cef1-43b5-bd2b-66b2b7de4ea1 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:05.040136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-1187b785-cef1-43b5-bd2b-66b2b7de4ea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:05.040136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:05.040136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:05.040136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:05.040136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:05.040136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:05.040136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:05.040136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:05.040136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:05.040136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:05.040136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:05.040136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:05.040136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:05.040136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:05.040136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:05.051980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:05.051980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:05.051980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:05.051980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:05.051980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:05.051980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:05.051980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:05.051980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:05.051980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:05.051980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:05.051980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:05.051980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:05.051980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:05.051980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:05.051980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:05.051980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:05.051980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:05.054166 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:05.054166 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:05.054166 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:05.054166 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:05.054166 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 250/494] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:05.054166 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187b785-cef1-43b5-bd2b-66b2b7de4ea1 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:05.059527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fe05d-f2a1-4695-a8bc-1b5262ffc483 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:05.114656 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c3915-e7d1-4522-b3f8-3dbf1c0d4c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:05.115400 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c3915-e7d1-4522-b3f8-3dbf1c0d4c4e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:05.115806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c3915-e7d1-4522-b3f8-3dbf1c0d4c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:05.115983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c3915-e7d1-4522-b3f8-3dbf1c0d4c4e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:05.126844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c3915-e7d1-4522-b3f8-3dbf1c0d4c4e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:05.128350 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c3915-e7d1-4522-b3f8-3dbf1c0d4c4e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:05.142673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-359c3915-e7d1-4522-b3f8-3dbf1c0d4c4e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:45:05.142673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:05.142673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:05.142673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:05.142673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:05.142673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:05.142673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:05.142673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:05.142673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:05.142673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:05.142673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:05.142673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:05.142673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:05.142673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:05.142673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:05.142673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:05.143823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:05.143823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:05.143823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:05.143823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:05.143823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:05.143823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:05.143823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:05.143823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:05.143823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:05.143823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:05.143823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:05.143823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:05.143823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:05.143823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:05.143823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:05.143823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:05.143823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:05.143823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:05.144876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:05.144876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:05.144876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:05.144876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:05.144876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:05.144876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:05.144876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:05.144876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:05.144876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:45:05.144876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:05.147077 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 245/495] 10.222.0.75 () {56 vars in 1093 bytes} [Thu Jul 28 17:45:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:05.147918 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c3915-e7d1-4522-b3f8-3dbf1c0d4c4e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:05.174001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187b785-cef1-43b5-bd2b-66b2b7de4ea1 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:05.200953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:05.215296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d3999-9f41-4356-b296-40d2203cc43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:05.215931 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d3999-9f41-4356-b296-40d2203cc43a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:05.217521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d3999-9f41-4356-b296-40d2203cc43a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:05.217521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d3999-9f41-4356-b296-40d2203cc43a None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:05.217521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d3999-9f41-4356-b296-40d2203cc43a None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:05.217521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d3999-9f41-4356-b296-40d2203cc43a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:05.218919 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d3999-9f41-4356-b296-40d2203cc43a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:05.229871 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 251/496] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:05.231135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ead80c-2ace-4627-8eab-352be342b1ad None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:05.231428 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ead80c-2ace-4627-8eab-352be342b1ad None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:05.231708 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ead80c-2ace-4627-8eab-352be342b1ad None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:05.233146 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 252/497] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:05.234904 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ead80c-2ace-4627-8eab-352be342b1ad None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:05.266369 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c3915-e7d1-4522-b3f8-3dbf1c0d4c4e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:05.292413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:05.307392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb4ee1-8513-4aba-9acf-b6add89029d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:05.308769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb4ee1-8513-4aba-9acf-b6add89029d3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:05.308769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb4ee1-8513-4aba-9acf-b6add89029d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:05.308769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb4ee1-8513-4aba-9acf-b6add89029d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:05.310373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb4ee1-8513-4aba-9acf-b6add89029d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:05.310373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb4ee1-8513-4aba-9acf-b6add89029d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:05.311064 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb4ee1-8513-4aba-9acf-b6add89029d3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:05.328269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 246/498] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:05.329584 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a964e2c-5ef5-4c31-961f-0ec355553498 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:05.329878 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a964e2c-5ef5-4c31-961f-0ec355553498 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:05.330157 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a964e2c-5ef5-4c31-961f-0ec355553498 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:05.332142 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 247/499] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:05.332947 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a964e2c-5ef5-4c31-961f-0ec355553498 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:05.356562 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ead80c-2ace-4627-8eab-352be342b1ad None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:05.396914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7931e-391e-45ae-a3b9-c9d13a83560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:05.397549 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7931e-391e-45ae-a3b9-c9d13a83560f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:05.397826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7931e-391e-45ae-a3b9-c9d13a83560f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:05.398097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7931e-391e-45ae-a3b9-c9d13a83560f None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:05.398911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7931e-391e-45ae-a3b9-c9d13a83560f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:05.399222 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7931e-391e-45ae-a3b9-c9d13a83560f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:05.400977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7931e-391e-45ae-a3b9-c9d13a83560f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:05.439285 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 253/500] 10.222.0.75 () {56 vars in 1133 bytes} [Thu Jul 28 17:45:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:05.440591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9b7bd-a9b6-4266-8f40-dafc6bd1786a None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:05.440943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9b7bd-a9b6-4266-8f40-dafc6bd1786a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:05.441198 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9b7bd-a9b6-4266-8f40-dafc6bd1786a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:05.453165 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a964e2c-5ef5-4c31-961f-0ec355553498 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:05.460738 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-55c9b7bd-a9b6-4266-8f40-dafc6bd1786a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:05.461556 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:05.462022 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-55c9b7bd-a9b6-4266-8f40-dafc6bd1786a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:05.490901 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a80a97-865f-4a6a-90ad-56f430b472a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:05.491689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a80a97-865f-4a6a-90ad-56f430b472a9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:05.492074 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a80a97-865f-4a6a-90ad-56f430b472a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:05.492543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a80a97-865f-4a6a-90ad-56f430b472a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:05.503071 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a80a97-865f-4a6a-90ad-56f430b472a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:05.504622 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a80a97-865f-4a6a-90ad-56f430b472a9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:05.523468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-d7a80a97-865f-4a6a-90ad-56f430b472a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:05.523468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:05.523468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:05.523468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:05.523468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:05.523468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:05.523468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:05.523468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:05.523468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:05.523468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:05.523468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:05.523468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:05.523468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:05.523468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:05.523468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:05.524385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:05.524385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:05.524385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:05.524385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:05.524385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:05.524385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:05.524385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:05.524385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:05.524385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:05.524385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:05.524385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:05.524385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:05.524385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:05.524385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:05.524385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:05.524385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:05.524385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:05.530539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:05.530539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:05.530539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:05.530539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:05.530539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 248/501] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:05.530539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a80a97-865f-4a6a-90ad-56f430b472a9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:05.546291 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 254/502] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:05.547863 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eee68-8296-440c-a02c-6d044b08c6df None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:05.547972 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eee68-8296-440c-a02c-6d044b08c6df None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:05.548202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eee68-8296-440c-a02c-6d044b08c6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:05.579532 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-ba0eee68-8296-440c-a02c-6d044b08c6df None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:05.581385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ba0eee68-8296-440c-a02c-6d044b08c6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:05.628081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a80a97-865f-4a6a-90ad-56f430b472a9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:05.659326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:05.662153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef75797-34fe-4510-90e1-8e03e1ad3108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:05.662799 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef75797-34fe-4510-90e1-8e03e1ad3108 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:05.663082 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef75797-34fe-4510-90e1-8e03e1ad3108 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:05.663356 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef75797-34fe-4510-90e1-8e03e1ad3108 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:05.671202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef75797-34fe-4510-90e1-8e03e1ad3108 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:05.673271 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef75797-34fe-4510-90e1-8e03e1ad3108 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:05.686386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-5ef75797-34fe-4510-90e1-8e03e1ad3108 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:45:05.686386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:05.686386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:05.686386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:05.686386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:05.686386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:05.686386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:05.686386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:05.686386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:05.686386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:05.686386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:05.686386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:05.686386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:05.686386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:05.686386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:05.686386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:05.687311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:05.687311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:05.687311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:05.687311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:05.687311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:05.687311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:05.687311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:05.687311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:05.687311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:05.687311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:05.687311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:05.687311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:05.687311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:05.687311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:05.687311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:05.687311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:05.687311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:05.687311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:05.688189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:05.688189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:05.688189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:05.688189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:05.688189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:05.688189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:05.688189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:05.688189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:05.688189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:45:05.688189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:05.688189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 249/503] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:45:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:05.689044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef75797-34fe-4510-90e1-8e03e1ad3108 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:05.697310 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 255/504] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:05.698165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0eee68-8296-440c-a02c-6d044b08c6df None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:05.718443 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:05.801234 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef75797-34fe-4510-90e1-8e03e1ad3108 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:05.802325 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0eee68-8296-440c-a02c-6d044b08c6df None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:05.833940 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1bb69-37ff-416b-aa6d-fc8fa9466226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:05.834562 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1bb69-37ff-416b-aa6d-fc8fa9466226 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:05.834848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1bb69-37ff-416b-aa6d-fc8fa9466226 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:05.835133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1bb69-37ff-416b-aa6d-fc8fa9466226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:05.836327 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8953f4-6a6a-4826-afcf-3706feff697e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:05.836973 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8953f4-6a6a-4826-afcf-3706feff697e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:05.837255 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8953f4-6a6a-4826-afcf-3706feff697e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:05.837530 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8953f4-6a6a-4826-afcf-3706feff697e None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:05.838222 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8953f4-6a6a-4826-afcf-3706feff697e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:05.838526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8953f4-6a6a-4826-afcf-3706feff697e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:05.839932 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8953f4-6a6a-4826-afcf-3706feff697e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:05.852115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 256/505] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:05.852712 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8953f4-6a6a-4826-afcf-3706feff697e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:05.883798 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:05.913086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1bb69-37ff-416b-aa6d-fc8fa9466226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:05.914566 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1bb69-37ff-416b-aa6d-fc8fa9466226 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:05.933988 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:05.961983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8953f4-6a6a-4826-afcf-3706feff697e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:05.995799 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b4d32-28dd-499d-b333-428f99b6a79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:05.996445 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b4d32-28dd-499d-b333-428f99b6a79a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:05.996726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b4d32-28dd-499d-b333-428f99b6a79a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:05.997028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b4d32-28dd-499d-b333-428f99b6a79a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:06.007165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b4d32-28dd-499d-b333-428f99b6a79a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:06.012539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-184b4d32-28dd-499d-b333-428f99b6a79a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:06.012539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:06.012539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:06.012539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:06.012539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:06.012539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:06.012539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:06.012539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:06.012539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:06.012539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:06.012539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:06.012539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:06.012539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:06.012539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:06.012539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:06.012539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:06.013550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:06.013550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:06.013550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:06.013550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:06.013550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:06.013550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:06.013550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:06.013550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:06.013550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:06.013550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:06.013550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:06.013550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:06.013550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:06.013550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:06.013550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:06.013550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:06.014334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:06.014334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:06.014334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:06.014334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:06.014334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:06.014334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:06.014334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:06.014334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:06.014334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:06.014334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:06.014334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:06.014334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:06.014334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 257/506] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:06.015242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b4d32-28dd-499d-b333-428f99b6a79a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:06.018893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 250/507] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:06.019658 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1bb69-37ff-416b-aa6d-fc8fa9466226 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:06.106971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:06.116279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b4d32-28dd-499d-b333-428f99b6a79a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:06.116888 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1bb69-37ff-416b-aa6d-fc8fa9466226 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:06.134329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:06.150266 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619c7ae-3890-4b4e-840a-a9201c87772e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:06.150894 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619c7ae-3890-4b4e-840a-a9201c87772e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:06.151087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539f324-deb4-4a19-a17a-797e369ddb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:06.151225 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619c7ae-3890-4b4e-840a-a9201c87772e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:06.151478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619c7ae-3890-4b4e-840a-a9201c87772e None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:06.151750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539f324-deb4-4a19-a17a-797e369ddb9a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:06.152031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539f324-deb4-4a19-a17a-797e369ddb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:06.152274 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619c7ae-3890-4b4e-840a-a9201c87772e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:06.152360 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539f324-deb4-4a19-a17a-797e369ddb9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:06.152585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619c7ae-3890-4b4e-840a-a9201c87772e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:06.154097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619c7ae-3890-4b4e-840a-a9201c87772e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:06.162191 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539f324-deb4-4a19-a17a-797e369ddb9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:06.163638 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539f324-deb4-4a19-a17a-797e369ddb9a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:06.172047 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 258/508] 10.222.0.75 () {56 vars in 1137 bytes} [Thu Jul 28 17:45:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:06.175252 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619c7ae-3890-4b4e-840a-a9201c87772e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:06.178598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-7539f324-deb4-4a19-a17a-797e369ddb9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:06.178598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:06.178598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:06.178598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:06.178598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:06.178598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:06.178598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:06.178598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:06.178598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:06.178598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:06.178598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:06.178598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:06.178598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:06.178598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:06.178598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:06.179434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:06.179434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:06.179434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:06.179434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:06.179434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:06.179434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:06.179434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:06.179434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:06.179434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:06.179434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:06.179434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:06.179434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:06.179434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:06.179434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:06.179434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:06.179434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:06.179434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:06.180278 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:06.180278 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:06.180278 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:06.180278 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:06.180278 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 251/509] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:06.180542 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539f324-deb4-4a19-a17a-797e369ddb9a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:06.272396 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619c7ae-3890-4b4e-840a-a9201c87772e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:06.279170 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539f324-deb4-4a19-a17a-797e369ddb9a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:06.306560 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de3156-ea24-4ed0-a01f-b23645a3e2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:06.307419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de3156-ea24-4ed0-a01f-b23645a3e2bf None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:06.307708 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de3156-ea24-4ed0-a01f-b23645a3e2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:06.307981 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de3156-ea24-4ed0-a01f-b23645a3e2bf None admin] PATH_INFO: `/v3/users/glance` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:06.311946 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cbef7-d0ac-4728-beee-92c3644f3d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:06.312558 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cbef7-d0ac-4728-beee-92c3644f3d05 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:06.312865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cbef7-d0ac-4728-beee-92c3644f3d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:06.313140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cbef7-d0ac-4728-beee-92c3644f3d05 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:06.313854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209cbef7-d0ac-4728-beee-92c3644f3d05 None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:06.314156 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209cbef7-d0ac-4728-beee-92c3644f3d05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:06.315531 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de3156-ea24-4ed0-a01f-b23645a3e2bf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:06.316157 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209cbef7-d0ac-4728-beee-92c3644f3d05 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:06.316999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de3156-ea24-4ed0-a01f-b23645a3e2bf None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:06.324035 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 252/510] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:06.324837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cbef7-d0ac-4728-beee-92c3644f3d05 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:06.330305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-07de3156-ea24-4ed0-a01f-b23645a3e2bf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 17:45:06.330305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:06.330305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:06.330305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:06.330305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:06.330305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:06.330305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:06.330305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:06.330305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:06.330305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:06.330305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:06.330305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:06.330305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:06.330305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:06.330305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:06.330305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:06.331201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:06.331201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:06.331201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:06.331201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:06.331201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:06.331201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:06.331201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:06.331201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:06.331201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:06.331201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:06.331201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:06.331201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:06.331201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:06.331201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:06.331201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:06.331201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:06.331201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:06.331201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:06.332079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:06.332079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:06.332079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:06.332079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:06.332079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:06.332079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:06.332079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:06.332079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:06.332079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 17:45:06.332079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:06.332079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 259/511] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:45:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:06.332633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de3156-ea24-4ed0-a01f-b23645a3e2bf None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:06.343960 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:06.356831 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:06.423714 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cbef7-d0ac-4728-beee-92c3644f3d05 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:06.431566 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de3156-ea24-4ed0-a01f-b23645a3e2bf None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:06.459353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a297f96-9f1f-4c34-bc90-95acd72e3d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:06.460023 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a297f96-9f1f-4c34-bc90-95acd72e3d64 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:06.460306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a297f96-9f1f-4c34-bc90-95acd72e3d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:06.460582 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a297f96-9f1f-4c34-bc90-95acd72e3d64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:06.465215 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f7249-932a-4757-b1c3-ff8ddcaec3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:06.465832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f7249-932a-4757-b1c3-ff8ddcaec3ea None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:06.466111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f7249-932a-4757-b1c3-ff8ddcaec3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:06.466381 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f7249-932a-4757-b1c3-ff8ddcaec3ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:06.471146 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a297f96-9f1f-4c34-bc90-95acd72e3d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:06.472588 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a297f96-9f1f-4c34-bc90-95acd72e3d64 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:06.487235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-9a297f96-9f1f-4c34-bc90-95acd72e3d64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:06.487235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:06.487235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:06.487235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:06.487235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:06.487235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:06.487235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:06.487235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:06.487235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:06.487235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:06.487235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:06.487235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:06.487235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:06.487235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:06.487235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:06.488087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:06.488087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:06.488087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:06.488087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:06.488087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:06.488087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:06.488087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:06.488087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:06.488087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:06.488087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:06.488087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:06.488087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:06.488087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:06.488087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:06.488087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:06.488087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:06.488087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:06.488973 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:06.488973 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:06.488973 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:06.488973 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:06.488973 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 253/512] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:06.489259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a297f96-9f1f-4c34-bc90-95acd72e3d64 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:06.538410 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f7249-932a-4757-b1c3-ff8ddcaec3ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:06.539906 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f7249-932a-4757-b1c3-ff8ddcaec3ea None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:06.550998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:06.576670 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:06.592107 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a297f96-9f1f-4c34-bc90-95acd72e3d64 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:06.627499 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7a01a-c34f-43e0-bb23-39f498a76d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:06.628117 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7a01a-c34f-43e0-bb23-39f498a76d93 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:06.628641 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7a01a-c34f-43e0-bb23-39f498a76d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:06.628641 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7a01a-c34f-43e0-bb23-39f498a76d93 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:06.629358 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7a01a-c34f-43e0-bb23-39f498a76d93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:06.629660 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7a01a-c34f-43e0-bb23-39f498a76d93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:06.631030 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7a01a-c34f-43e0-bb23-39f498a76d93 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:06.639404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 260/513] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:06.640248 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f7249-932a-4757-b1c3-ff8ddcaec3ea None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:06.648929 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 254/514] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:06.648929 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7a01a-c34f-43e0-bb23-39f498a76d93 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:06.737486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f7249-932a-4757-b1c3-ff8ddcaec3ea None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:06.745971 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7a01a-c34f-43e0-bb23-39f498a76d93 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:06.746656 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:06.770636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa2c91-0521-4a7e-ba37-1339d26d98a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:06.771279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa2c91-0521-4a7e-ba37-1339d26d98a0 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:06.771561 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa2c91-0521-4a7e-ba37-1339d26d98a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:06.771834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa2c91-0521-4a7e-ba37-1339d26d98a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:06.780431 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e411c-b809-473f-9cea-4d03b11887a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:06.781077 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e411c-b809-473f-9cea-4d03b11887a5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:06.781354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e411c-b809-473f-9cea-4d03b11887a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:06.781625 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e411c-b809-473f-9cea-4d03b11887a5 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:06.781944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa2c91-0521-4a7e-ba37-1339d26d98a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:06.782417 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e411c-b809-473f-9cea-4d03b11887a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:06.782724 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e411c-b809-473f-9cea-4d03b11887a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:06.783991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa2c91-0521-4a7e-ba37-1339d26d98a0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:06.784711 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e411c-b809-473f-9cea-4d03b11887a5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:06.799710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-f4fa2c91-0521-4a7e-ba37-1339d26d98a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:06.799710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:06.799710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:06.799710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:06.799710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:06.799710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:06.799710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:06.799710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:06.799710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:06.799710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:06.799710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:06.799710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:06.799710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:06.799710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:06.799710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:06.800624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:06.800624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:06.800624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:06.800624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:06.800624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:06.800624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:06.800624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:06.800624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:06.800624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:06.800624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:06.800624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:06.800624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:06.800624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:06.800624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:06.800624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:06.800624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:06.800624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:06.801528 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:06.801528 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:06.801528 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:06.801528 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:06.801528 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 261/515] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:06.801803 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa2c91-0521-4a7e-ba37-1339d26d98a0 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:06.823495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 255/516] 10.222.0.75 () {56 vars in 1137 bytes} [Thu Jul 28 17:45:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:06.824247 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e411c-b809-473f-9cea-4d03b11887a5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:06.826899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:06.906105 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa2c91-0521-4a7e-ba37-1339d26d98a0 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:06.923584 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e411c-b809-473f-9cea-4d03b11887a5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:06.941936 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6383dcb-bd84-452a-80f1-7bc5ae5e8e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:06.942554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6383dcb-bd84-452a-80f1-7bc5ae5e8e9e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:06.942841 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6383dcb-bd84-452a-80f1-7bc5ae5e8e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:06.943518 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6383dcb-bd84-452a-80f1-7bc5ae5e8e9e None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:06.944211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6383dcb-bd84-452a-80f1-7bc5ae5e8e9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:06.944518 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6383dcb-bd84-452a-80f1-7bc5ae5e8e9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:06.945943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6383dcb-bd84-452a-80f1-7bc5ae5e8e9e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:06.957110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849eaa7-0c2f-48dd-bf81-f4fafb742aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:06.957755 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849eaa7-0c2f-48dd-bf81-f4fafb742aef None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:06.958040 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849eaa7-0c2f-48dd-bf81-f4fafb742aef None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:06.958325 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849eaa7-0c2f-48dd-bf81-f4fafb742aef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:06.958443 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 262/517] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:06.959167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6383dcb-bd84-452a-80f1-7bc5ae5e8e9e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:06.968648 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849eaa7-0c2f-48dd-bf81-f4fafb742aef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:06.970151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849eaa7-0c2f-48dd-bf81-f4fafb742aef None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:06.982602 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:06.985627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-9849eaa7-0c2f-48dd-bf81-f4fafb742aef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:06.985627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:06.985627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:06.985627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:06.985627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:06.985627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:06.985627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:06.985627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:06.985627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:06.985627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:06.985627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:06.985627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:06.985627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:06.985627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:06.985627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:06.986442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:06.986442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:06.986442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:06.986442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:06.986442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:06.986442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:06.986442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:06.986442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:06.986442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:06.986442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:06.986442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:06.986442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:06.986442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:06.986442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:06.986442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:06.986442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:06.986442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:07.002675 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:07.002675 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:07.002675 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:07.002675 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:07.002675 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 256/518] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:07.002675 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849eaa7-0c2f-48dd-bf81-f4fafb742aef None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:07.044903 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:07.059925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6383dcb-bd84-452a-80f1-7bc5ae5e8e9e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:07.089323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849eaa7-0c2f-48dd-bf81-f4fafb742aef None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:07.093904 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d630f1-f800-4d20-b34c-cb69d856ef5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:07.094696 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d630f1-f800-4d20-b34c-cb69d856ef5b None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:07.094975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d630f1-f800-4d20-b34c-cb69d856ef5b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:07.095243 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d630f1-f800-4d20-b34c-cb69d856ef5b None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:07.096510 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d630f1-f800-4d20-b34c-cb69d856ef5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:07.098018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d630f1-f800-4d20-b34c-cb69d856ef5b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:07.122293 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11045b-d55b-4ec5-800b-bcc996f627f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:07.122914 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11045b-d55b-4ec5-800b-bcc996f627f5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:07.123197 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11045b-d55b-4ec5-800b-bcc996f627f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:07.123473 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11045b-d55b-4ec5-800b-bcc996f627f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:07.124168 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11045b-d55b-4ec5-800b-bcc996f627f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:07.124478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11045b-d55b-4ec5-800b-bcc996f627f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:07.125921 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11045b-d55b-4ec5-800b-bcc996f627f5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:07.137859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 257/519] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:07.138650 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11045b-d55b-4ec5-800b-bcc996f627f5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:07.182427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 263/520] 10.222.0.75 () {60 vars in 1132 bytes} [Thu Jul 28 17:45:06 2022] POST /identity/v3/users => generated 247 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:45:07.183075 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d630f1-f800-4d20-b34c-cb69d856ef5b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:07.243586 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11045b-d55b-4ec5-800b-bcc996f627f5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:07.259351 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:07.284443 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094e4be-0584-4284-853d-8dd94a00ef5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:07.285406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094e4be-0584-4284-853d-8dd94a00ef5d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:07.285861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094e4be-0584-4284-853d-8dd94a00ef5d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:07.286299 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094e4be-0584-4284-853d-8dd94a00ef5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:07.293351 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:07.321243 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d630f1-f800-4d20-b34c-cb69d856ef5b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:07.366305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2007f4-c55c-46d9-a9c0-e4c865ecd055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:07.366762 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2007f4-c55c-46d9-a9c0-e4c865ecd055 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:07.367042 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2007f4-c55c-46d9-a9c0-e4c865ecd055 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:07.367322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2007f4-c55c-46d9-a9c0-e4c865ecd055 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:07.368893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094e4be-0584-4284-853d-8dd94a00ef5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:07.371954 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094e4be-0584-4284-853d-8dd94a00ef5d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:07.375070 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2007f4-c55c-46d9-a9c0-e4c865ecd055 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:07.376565 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2007f4-c55c-46d9-a9c0-e4c865ecd055 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:07.393192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-cb2007f4-c55c-46d9-a9c0-e4c865ecd055 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:07.393192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:07.393192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:07.393192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:07.393192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:07.393192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:07.393192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:07.393192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:07.393192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:07.393192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:07.393192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:07.393192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:07.393192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:07.393192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:07.393192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:07.394115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:07.394115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:07.394115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:07.394115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:07.394115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:07.394115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:07.394115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:07.394115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:07.394115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:07.394115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:07.394115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:07.394115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:07.394115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:07.394115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:07.394115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:07.394115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:07.394115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:07.395095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:07.395095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:07.395095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:07.395095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:07.395095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:07.395095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:07.395095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:07.395095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:07.395095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 264/521] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:07.395591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2007f4-c55c-46d9-a9c0-e4c865ecd055 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:07.491724 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 258/522] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:07.491724 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094e4be-0584-4284-853d-8dd94a00ef5d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:07.506083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:07.512784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2007f4-c55c-46d9-a9c0-e4c865ecd055 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:07.557647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1210064-2237-4196-96fe-ae497baf5b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:07.558276 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1210064-2237-4196-96fe-ae497baf5b85 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:07.558814 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1210064-2237-4196-96fe-ae497baf5b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:07.559094 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1210064-2237-4196-96fe-ae497baf5b85 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:07.560443 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1210064-2237-4196-96fe-ae497baf5b85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:07.560883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1210064-2237-4196-96fe-ae497baf5b85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:07.562917 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1210064-2237-4196-96fe-ae497baf5b85 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:07.566413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:07.582013 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 265/523] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:07.583408 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1210064-2237-4196-96fe-ae497baf5b85 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:07.596521 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094e4be-0584-4284-853d-8dd94a00ef5d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:07.636153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8122e67-ef04-4a65-82f9-7fb38aa6573a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:07.636821 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8122e67-ef04-4a65-82f9-7fb38aa6573a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:07.637134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8122e67-ef04-4a65-82f9-7fb38aa6573a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:07.637407 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8122e67-ef04-4a65-82f9-7fb38aa6573a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:07.645369 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8122e67-ef04-4a65-82f9-7fb38aa6573a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:07.646815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8122e67-ef04-4a65-82f9-7fb38aa6573a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:07.659836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-c8122e67-ef04-4a65-82f9-7fb38aa6573a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 17:45:07.659836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:07.659836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:07.659836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:07.659836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:07.659836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:07.659836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:07.659836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:07.659836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:07.659836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:07.659836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:07.659836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:07.659836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:07.659836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:07.659836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:07.659836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:07.661069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:07.661069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:07.661069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:07.661069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:07.661069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:07.661069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:07.661069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:07.661069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:07.661069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:07.661069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:07.661069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:07.661069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:07.661069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:07.661069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:07.661069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:07.661069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:07.661069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:07.661069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:07.661945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:07.661945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:07.661945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:07.661945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:07.661945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:07.661945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:07.661945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:07.661945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:07.661945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 17:45:07.661945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:07.661945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 259/524] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:07.665597 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8122e67-ef04-4a65-82f9-7fb38aa6573a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:07.700154 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1210064-2237-4196-96fe-ae497baf5b85 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:07.739500 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0af95-f24e-467e-9401-e2ba20219050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:07.740732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0af95-f24e-467e-9401-e2ba20219050 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:07.740732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0af95-f24e-467e-9401-e2ba20219050 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:07.740948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0af95-f24e-467e-9401-e2ba20219050 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:07.741605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0af95-f24e-467e-9401-e2ba20219050 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:07.741923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0af95-f24e-467e-9401-e2ba20219050 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:07.743394 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0af95-f24e-467e-9401-e2ba20219050 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:07.755872 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:07.767901 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 266/525] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:07.767901 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0af95-f24e-467e-9401-e2ba20219050 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:07.786713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8122e67-ef04-4a65-82f9-7fb38aa6573a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:07.821329 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:07.825277 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c0f51-c8e3-4060-aefc-5ae5ce6a8a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:07.826162 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c0f51-c8e3-4060-aefc-5ae5ce6a8a1f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:07.826623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c0f51-c8e3-4060-aefc-5ae5ce6a8a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:07.827085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c0f51-c8e3-4060-aefc-5ae5ce6a8a1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:07.838273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c0f51-c8e3-4060-aefc-5ae5ce6a8a1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:07.839748 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c0f51-c8e3-4060-aefc-5ae5ce6a8a1f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:07.855027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-e77c0f51-c8e3-4060-aefc-5ae5ce6a8a1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:07.855027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:07.855027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:07.855027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:07.855027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:07.855027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:07.855027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:07.855027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:07.855027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:07.855027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:07.855027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:07.855027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:07.855027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:07.855027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:07.855027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:07.856000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:07.856000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:07.856000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:07.856000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:07.856000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:07.856000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:07.856000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:07.856000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:07.856000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:07.856000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:07.856000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:07.856000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:07.856000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:07.856000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:07.856000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:07.856000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:07.856000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:07.856865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:07.856865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:07.856865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:07.856865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:07.856865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 260/526] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:07.857148 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c0f51-c8e3-4060-aefc-5ae5ce6a8a1f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:07.872523 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0af95-f24e-467e-9401-e2ba20219050 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:07.908483 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbd9b6-d230-4dcf-984f-82839a1f5c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:07.909178 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbd9b6-d230-4dcf-984f-82839a1f5c4e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:07.909684 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbd9b6-d230-4dcf-984f-82839a1f5c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:07.909884 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbd9b6-d230-4dcf-984f-82839a1f5c4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:07.927279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbd9b6-d230-4dcf-984f-82839a1f5c4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:07.928831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbd9b6-d230-4dcf-984f-82839a1f5c4e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:07.941498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-96cbd9b6-d230-4dcf-984f-82839a1f5c4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:07.941498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:07.941498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:07.941498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:07.941498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:07.941498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:07.941498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:07.941498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:07.941498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:07.941498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:07.941498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:07.941498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:07.941498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:07.941498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:07.941498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:07.942400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:07.942400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:07.942400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:07.942400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:07.942400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:07.942400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:07.942400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:07.942400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:07.942400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:07.942400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:07.942400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:07.942400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:07.942400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:07.942400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:07.942400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:07.942400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:07.942400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:07.943240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:07.943240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:07.943240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:07.943240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:07.943240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:07.943240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:07.943240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:07.943240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:07.943240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 267/527] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:07.943729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbd9b6-d230-4dcf-984f-82839a1f5c4e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:07.973701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c0f51-c8e3-4060-aefc-5ae5ce6a8a1f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:08.001432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:08.013844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a4935-69d8-4399-b796-3f1dd4d82365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:08.017123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a4935-69d8-4399-b796-3f1dd4d82365 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:08.017123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a4935-69d8-4399-b796-3f1dd4d82365 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:08.017123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a4935-69d8-4399-b796-3f1dd4d82365 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:08.017123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a4935-69d8-4399-b796-3f1dd4d82365 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:08.017123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a4935-69d8-4399-b796-3f1dd4d82365 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:08.018663 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a4935-69d8-4399-b796-3f1dd4d82365 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:08.041004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 261/528] 10.222.0.75 () {56 vars in 1139 bytes} [Thu Jul 28 17:45:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:08.042071 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a4935-69d8-4399-b796-3f1dd4d82365 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:08.061063 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbd9b6-d230-4dcf-984f-82839a1f5c4e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:08.078964 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:08.097760 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdf0d6-bdbe-442f-b84a-7f2c88d37923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:08.098384 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdf0d6-bdbe-442f-b84a-7f2c88d37923 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:08.098670 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdf0d6-bdbe-442f-b84a-7f2c88d37923 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:08.098945 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdf0d6-bdbe-442f-b84a-7f2c88d37923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:08.099728 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdf0d6-bdbe-442f-b84a-7f2c88d37923 None admin] RBAC: Adding query filter params (role.id=6f10ff8509da43688fba83e6a4fd5c5f, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=c456a787159844feb7eabfd1e527e46e) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:08.100043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdf0d6-bdbe-442f-b84a-7f2c88d37923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:08.101551 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdf0d6-bdbe-442f-b84a-7f2c88d37923 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:08.107752 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 268/529] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:07 2022] GET /identity/v3/role_assignments?user.id=c456a787159844feb7eabfd1e527e46e&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=6f10ff8509da43688fba83e6a4fd5c5f => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:08.108540 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdf0d6-bdbe-442f-b84a-7f2c88d37923 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:08.177893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a4935-69d8-4399-b796-3f1dd4d82365 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:08.221686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48508e4-bf03-4b92-8d68-88ece95b811c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:08.222662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48508e4-bf03-4b92-8d68-88ece95b811c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:08.223125 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48508e4-bf03-4b92-8d68-88ece95b811c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:08.223576 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48508e4-bf03-4b92-8d68-88ece95b811c None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:08.224465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48508e4-bf03-4b92-8d68-88ece95b811c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:08.224976 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48508e4-bf03-4b92-8d68-88ece95b811c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:08.226589 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48508e4-bf03-4b92-8d68-88ece95b811c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:08.246794 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 262/530] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:08.247224 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdf0d6-bdbe-442f-b84a-7f2c88d37923 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:08.248224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48508e4-bf03-4b92-8d68-88ece95b811c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:08.299274 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb912534-552c-4541-b9f4-b9952198e898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:08.300207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb912534-552c-4541-b9f4-b9952198e898 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:08.300666 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb912534-552c-4541-b9f4-b9952198e898 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:08.301151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb912534-552c-4541-b9f4-b9952198e898 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:08.302084 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb912534-552c-4541-b9f4-b9952198e898 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:08.302602 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb912534-552c-4541-b9f4-b9952198e898 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:08.305316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb912534-552c-4541-b9f4-b9952198e898 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:08.320673 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 269/531] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:08.321851 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb912534-552c-4541-b9f4-b9952198e898 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:08.326010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:08.397227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:08.397934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48508e4-bf03-4b92-8d68-88ece95b811c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:08.434315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8aac8-0ecd-4c9b-b65d-fb602c28b8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:08.435133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8aac8-0ecd-4c9b-b65d-fb602c28b8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:08.435513 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8aac8-0ecd-4c9b-b65d-fb602c28b8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:08.435910 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8aac8-0ecd-4c9b-b65d-fb602c28b8b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:08.457052 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb912534-552c-4541-b9f4-b9952198e898 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:08.493701 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432f41b-4db7-44db-8b93-cf6c0d08a61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:08.494517 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432f41b-4db7-44db-8b93-cf6c0d08a61b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:08.495092 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432f41b-4db7-44db-8b93-cf6c0d08a61b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:08.495343 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432f41b-4db7-44db-8b93-cf6c0d08a61b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:08.503244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3432f41b-4db7-44db-8b93-cf6c0d08a61b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:08.504892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3432f41b-4db7-44db-8b93-cf6c0d08a61b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:08.517382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-3432f41b-4db7-44db-8b93-cf6c0d08a61b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:08.517382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:08.517382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:08.517382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:08.517382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:08.517382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:08.517382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:08.517382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:08.517382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:08.517382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:08.517382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:08.517382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:08.517382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:08.517382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:08.517382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:08.518444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:08.518444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:08.518444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:08.518444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:08.518444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:08.518444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:08.518444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:08.518444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:08.518444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:08.518444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:08.518444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:08.518444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:08.518444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:08.518444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:08.518444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:08.518444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:08.518444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:08.519479 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:08.519479 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:08.519479 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:08.519479 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:08.519479 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:08.519479 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:08.519479 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:08.519479 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:08.526180 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 270/532] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:08.526180 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432f41b-4db7-44db-8b93-cf6c0d08a61b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:08.528634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8aac8-0ecd-4c9b-b65d-fb602c28b8b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:08.530365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8aac8-0ecd-4c9b-b65d-fb602c28b8b8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:08.581407 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:08.642170 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:08.645484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432f41b-4db7-44db-8b93-cf6c0d08a61b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:08.648631 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 263/533] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:08.650423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8aac8-0ecd-4c9b-b65d-fb602c28b8b8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:08.687736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cca412-fc02-4885-9168-7bcfe273ec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:08.688373 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cca412-fc02-4885-9168-7bcfe273ec68 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:08.688668 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cca412-fc02-4885-9168-7bcfe273ec68 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:08.688959 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cca412-fc02-4885-9168-7bcfe273ec68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:08.690294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cca412-fc02-4885-9168-7bcfe273ec68 None admin] RBAC: Adding query filter params (role.id=6f10ff8509da43688fba83e6a4fd5c5f, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=be78ea573a674611807171c76f8003ce) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:08.690604 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cca412-fc02-4885-9168-7bcfe273ec68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:08.692416 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cca412-fc02-4885-9168-7bcfe273ec68 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:08.698262 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 271/534] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:08 2022] GET /identity/v3/role_assignments?user.id=be78ea573a674611807171c76f8003ce&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=6f10ff8509da43688fba83e6a4fd5c5f => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:08.699048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cca412-fc02-4885-9168-7bcfe273ec68 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:08.794879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8aac8-0ecd-4c9b-b65d-fb602c28b8b8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:08.842819 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cca412-fc02-4885-9168-7bcfe273ec68 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:08.875974 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193ade4-ec9c-464a-97c5-96fbcbf643b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:08.876619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193ade4-ec9c-464a-97c5-96fbcbf643b0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:08.877269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193ade4-ec9c-464a-97c5-96fbcbf643b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:08.877558 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193ade4-ec9c-464a-97c5-96fbcbf643b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:08.878341 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193ade4-ec9c-464a-97c5-96fbcbf643b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:08.878655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193ade4-ec9c-464a-97c5-96fbcbf643b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:08.880135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193ade4-ec9c-464a-97c5-96fbcbf643b0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:08.919217 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573b4aa-e2cd-4ad5-afd4-6dc4f74457ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:08.919865 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573b4aa-e2cd-4ad5-afd4-6dc4f74457ef None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:08.920144 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573b4aa-e2cd-4ad5-afd4-6dc4f74457ef None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:08.920413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573b4aa-e2cd-4ad5-afd4-6dc4f74457ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:08.923266 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 264/535] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:08.930119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193ade4-ec9c-464a-97c5-96fbcbf643b0 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:08.935589 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:08.951122 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573b4aa-e2cd-4ad5-afd4-6dc4f74457ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:08.956499 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573b4aa-e2cd-4ad5-afd4-6dc4f74457ef None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:08.983348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-a573b4aa-e2cd-4ad5-afd4-6dc4f74457ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:08.983348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:08.983348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:08.983348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:08.983348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:08.983348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:08.983348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:08.983348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:08.983348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:08.983348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:08.983348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:08.983348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:08.983348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:08.983348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:08.983348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:08.984332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:08.984332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:08.984332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:08.984332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:08.984332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:08.984332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:08.984332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:08.984332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:08.984332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:08.984332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:08.984332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:08.984332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:08.984332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:08.984332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:08.984332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:08.984332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:08.984332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:08.985565 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:08.985565 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:08.985565 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:08.985565 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:08.985939 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 272/536] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:08.992638 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573b4aa-e2cd-4ad5-afd4-6dc4f74457ef None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:09.016943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:09.147360 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193ade4-ec9c-464a-97c5-96fbcbf643b0 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:09.179453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573b4aa-e2cd-4ad5-afd4-6dc4f74457ef None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:09.216029 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd5ae3-d292-4f70-928b-9f0cb8f61e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:09.216682 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd5ae3-d292-4f70-928b-9f0cb8f61e73 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:09.216993 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd5ae3-d292-4f70-928b-9f0cb8f61e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:09.217331 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd5ae3-d292-4f70-928b-9f0cb8f61e73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:09.218145 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd5ae3-d292-4f70-928b-9f0cb8f61e73 None admin] RBAC: Adding query filter params (role.id=6f10ff8509da43688fba83e6a4fd5c5f, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=1837a832a0da4d698984ce62057b81f4) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:09.218458 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd5ae3-d292-4f70-928b-9f0cb8f61e73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:09.219914 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd5ae3-d292-4f70-928b-9f0cb8f61e73 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:09.236930 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 265/537] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:08 2022] GET /identity/v3/role_assignments?user.id=1837a832a0da4d698984ce62057b81f4&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=6f10ff8509da43688fba83e6a4fd5c5f => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:09.251181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b983c-7fe8-4f25-8d91-9322077efb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:09.251892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b983c-7fe8-4f25-8d91-9322077efb78 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:09.252240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b983c-7fe8-4f25-8d91-9322077efb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:09.252522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b983c-7fe8-4f25-8d91-9322077efb78 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:09.253314 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b983c-7fe8-4f25-8d91-9322077efb78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:09.253629 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b983c-7fe8-4f25-8d91-9322077efb78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:09.255072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b983c-7fe8-4f25-8d91-9322077efb78 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:09.273954 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 273/538] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:09.279392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd5ae3-d292-4f70-928b-9f0cb8f61e73 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:09.386257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:09.425528 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0915523-774a-466e-9baf-955289eb05ad None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:09.425814 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0915523-774a-466e-9baf-955289eb05ad None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:09.426103 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0915523-774a-466e-9baf-955289eb05ad None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:09.427751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 274/539] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:45:09.435046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd5ae3-d292-4f70-928b-9f0cb8f61e73 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:09.456256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb778e4-ba53-4079-b8b3-1ed79a49f171 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:09.456545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb778e4-ba53-4079-b8b3-1ed79a49f171 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:09.456858 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb778e4-ba53-4079-b8b3-1ed79a49f171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:09.476555 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0ecc6-6087-40ef-b7d9-44828742e1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:09.477241 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0ecc6-6087-40ef-b7d9-44828742e1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:09.477523 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0ecc6-6087-40ef-b7d9-44828742e1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:09.477792 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0ecc6-6087-40ef-b7d9-44828742e1a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:09.485236 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0ecc6-6087-40ef-b7d9-44828742e1a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:09.486732 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0ecc6-6087-40ef-b7d9-44828742e1a5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:09.489290 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-eeb778e4-ba53-4079-b8b3-1ed79a49f171 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:09.490547 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-eeb778e4-ba53-4079-b8b3-1ed79a49f171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:09.503627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-5ef0ecc6-6087-40ef-b7d9-44828742e1a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:09.503627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:09.503627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:09.503627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:09.503627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:09.503627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:09.503627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:09.503627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:09.503627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:09.503627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:09.503627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:09.503627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:09.503627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:09.503627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:09.503627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:09.504662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:09.504662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:09.504662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:09.504662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:09.504662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:09.504662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:09.504662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:09.504662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:09.504662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:09.504662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:09.504662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:09.504662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:09.504662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:09.504662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:09.504662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:09.504662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:09.504662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:09.505550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:09.505550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:09.505550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:09.505550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:09.505550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:09.505550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:09.505550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:09.505550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:09.505550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 266/540] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:09.511165 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0ecc6-6087-40ef-b7d9-44828742e1a5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:09.589858 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 275/541] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:09.613022 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb778e4-ba53-4079-b8b3-1ed79a49f171 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:09.621714 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:09.748892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb778e4-ba53-4079-b8b3-1ed79a49f171 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:09.761568 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0ecc6-6087-40ef-b7d9-44828742e1a5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:09.805053 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:09.814311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3e8bd-0051-418e-9455-a397c0481d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:09.815216 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3e8bd-0051-418e-9455-a397c0481d3e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:09.815647 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3e8bd-0051-418e-9455-a397c0481d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:09.819788 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3e8bd-0051-418e-9455-a397c0481d3e None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:09.819788 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3e8bd-0051-418e-9455-a397c0481d3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:09.819788 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3e8bd-0051-418e-9455-a397c0481d3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:09.819788 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3e8bd-0051-418e-9455-a397c0481d3e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:09.832278 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 267/542] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:09.836804 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7574f1-0177-4768-8023-8eaa8bbd803b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:09.836804 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7574f1-0177-4768-8023-8eaa8bbd803b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:09.836804 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7574f1-0177-4768-8023-8eaa8bbd803b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:09.836804 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7574f1-0177-4768-8023-8eaa8bbd803b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:09.838827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3e8bd-0051-418e-9455-a397c0481d3e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:09.869731 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7574f1-0177-4768-8023-8eaa8bbd803b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:09.875077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-cb7574f1-0177-4768-8023-8eaa8bbd803b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:09.875077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:09.875077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:09.875077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:09.875077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:09.875077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:09.875077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:09.875077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:09.875077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:09.875077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:09.875077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:09.875077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:09.875077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:09.875077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:09.875077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:09.875077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:09.876163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:09.876163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:09.876163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:09.876163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:09.876163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:09.876163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:09.876163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:09.876163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:09.876163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:09.876163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:09.876163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:09.876163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:09.876163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:09.876163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:09.876163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:09.876163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:09.877253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:09.877253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:09.877253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:09.877253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:09.877253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:09.877253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:09.877253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:09.877253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:09.877253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:09.877253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:09.877253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:09.877253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:09.881127 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 276/543] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:09.882054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7574f1-0177-4768-8023-8eaa8bbd803b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:09.992832 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3e8bd-0051-418e-9455-a397c0481d3e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:10.025878 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:10.057904 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64966bf5-b540-4cab-998d-d4a667c6c6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:10.058806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64966bf5-b540-4cab-998d-d4a667c6c6eb None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:10.059238 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64966bf5-b540-4cab-998d-d4a667c6c6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:10.059672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64966bf5-b540-4cab-998d-d4a667c6c6eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:10.060649 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64966bf5-b540-4cab-998d-d4a667c6c6eb None admin] RBAC: Adding query filter params (role.id=6f10ff8509da43688fba83e6a4fd5c5f, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=d0e56603b8704cb2b5587313c67254a9) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:10.061135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64966bf5-b540-4cab-998d-d4a667c6c6eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:10.062725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64966bf5-b540-4cab-998d-d4a667c6c6eb None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:10.069525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 268/544] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:09 2022] GET /identity/v3/role_assignments?user.id=d0e56603b8704cb2b5587313c67254a9&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=6f10ff8509da43688fba83e6a4fd5c5f => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:10.088215 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7574f1-0177-4768-8023-8eaa8bbd803b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:10.148553 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4795ea0-0ef0-4616-b324-be48cd4700ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:10.149234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4795ea0-0ef0-4616-b324-be48cd4700ee None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:10.149516 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4795ea0-0ef0-4616-b324-be48cd4700ee None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:10.150093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4795ea0-0ef0-4616-b324-be48cd4700ee None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:10.150889 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4795ea0-0ef0-4616-b324-be48cd4700ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:10.151195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4795ea0-0ef0-4616-b324-be48cd4700ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:10.152634 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4795ea0-0ef0-4616-b324-be48cd4700ee None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:10.162858 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 277/545] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:10.168661 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64966bf5-b540-4cab-998d-d4a667c6c6eb None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:10.253214 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:10.291172 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b5961-b422-48ef-a866-172b41c87376 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:10.291451 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b5961-b422-48ef-a866-172b41c87376 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:10.291645 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b5961-b422-48ef-a866-172b41c87376 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:10.297076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 278/546] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:10.299212 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493be9a-1798-4706-a966-9b6dfc85a27b None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:10.299497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493be9a-1798-4706-a966-9b6dfc85a27b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:10.299770 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493be9a-1798-4706-a966-9b6dfc85a27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:10.309600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64966bf5-b540-4cab-998d-d4a667c6c6eb None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:10.333785 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6493be9a-1798-4706-a966-9b6dfc85a27b None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:10.334988 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6493be9a-1798-4706-a966-9b6dfc85a27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:10.369960 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe717e7-6461-42a2-b810-d4badc2b4944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:10.370615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe717e7-6461-42a2-b810-d4badc2b4944 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:10.370899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe717e7-6461-42a2-b810-d4badc2b4944 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:10.371199 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe717e7-6461-42a2-b810-d4badc2b4944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:10.390699 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe717e7-6461-42a2-b810-d4badc2b4944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:10.392338 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe717e7-6461-42a2-b810-d4badc2b4944 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:10.409750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-6fe717e7-6461-42a2-b810-d4badc2b4944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:10.409750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:10.409750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:10.409750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:10.409750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:10.409750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:10.409750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:10.409750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:10.409750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:10.409750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:10.409750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:10.409750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:10.409750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:10.409750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:10.409750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:10.410717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:10.410717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:10.410717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:10.410717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:10.410717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:10.410717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:10.410717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:10.410717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:10.410717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:10.410717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:10.410717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:10.410717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:10.410717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:10.410717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:10.410717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:10.410717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:10.410717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:10.411550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:10.411550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:10.411550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:10.411550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:10.411550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 269/547] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:10.416850 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe717e7-6461-42a2-b810-d4badc2b4944 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:10.507243 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 279/548] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:10.522142 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe717e7-6461-42a2-b810-d4badc2b4944 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:10.525423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:10.541348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493be9a-1798-4706-a966-9b6dfc85a27b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:10.558585 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb75a7-4b16-4306-aff5-e21f912b41c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:10.559215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb75a7-4b16-4306-aff5-e21f912b41c3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:10.559566 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb75a7-4b16-4306-aff5-e21f912b41c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:10.559849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb75a7-4b16-4306-aff5-e21f912b41c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:10.560547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb75a7-4b16-4306-aff5-e21f912b41c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:10.560887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb75a7-4b16-4306-aff5-e21f912b41c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:10.562328 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb75a7-4b16-4306-aff5-e21f912b41c3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:10.575089 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 270/549] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:10.580528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb75a7-4b16-4306-aff5-e21f912b41c3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:10.652175 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:10.688211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb75a7-4b16-4306-aff5-e21f912b41c3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:10.734862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f15840-8a78-4d8c-bf37-fbdcc640f789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:10.735617 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f15840-8a78-4d8c-bf37-fbdcc640f789 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:10.736051 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f15840-8a78-4d8c-bf37-fbdcc640f789 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:10.736907 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f15840-8a78-4d8c-bf37-fbdcc640f789 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:10.744567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f15840-8a78-4d8c-bf37-fbdcc640f789 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:10.746151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f15840-8a78-4d8c-bf37-fbdcc640f789 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:10.746759 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493be9a-1798-4706-a966-9b6dfc85a27b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:10.760232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-a1f15840-8a78-4d8c-bf37-fbdcc640f789 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:45:10.760232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:10.760232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:10.760232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:10.760232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:10.760232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:10.760232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:10.760232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:10.760232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:10.760232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:10.760232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:10.760232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:10.760232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:10.760232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:10.760232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:10.760232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:10.761242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:10.761242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:10.761242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:10.761242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:10.761242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:10.761242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:10.761242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:10.761242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:10.761242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:10.761242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:10.761242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:10.761242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:10.761242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:10.761242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:10.761242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:10.761242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:10.761242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:10.761242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:10.762596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:10.762596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:10.762596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:10.762596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:10.762596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:10.762596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:10.762596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:10.762596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:10.762596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:45:10.762596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:10.762596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 271/550] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:45:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:10.767957 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f15840-8a78-4d8c-bf37-fbdcc640f789 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:10.801253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:10.853472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101c238-3ff3-4fe6-9fb5-ec7946822130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:10.854141 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101c238-3ff3-4fe6-9fb5-ec7946822130 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:10.854424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101c238-3ff3-4fe6-9fb5-ec7946822130 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:10.854701 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101c238-3ff3-4fe6-9fb5-ec7946822130 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:10.879552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101c238-3ff3-4fe6-9fb5-ec7946822130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:10.889465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-d101c238-3ff3-4fe6-9fb5-ec7946822130 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:10.889465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:10.889465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:10.889465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:10.889465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:10.889465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:10.889465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:10.889465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:10.889465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:10.889465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:10.889465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:10.889465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:10.889465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:10.889465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:10.889465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:10.889465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:10.890355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:10.890355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:10.890355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:10.890355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:10.890355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:10.890355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:10.890355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:10.890355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:10.890355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:10.890355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:10.890355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:10.890355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:10.890355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:10.890355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:10.890355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:10.890355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:10.891165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:10.891165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:10.891165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:10.891165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:10.891165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:10.891165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:10.891165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:10.891165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:10.891165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:10.891165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:10.891165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:10.891165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:10.891165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 280/551] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:10.897105 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101c238-3ff3-4fe6-9fb5-ec7946822130 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:10.899124 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f15840-8a78-4d8c-bf37-fbdcc640f789 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:10.973222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f58662-ebc6-4831-bb19-d5fdf62e7f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:10.973861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f58662-ebc6-4831-bb19-d5fdf62e7f6a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:10.974144 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f58662-ebc6-4831-bb19-d5fdf62e7f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:10.974418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f58662-ebc6-4831-bb19-d5fdf62e7f6a None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:10.975224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f58662-ebc6-4831-bb19-d5fdf62e7f6a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:10.975531 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f58662-ebc6-4831-bb19-d5fdf62e7f6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:10.976985 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f58662-ebc6-4831-bb19-d5fdf62e7f6a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:11.015985 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 272/552] 10.222.0.75 () {56 vars in 1135 bytes} [Thu Jul 28 17:45:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:11.031773 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f58662-ebc6-4831-bb19-d5fdf62e7f6a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:11.061791 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101c238-3ff3-4fe6-9fb5-ec7946822130 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:11.091873 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:11.105208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6b7ab-7a23-47f3-8834-dba7dc7fc546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:11.110584 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6b7ab-7a23-47f3-8834-dba7dc7fc546 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:11.110584 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6b7ab-7a23-47f3-8834-dba7dc7fc546 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:11.110584 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6b7ab-7a23-47f3-8834-dba7dc7fc546 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:11.110584 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6b7ab-7a23-47f3-8834-dba7dc7fc546 None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:11.110584 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6b7ab-7a23-47f3-8834-dba7dc7fc546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:11.110584 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6b7ab-7a23-47f3-8834-dba7dc7fc546 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:11.118214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 281/553] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:11.123728 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6b7ab-7a23-47f3-8834-dba7dc7fc546 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:11.167123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:11.185460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f58662-ebc6-4831-bb19-d5fdf62e7f6a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:11.226039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176ead5-751d-4d1b-9246-21ad6523c335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:11.226672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176ead5-751d-4d1b-9246-21ad6523c335 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:11.226957 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176ead5-751d-4d1b-9246-21ad6523c335 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:11.227235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176ead5-751d-4d1b-9246-21ad6523c335 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:11.318105 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6b7ab-7a23-47f3-8834-dba7dc7fc546 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:11.352124 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176ead5-751d-4d1b-9246-21ad6523c335 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:11.352124 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176ead5-751d-4d1b-9246-21ad6523c335 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:11.387648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bfbba-4b5b-4b5d-a5b5-09e0cbcc78d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:11.388304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bfbba-4b5b-4b5d-a5b5-09e0cbcc78d8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:11.388582 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bfbba-4b5b-4b5d-a5b5-09e0cbcc78d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:11.388886 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bfbba-4b5b-4b5d-a5b5-09e0cbcc78d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:11.402050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bfbba-4b5b-4b5d-a5b5-09e0cbcc78d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:11.403539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bfbba-4b5b-4b5d-a5b5-09e0cbcc78d8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:11.420043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-fd7bfbba-4b5b-4b5d-a5b5-09e0cbcc78d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:11.420043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:11.420043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:11.420043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:11.420043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:11.420043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:11.420043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:11.420043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:11.420043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:11.420043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:11.420043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:11.420043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:11.420043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:11.420043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:11.420043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:11.420998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:11.420998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:11.420998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:11.420998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:11.420998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:11.420998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:11.420998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:11.420998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:11.420998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:11.420998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:11.420998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:11.420998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:11.420998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:11.420998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:11.420998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:11.420998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:11.420998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:11.421929 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:11.421929 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:11.421929 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:11.421929 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:11.421929 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 282/554] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:11.428458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe9cb0-cd72-41b9-b97b-0a83ae989df6 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:11.428458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe9cb0-cd72-41b9-b97b-0a83ae989df6 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:11.428458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe9cb0-cd72-41b9-b97b-0a83ae989df6 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:11.428458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 283/555] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:11.428458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe9cb0-cd72-41b9-b97b-0a83ae989df6 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:11.466447 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:11.481042 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:11.508841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 273/556] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:11.510224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c315838-acca-4677-b7d5-32595ec37b59 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:11.510517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c315838-acca-4677-b7d5-32595ec37b59 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:11.510793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c315838-acca-4677-b7d5-32595ec37b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:11.541530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-5c315838-acca-4677-b7d5-32595ec37b59 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:11.543548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5c315838-acca-4677-b7d5-32595ec37b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:11.556840 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe9cb0-cd72-41b9-b97b-0a83ae989df6 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:11.595810 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d958a-7f7b-4e98-b813-6e00cadb0914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:11.596706 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d958a-7f7b-4e98-b813-6e00cadb0914 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:11.597198 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d958a-7f7b-4e98-b813-6e00cadb0914 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:11.597661 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d958a-7f7b-4e98-b813-6e00cadb0914 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:11.598593 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d958a-7f7b-4e98-b813-6e00cadb0914 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:11.599125 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d958a-7f7b-4e98-b813-6e00cadb0914 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:11.600929 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d958a-7f7b-4e98-b813-6e00cadb0914 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:11.615329 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 284/557] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:11.616412 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d958a-7f7b-4e98-b813-6e00cadb0914 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:11.638258 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 274/558] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:11.639366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c315838-acca-4677-b7d5-32595ec37b59 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:11.727170 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:11.738639 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d958a-7f7b-4e98-b813-6e00cadb0914 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:11.773061 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c315838-acca-4677-b7d5-32595ec37b59 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:11.779986 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae2b3f-31e0-4afe-a741-ab671c26c297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:11.780703 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae2b3f-31e0-4afe-a741-ab671c26c297 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:11.781018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae2b3f-31e0-4afe-a741-ab671c26c297 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:11.781293 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae2b3f-31e0-4afe-a741-ab671c26c297 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:11.793487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae2b3f-31e0-4afe-a741-ab671c26c297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:11.794966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae2b3f-31e0-4afe-a741-ab671c26c297 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:11.796558 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:11.812267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-96ae2b3f-31e0-4afe-a741-ab671c26c297 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:11.812267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:11.812267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:11.812267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:11.812267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:11.812267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:11.812267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:11.812267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:11.812267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:11.812267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:11.812267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:11.812267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:11.812267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:11.812267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:11.812267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:11.819751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:11.819751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:11.819751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:11.819751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:11.819751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:11.819751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:11.819751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:11.819751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:11.819751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:11.819751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:11.819751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:11.819751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:11.819751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:11.819751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:11.819751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:11.819751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:11.819751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:11.820669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:11.820669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:11.820669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:11.820669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:11.820669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 285/559] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:11.820669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83843592-2a09-46a9-9547-c05a22b8235d None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:11.820669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83843592-2a09-46a9-9547-c05a22b8235d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:11.820669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83843592-2a09-46a9-9547-c05a22b8235d None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:11.821171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 286/560] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:11.821903 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83843592-2a09-46a9-9547-c05a22b8235d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:11.827749 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e083ad-01ef-4f63-96d4-ccb28f9d467d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:11.828488 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e083ad-01ef-4f63-96d4-ccb28f9d467d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:11.828875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e083ad-01ef-4f63-96d4-ccb28f9d467d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:11.829219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e083ad-01ef-4f63-96d4-ccb28f9d467d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:11.836692 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e083ad-01ef-4f63-96d4-ccb28f9d467d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:11.838359 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e083ad-01ef-4f63-96d4-ccb28f9d467d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:11.851705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-d9e083ad-01ef-4f63-96d4-ccb28f9d467d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:45:11.851705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:11.851705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:11.851705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:11.851705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:11.851705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:11.851705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:11.851705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:11.851705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:11.851705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:11.851705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:11.851705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:11.851705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:11.851705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:11.851705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:11.851705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:11.853058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:11.853058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:11.853058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:11.853058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:11.853058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:11.853058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:11.853058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:11.853058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:11.853058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:11.853058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:11.853058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:11.853058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:11.853058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:11.853058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:11.853058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:11.853058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:11.853058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:11.853058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:11.853970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:11.853970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:11.853970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:11.853970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:11.853970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:11.853970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:11.853970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:11.853970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:11.853970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:45:11.853970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:11.853970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 275/561] 10.222.0.75 () {56 vars in 1093 bytes} [Thu Jul 28 17:45:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:11.853970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e083ad-01ef-4f63-96d4-ccb28f9d467d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:11.938497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83843592-2a09-46a9-9547-c05a22b8235d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:11.966506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e083ad-01ef-4f63-96d4-ccb28f9d467d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:11.977906 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4452f-e8de-43f7-8b2e-9afdc9ed20a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:11.978567 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4452f-e8de-43f7-8b2e-9afdc9ed20a7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:11.978846 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4452f-e8de-43f7-8b2e-9afdc9ed20a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:11.979123 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4452f-e8de-43f7-8b2e-9afdc9ed20a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:11.990281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4452f-e8de-43f7-8b2e-9afdc9ed20a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:11.995892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-13c4452f-e8de-43f7-8b2e-9afdc9ed20a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:11.995892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:11.995892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:11.995892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:11.995892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:11.995892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:11.995892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:11.995892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:11.995892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:11.995892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:11.995892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:11.995892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:11.995892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:11.995892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:11.995892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:11.995892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:11.996867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:11.996867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:11.996867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:11.996867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:11.996867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:11.996867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:11.996867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:11.996867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:11.996867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:11.996867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:11.996867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:11.996867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:11.996867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:11.996867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:11.996867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:11.996867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:11.997789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:11.997789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:11.997789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:11.997789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:11.997789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:11.997789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:11.997789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:11.997789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:11.997789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:11.997789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:11.997789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:11.997789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:11.997789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 287/562] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:11.998977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f73e0-ae55-486a-96e8-c86c5e462c63 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:11.998977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f73e0-ae55-486a-96e8-c86c5e462c63 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:11.998977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f73e0-ae55-486a-96e8-c86c5e462c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:12.006520 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:12.012053 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a70aed-09d9-4d88-ab6b-84e3ceab1f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:12.012593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a70aed-09d9-4d88-ab6b-84e3ceab1f1e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:12.012931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a70aed-09d9-4d88-ab6b-84e3ceab1f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:12.013215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a70aed-09d9-4d88-ab6b-84e3ceab1f1e None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:12.013908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a70aed-09d9-4d88-ab6b-84e3ceab1f1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:12.014218 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a70aed-09d9-4d88-ab6b-84e3ceab1f1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:12.015590 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a70aed-09d9-4d88-ab6b-84e3ceab1f1e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:12.017073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-a06f73e0-ae55-486a-96e8-c86c5e462c63 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:12.018293 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a06f73e0-ae55-486a-96e8-c86c5e462c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:12.032641 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 276/563] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:12.032641 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a70aed-09d9-4d88-ab6b-84e3ceab1f1e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:12.068246 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:12.096474 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 288/564] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:12.097695 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f73e0-ae55-486a-96e8-c86c5e462c63 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:12.152228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a70aed-09d9-4d88-ab6b-84e3ceab1f1e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:12.191604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cf75f-cb32-46aa-90a6-21e1088b5802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:12.192496 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cf75f-cb32-46aa-90a6-21e1088b5802 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:12.192798 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cf75f-cb32-46aa-90a6-21e1088b5802 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:12.193074 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cf75f-cb32-46aa-90a6-21e1088b5802 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:12.193868 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cf75f-cb32-46aa-90a6-21e1088b5802 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:12.194176 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cf75f-cb32-46aa-90a6-21e1088b5802 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:12.195626 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cf75f-cb32-46aa-90a6-21e1088b5802 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:12.218543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 277/565] 10.222.0.75 () {56 vars in 1133 bytes} [Thu Jul 28 17:45:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:12.218543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cf75f-cb32-46aa-90a6-21e1088b5802 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:12.218787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f73e0-ae55-486a-96e8-c86c5e462c63 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:12.255071 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32f2e1-d26a-4e69-98cb-6e949bc8ebc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:12.255702 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32f2e1-d26a-4e69-98cb-6e949bc8ebc1 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:12.255984 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32f2e1-d26a-4e69-98cb-6e949bc8ebc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:12.256259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32f2e1-d26a-4e69-98cb-6e949bc8ebc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:12.257009 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32f2e1-d26a-4e69-98cb-6e949bc8ebc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:12.257319 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32f2e1-d26a-4e69-98cb-6e949bc8ebc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:12.258746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32f2e1-d26a-4e69-98cb-6e949bc8ebc1 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:12.260266 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:12.268384 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 289/566] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:12.269258 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32f2e1-d26a-4e69-98cb-6e949bc8ebc1 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:12.318812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:12.328070 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cf75f-cb32-46aa-90a6-21e1088b5802 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:12.363876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d72a7e-021d-4c2c-b2bc-2fe15e5ce8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:12.364523 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d72a7e-021d-4c2c-b2bc-2fe15e5ce8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:12.364834 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d72a7e-021d-4c2c-b2bc-2fe15e5ce8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:12.365117 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d72a7e-021d-4c2c-b2bc-2fe15e5ce8b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:12.371667 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d72a7e-021d-4c2c-b2bc-2fe15e5ce8b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:12.373135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d72a7e-021d-4c2c-b2bc-2fe15e5ce8b8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:12.373372 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32f2e1-d26a-4e69-98cb-6e949bc8ebc1 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:12.385007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-19d72a7e-021d-4c2c-b2bc-2fe15e5ce8b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:12.385007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:12.385007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:12.385007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:12.385007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:12.385007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:12.385007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:12.385007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:12.385007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:12.385007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:12.385007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:12.385007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:12.385007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:12.385007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:12.385007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:12.385887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:12.385887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:12.385887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:12.385887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:12.385887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:12.385887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:12.385887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:12.385887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:12.385887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:12.385887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:12.385887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:12.385887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:12.385887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:12.385887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:12.385887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:12.385887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:12.385887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:12.386759 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:12.386759 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:12.386759 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:12.386759 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:12.386759 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:12.386759 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:12.386759 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:12.386759 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:12.386759 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 278/567] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:12.387651 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d72a7e-021d-4c2c-b2bc-2fe15e5ce8b8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:12.408689 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bdc83-88d7-429c-8fb4-6466bdd7e6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:12.409315 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bdc83-88d7-429c-8fb4-6466bdd7e6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:12.409598 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bdc83-88d7-429c-8fb4-6466bdd7e6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:12.409874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bdc83-88d7-429c-8fb4-6466bdd7e6f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:12.419761 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39bdc83-88d7-429c-8fb4-6466bdd7e6f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:12.425662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-e39bdc83-88d7-429c-8fb4-6466bdd7e6f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:12.425662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:12.425662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:12.425662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:12.425662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:12.425662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:12.425662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:12.425662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:12.425662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:12.425662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:12.425662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:12.425662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:12.425662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:12.425662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:12.425662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:12.425662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:12.426559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:12.426559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:12.426559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:12.426559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:12.426559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:12.426559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:12.426559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:12.426559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:12.426559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:12.426559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:12.426559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:12.426559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:12.426559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:12.426559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:12.426559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:12.426559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:12.427374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:12.427374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:12.427374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:12.427374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:12.427374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:12.427374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:12.427374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:12.427374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:12.427374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:12.427374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:12.427374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:12.427374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:12.427374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 290/568] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:12.428036 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bdc83-88d7-429c-8fb4-6466bdd7e6f0 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:12.486923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:12.488877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d72a7e-021d-4c2c-b2bc-2fe15e5ce8b8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:12.522452 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43468d63-a6f2-4bae-b183-cf52fff85b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:12.523088 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43468d63-a6f2-4bae-b183-cf52fff85b6c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:12.523372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43468d63-a6f2-4bae-b183-cf52fff85b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:12.523651 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43468d63-a6f2-4bae-b183-cf52fff85b6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:12.531022 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bdc83-88d7-429c-8fb4-6466bdd7e6f0 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:12.537142 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43468d63-a6f2-4bae-b183-cf52fff85b6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:12.537142 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43468d63-a6f2-4bae-b183-cf52fff85b6c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:12.553078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-43468d63-a6f2-4bae-b183-cf52fff85b6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:12.553078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:12.553078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:12.553078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:12.553078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:12.553078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:12.553078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:12.553078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:12.553078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:12.553078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:12.553078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:12.553078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:12.553078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:12.553078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:12.553078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:12.553983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:12.553983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:12.553983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:12.553983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:12.553983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:12.553983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:12.553983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:12.553983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:12.553983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:12.553983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:12.553983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:12.553983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:12.553983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:12.553983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:12.553983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:12.553983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:12.553983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:12.554845 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:12.554845 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:12.554845 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:12.554845 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:12.554845 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 279/569] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:12.555661 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b3a5b-55be-47e5-aa26-1ebbd9603fd9 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:12.555868 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b3a5b-55be-47e5-aa26-1ebbd9603fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:12.556306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b3a5b-55be-47e5-aa26-1ebbd9603fd9 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:12.557551 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 280/570] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:12.558169 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b3a5b-55be-47e5-aa26-1ebbd9603fd9 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:12.561102 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:12.569334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71ee74-cb27-4d93-b8e2-e7c869da70ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:12.569980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71ee74-cb27-4d93-b8e2-e7c869da70ab None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:12.571559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71ee74-cb27-4d93-b8e2-e7c869da70ab None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:12.571559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71ee74-cb27-4d93-b8e2-e7c869da70ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:12.581069 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71ee74-cb27-4d93-b8e2-e7c869da70ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:12.582525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71ee74-cb27-4d93-b8e2-e7c869da70ab None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:12.596844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-ad71ee74-cb27-4d93-b8e2-e7c869da70ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:12.596844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:12.596844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:12.596844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:12.596844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:12.596844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:12.596844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:12.596844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:12.596844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:12.596844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:12.596844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:12.596844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:12.596844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:12.596844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:12.596844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:12.597753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:12.597753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:12.597753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:12.597753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:12.597753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:12.597753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:12.597753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:12.597753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:12.597753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:12.597753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:12.597753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:12.597753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:12.597753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:12.597753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:12.597753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:12.597753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:12.597753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:12.599436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:12.599436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:12.599436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:12.599436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:12.599436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 291/571] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:12.599436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71ee74-cb27-4d93-b8e2-e7c869da70ab None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:12.693513 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b3a5b-55be-47e5-aa26-1ebbd9603fd9 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:12.699280 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71ee74-cb27-4d93-b8e2-e7c869da70ab None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:12.707953 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:12.727167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a4f95-59a8-40f1-acc4-f30ce9d3cd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:12.727797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4f95-59a8-40f1-acc4-f30ce9d3cd61 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:12.728079 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4f95-59a8-40f1-acc4-f30ce9d3cd61 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:12.728392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4f95-59a8-40f1-acc4-f30ce9d3cd61 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:12.729177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a4f95-59a8-40f1-acc4-f30ce9d3cd61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:12.729495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a4f95-59a8-40f1-acc4-f30ce9d3cd61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:12.730924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a4f95-59a8-40f1-acc4-f30ce9d3cd61 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:12.733209 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f0950-ee60-4bb2-a511-7ef044807110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:12.733777 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f0950-ee60-4bb2-a511-7ef044807110 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:12.734065 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f0950-ee60-4bb2-a511-7ef044807110 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:12.734334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f0950-ee60-4bb2-a511-7ef044807110 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:12.735040 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f0950-ee60-4bb2-a511-7ef044807110 None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:12.735347 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f0950-ee60-4bb2-a511-7ef044807110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:12.737314 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f0950-ee60-4bb2-a511-7ef044807110 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:12.744152 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 281/572] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:12.745021 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a4f95-59a8-40f1-acc4-f30ce9d3cd61 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:12.753585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 292/573] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:12.753585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e77ac7-8a67-4833-b5ca-4bc791343590 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:12.753585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e77ac7-8a67-4833-b5ca-4bc791343590 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:12.753585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e77ac7-8a67-4833-b5ca-4bc791343590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:12.769884 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f4e77ac7-8a67-4833-b5ca-4bc791343590 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:12.771076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f4e77ac7-8a67-4833-b5ca-4bc791343590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:12.811516 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:12.837123 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 293/574] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:12.837972 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e77ac7-8a67-4833-b5ca-4bc791343590 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:12.849695 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a4f95-59a8-40f1-acc4-f30ce9d3cd61 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:12.884217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee92449-2004-4ccd-b38a-ec7120636ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:12.884891 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee92449-2004-4ccd-b38a-ec7120636ded None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:12.885141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee92449-2004-4ccd-b38a-ec7120636ded None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:12.885410 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee92449-2004-4ccd-b38a-ec7120636ded None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:12.886098 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee92449-2004-4ccd-b38a-ec7120636ded None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:12.886399 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee92449-2004-4ccd-b38a-ec7120636ded None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:12.887757 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee92449-2004-4ccd-b38a-ec7120636ded None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:12.899970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 282/575] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:12.900715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee92449-2004-4ccd-b38a-ec7120636ded None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:12.946608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:12.949767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e77ac7-8a67-4833-b5ca-4bc791343590 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:12.985302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892162a-298a-46e5-a6d5-04b1db649237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:12.985926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892162a-298a-46e5-a6d5-04b1db649237 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:12.986235 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892162a-298a-46e5-a6d5-04b1db649237 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:12.986511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892162a-298a-46e5-a6d5-04b1db649237 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:12.987206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892162a-298a-46e5-a6d5-04b1db649237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:12.987510 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892162a-298a-46e5-a6d5-04b1db649237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:12.988932 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892162a-298a-46e5-a6d5-04b1db649237 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:13.000858 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 294/576] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:13.001505 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892162a-298a-46e5-a6d5-04b1db649237 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:13.011073 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee92449-2004-4ccd-b38a-ec7120636ded None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:13.034258 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:13.045382 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e6f95-e1ea-4366-98c0-b46d98e632cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:13.046002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6f95-e1ea-4366-98c0-b46d98e632cd None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:13.046279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6f95-e1ea-4366-98c0-b46d98e632cd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:13.046550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6f95-e1ea-4366-98c0-b46d98e632cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:13.047328 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e6f95-e1ea-4366-98c0-b46d98e632cd None admin] RBAC: Adding query filter params (role.id=6f10ff8509da43688fba83e6a4fd5c5f, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=d77b4fcb974d48a0bda4852c8d304511) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:13.047634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e6f95-e1ea-4366-98c0-b46d98e632cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:13.049105 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e6f95-e1ea-4366-98c0-b46d98e632cd None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:13.054287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 283/577] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:12 2022] GET /identity/v3/role_assignments?user.id=d77b4fcb974d48a0bda4852c8d304511&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=6f10ff8509da43688fba83e6a4fd5c5f => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:13.055054 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e6f95-e1ea-4366-98c0-b46d98e632cd None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:13.111131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892162a-298a-46e5-a6d5-04b1db649237 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:13.149944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7d929-037d-43ec-a7db-7aa440603bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:13.150618 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7d929-037d-43ec-a7db-7aa440603bed None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:13.150903 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7d929-037d-43ec-a7db-7aa440603bed None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:13.151182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7d929-037d-43ec-a7db-7aa440603bed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:13.163974 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7d929-037d-43ec-a7db-7aa440603bed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:13.164309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e6f95-e1ea-4366-98c0-b46d98e632cd None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:13.165539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7d929-037d-43ec-a7db-7aa440603bed None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:13.183743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-4ce7d929-037d-43ec-a7db-7aa440603bed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:13.183743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:13.183743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:13.183743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:13.183743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:13.183743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:13.183743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:13.183743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:13.183743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:13.183743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:13.183743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:13.183743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:13.183743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:13.183743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:13.183743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:13.184716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:13.184716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:13.184716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:13.184716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:13.184716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:13.184716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:13.184716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:13.184716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:13.184716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:13.184716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:13.184716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:13.184716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:13.184716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:13.184716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:13.184716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:13.184716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:13.184716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:13.185943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:13.185943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:13.185943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:13.185943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:13.185943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 295/578] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:13.186264 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7d929-037d-43ec-a7db-7aa440603bed None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:13.205476 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:13.207682 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7cd1f0-2333-489c-a46b-64ab5730be0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:13.208339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cd1f0-2333-489c-a46b-64ab5730be0e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:13.208625 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cd1f0-2333-489c-a46b-64ab5730be0e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:13.209342 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cd1f0-2333-489c-a46b-64ab5730be0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:13.219767 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7cd1f0-2333-489c-a46b-64ab5730be0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:13.225614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-1c7cd1f0-2333-489c-a46b-64ab5730be0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:13.225614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:13.225614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:13.225614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:13.225614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:13.225614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:13.225614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:13.225614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:13.225614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:13.225614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:13.225614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:13.225614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:13.225614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:13.225614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:13.225614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:13.225614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:13.228862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:13.228862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:13.228862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:13.228862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:13.228862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:13.228862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:13.228862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:13.228862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:13.228862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:13.228862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:13.228862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:13.228862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:13.228862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:13.228862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:13.228862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:13.228862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:13.230905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:13.230905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:13.230905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:13.230905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:13.230905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:13.230905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:13.230905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:13.230905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:13.230905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:13.230905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:13.230905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:13.230905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:13.230905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 284/579] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:13.230905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7cd1f0-2333-489c-a46b-64ab5730be0e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:13.279558 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:13.298183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7d929-037d-43ec-a7db-7aa440603bed None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:13.334167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df9c55-0d1f-42fa-8793-d9ef7b714780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:13.337447 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df9c55-0d1f-42fa-8793-d9ef7b714780 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:13.337447 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df9c55-0d1f-42fa-8793-d9ef7b714780 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:13.337652 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7cd1f0-2333-489c-a46b-64ab5730be0e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:13.337733 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df9c55-0d1f-42fa-8793-d9ef7b714780 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:13.344885 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df9c55-0d1f-42fa-8793-d9ef7b714780 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:13.346390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df9c55-0d1f-42fa-8793-d9ef7b714780 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:13.359407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-d0df9c55-0d1f-42fa-8793-d9ef7b714780 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:13.359407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:13.359407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:13.359407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:13.359407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:13.359407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:13.359407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:13.359407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:13.359407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:13.359407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:13.359407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:13.359407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:13.359407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:13.359407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:13.359407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:13.360326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:13.360326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:13.360326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:13.360326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:13.360326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:13.360326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:13.360326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:13.360326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:13.360326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:13.360326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:13.360326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:13.360326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:13.360326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:13.360326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:13.360326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:13.360326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:13.360326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:13.361303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:13.361303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:13.361303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:13.361303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:13.361303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:13.361303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:13.361303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:13.361303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:13.364896 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 296/580] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:13.366459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df9c55-0d1f-42fa-8793-d9ef7b714780 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:13.377408 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c54ae-0784-4bfa-aaa3-8942569fa951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:13.378064 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c54ae-0784-4bfa-aaa3-8942569fa951 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:13.378345 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c54ae-0784-4bfa-aaa3-8942569fa951 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:13.378619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c54ae-0784-4bfa-aaa3-8942569fa951 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:13.386625 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c54ae-0784-4bfa-aaa3-8942569fa951 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:13.388070 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c54ae-0784-4bfa-aaa3-8942569fa951 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:13.400353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-ae3c54ae-0784-4bfa-aaa3-8942569fa951 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:45:13.400353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:13.400353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:13.400353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:13.400353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:13.400353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:13.400353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:13.400353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:13.400353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:13.400353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:13.400353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:13.400353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:13.400353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:13.400353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:13.400353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:13.400353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:13.401567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:13.401567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:13.401567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:13.401567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:13.401567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:13.401567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:13.401567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:13.401567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:13.401567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:13.401567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:13.401567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:13.401567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:13.401567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:13.401567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:13.401567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:13.401567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:13.401567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:13.401567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:13.402494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:13.402494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:13.402494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:13.402494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:13.402494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:13.402494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:13.402494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:13.402494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:13.402494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:45:13.402494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:13.402494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 285/581] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:45:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:13.402494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c54ae-0784-4bfa-aaa3-8942569fa951 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:13.445784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:13.475523 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df9c55-0d1f-42fa-8793-d9ef7b714780 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:13.512733 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c54ae-0784-4bfa-aaa3-8942569fa951 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:13.513677 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e712495-2dc4-4af3-95ef-f43306a333ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:13.514300 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e712495-2dc4-4af3-95ef-f43306a333ff None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:13.514578 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e712495-2dc4-4af3-95ef-f43306a333ff None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:13.514846 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e712495-2dc4-4af3-95ef-f43306a333ff None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:13.515538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e712495-2dc4-4af3-95ef-f43306a333ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:13.515841 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e712495-2dc4-4af3-95ef-f43306a333ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:13.517314 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e712495-2dc4-4af3-95ef-f43306a333ff None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:13.523296 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:13.534439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 297/582] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:13.534439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e712495-2dc4-4af3-95ef-f43306a333ff None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:13.560910 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcc461-fbb3-402b-b008-304055500f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:13.561695 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcc461-fbb3-402b-b008-304055500f87 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:13.561981 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcc461-fbb3-402b-b008-304055500f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:13.562260 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcc461-fbb3-402b-b008-304055500f87 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:13.562985 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcc461-fbb3-402b-b008-304055500f87 None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:13.563294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcc461-fbb3-402b-b008-304055500f87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:13.565243 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcc461-fbb3-402b-b008-304055500f87 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:13.573857 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 286/583] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:13.574670 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcc461-fbb3-402b-b008-304055500f87 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:13.647528 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e712495-2dc4-4af3-95ef-f43306a333ff None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:13.715582 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:13.719059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcc461-fbb3-402b-b008-304055500f87 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:13.721140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214ca9d-2748-47f1-b3f9-8948c5edb88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:13.722134 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214ca9d-2748-47f1-b3f9-8948c5edb88f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:13.722134 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214ca9d-2748-47f1-b3f9-8948c5edb88f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:13.749526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214ca9d-2748-47f1-b3f9-8948c5edb88f None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:13.749526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214ca9d-2748-47f1-b3f9-8948c5edb88f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:13.749526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214ca9d-2748-47f1-b3f9-8948c5edb88f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:13.749526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214ca9d-2748-47f1-b3f9-8948c5edb88f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:13.749526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 298/584] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:13.749526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214ca9d-2748-47f1-b3f9-8948c5edb88f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:13.763865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1ca0e-cbe3-46ca-b4c4-cead136c3245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:13.764845 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1ca0e-cbe3-46ca-b4c4-cead136c3245 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:13.765271 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1ca0e-cbe3-46ca-b4c4-cead136c3245 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:13.765672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1ca0e-cbe3-46ca-b4c4-cead136c3245 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:13.766628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1ca0e-cbe3-46ca-b4c4-cead136c3245 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:13.766942 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1ca0e-cbe3-46ca-b4c4-cead136c3245 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:13.769146 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1ca0e-cbe3-46ca-b4c4-cead136c3245 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:13.793842 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 287/585] 10.222.0.75 () {56 vars in 1137 bytes} [Thu Jul 28 17:45:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:13.794981 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1ca0e-cbe3-46ca-b4c4-cead136c3245 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:13.824329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:13.851498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214ca9d-2748-47f1-b3f9-8948c5edb88f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:13.885987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e456dc9-e75f-4761-87f1-dbe8780dcddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:13.886638 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e456dc9-e75f-4761-87f1-dbe8780dcddc None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:13.886920 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e456dc9-e75f-4761-87f1-dbe8780dcddc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:13.887198 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e456dc9-e75f-4761-87f1-dbe8780dcddc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:13.894844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e456dc9-e75f-4761-87f1-dbe8780dcddc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:13.895739 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1ca0e-cbe3-46ca-b4c4-cead136c3245 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:13.896316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e456dc9-e75f-4761-87f1-dbe8780dcddc None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:13.908239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-8e456dc9-e75f-4761-87f1-dbe8780dcddc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 17:45:13.908239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:13.908239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:13.908239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:13.908239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:13.908239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:13.908239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:13.908239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:13.908239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:13.908239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:13.908239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:13.908239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:13.908239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:13.908239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:13.908239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:13.908239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:13.909320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:13.909320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:13.909320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:13.909320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:13.909320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:13.909320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:13.909320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:13.909320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:13.909320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:13.909320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:13.909320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:13.909320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:13.909320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:13.909320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:13.909320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:13.909320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:13.909320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:13.909320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:13.910271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:13.910271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:13.910271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:13.910271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:13.910271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:13.910271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:13.910271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:13.910271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:13.910271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 17:45:13.910271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:13.910271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 299/586] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:45:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:13.910271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e456dc9-e75f-4761-87f1-dbe8780dcddc None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:13.936272 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b13ea-e633-452c-9e94-1ae44968e486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:13.937057 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b13ea-e633-452c-9e94-1ae44968e486 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:13.937406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b13ea-e633-452c-9e94-1ae44968e486 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:13.937750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b13ea-e633-452c-9e94-1ae44968e486 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:13.949036 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b13ea-e633-452c-9e94-1ae44968e486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:13.950550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b13ea-e633-452c-9e94-1ae44968e486 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:13.965281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-240b13ea-e633-452c-9e94-1ae44968e486 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:13.965281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:13.965281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:13.965281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:13.965281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:13.965281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:13.965281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:13.965281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:13.965281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:13.965281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:13.965281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:13.965281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:13.965281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:13.965281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:13.965281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:13.966394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:13.966394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:13.966394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:13.966394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:13.966394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:13.966394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:13.966394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:13.966394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:13.966394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:13.966394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:13.966394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:13.966394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:13.966394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:13.966394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:13.966394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:13.966394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:13.966394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:13.967273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:13.967273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:13.967273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:13.967273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:13.967273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 288/587] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:13.967273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b13ea-e633-452c-9e94-1ae44968e486 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:13.978642 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:14.041976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e456dc9-e75f-4761-87f1-dbe8780dcddc None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:14.064040 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:14.082048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cccfd8-ef16-42a4-a6bc-04e9e4596261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:14.082735 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cccfd8-ef16-42a4-a6bc-04e9e4596261 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:14.083021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cccfd8-ef16-42a4-a6bc-04e9e4596261 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:14.083457 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cccfd8-ef16-42a4-a6bc-04e9e4596261 None admin] PATH_INFO: `/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/c456a787159844feb7eabfd1e527e46e/roles/6f10ff8509da43688fba83e6a4fd5c5f` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:14.086722 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b13ea-e633-452c-9e94-1ae44968e486 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:14.102012 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cccfd8-ef16-42a4-a6bc-04e9e4596261 None admin] RBAC: Authorizing `identity:create_grant(project_id=883ec0c5aa374fbfbfc08eda6c626cfc, user_id=c456a787159844feb7eabfd1e527e46e, role_id=6f10ff8509da43688fba83e6a4fd5c5f)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:14.103505 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cccfd8-ef16-42a4-a6bc-04e9e4596261 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:14.129666 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd5580-9428-45d0-b577-e73faec5c761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:14.130315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd5580-9428-45d0-b577-e73faec5c761 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:14.130592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd5580-9428-45d0-b577-e73faec5c761 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:14.130869 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd5580-9428-45d0-b577-e73faec5c761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:14.141819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd5580-9428-45d0-b577-e73faec5c761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:14.143309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd5580-9428-45d0-b577-e73faec5c761 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:14.158257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-59bd5580-9428-45d0-b577-e73faec5c761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:14.158257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:14.158257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:14.158257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:14.158257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:14.158257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:14.158257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:14.158257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:14.158257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:14.158257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:14.158257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:14.158257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:14.158257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:14.158257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:14.158257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:14.159329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:14.159329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:14.159329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:14.159329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:14.159329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:14.159329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:14.159329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:14.159329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:14.159329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:14.159329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:14.159329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:14.159329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:14.159329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:14.159329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:14.159329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:14.159329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:14.159329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:14.160238 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:14.160238 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:14.160238 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:14.160238 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:14.160238 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 289/588] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:14.160870 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd5580-9428-45d0-b577-e73faec5c761 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:14.232791 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 300/589] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:45:13 2022] PUT /identity/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/c456a787159844feb7eabfd1e527e46e/roles/6f10ff8509da43688fba83e6a4fd5c5f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:45:14.232791 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cccfd8-ef16-42a4-a6bc-04e9e4596261 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:14.281909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd5580-9428-45d0-b577-e73faec5c761 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:14.326849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:14.334573 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394fdac-cfe3-4779-8d77-e40aa7f8de08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:14.336918 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394fdac-cfe3-4779-8d77-e40aa7f8de08 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:14.336918 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394fdac-cfe3-4779-8d77-e40aa7f8de08 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:14.336918 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394fdac-cfe3-4779-8d77-e40aa7f8de08 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:14.336918 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394fdac-cfe3-4779-8d77-e40aa7f8de08 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:14.336918 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394fdac-cfe3-4779-8d77-e40aa7f8de08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:14.344931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394fdac-cfe3-4779-8d77-e40aa7f8de08 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:14.365244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 290/590] 10.222.0.75 () {56 vars in 1137 bytes} [Thu Jul 28 17:45:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:14.366198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394fdac-cfe3-4779-8d77-e40aa7f8de08 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:14.366791 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cccfd8-ef16-42a4-a6bc-04e9e4596261 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:14.368863 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:14.415081 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c87f5a-f90b-4873-8ea6-782ea61863dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:14.415710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87f5a-f90b-4873-8ea6-782ea61863dc None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:14.415990 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87f5a-f90b-4873-8ea6-782ea61863dc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:14.416263 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87f5a-f90b-4873-8ea6-782ea61863dc None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:14.416999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c87f5a-f90b-4873-8ea6-782ea61863dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:14.417303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c87f5a-f90b-4873-8ea6-782ea61863dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:14.418891 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c87f5a-f90b-4873-8ea6-782ea61863dc None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:14.432222 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 301/591] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:14.433080 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c87f5a-f90b-4873-8ea6-782ea61863dc None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:14.510580 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394fdac-cfe3-4779-8d77-e40aa7f8de08 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:14.549197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c87f5a-f90b-4873-8ea6-782ea61863dc None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:14.555877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125a289-5b0c-458b-852c-a1823943a970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:14.556502 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125a289-5b0c-458b-852c-a1823943a970 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:14.556800 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125a289-5b0c-458b-852c-a1823943a970 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:14.557074 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125a289-5b0c-458b-852c-a1823943a970 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:14.558202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125a289-5b0c-458b-852c-a1823943a970 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:14.558508 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125a289-5b0c-458b-852c-a1823943a970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:14.560248 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125a289-5b0c-458b-852c-a1823943a970 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:14.574988 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 291/592] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:14.575902 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125a289-5b0c-458b-852c-a1823943a970 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:14.601111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4885b-8662-4f10-8251-b1727de5e1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:14.601744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4885b-8662-4f10-8251-b1727de5e1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:14.602024 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4885b-8662-4f10-8251-b1727de5e1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:14.602292 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4885b-8662-4f10-8251-b1727de5e1e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:14.619025 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4885b-8662-4f10-8251-b1727de5e1e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:14.620558 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4885b-8662-4f10-8251-b1727de5e1e9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:14.633303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:14.641605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-9cf4885b-8662-4f10-8251-b1727de5e1e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:14.641605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:14.641605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:14.641605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:14.641605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:14.641605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:14.641605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:14.641605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:14.641605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:14.641605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:14.641605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:14.641605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:14.641605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:14.641605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:14.641605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:14.642580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:14.642580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:14.642580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:14.642580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:14.642580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:14.642580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:14.642580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:14.642580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:14.642580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:14.642580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:14.642580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:14.642580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:14.642580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:14.642580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:14.642580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:14.642580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:14.642580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:14.644265 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:14.644265 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:14.644265 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:14.644265 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:14.644265 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 302/593] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:14.644893 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4885b-8662-4f10-8251-b1727de5e1e9 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:14.665525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:14.706100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125a289-5b0c-458b-852c-a1823943a970 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:14.753742 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37653c2-bc1f-4796-af2d-0553a2098ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:14.754249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4885b-8662-4f10-8251-b1727de5e1e9 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:14.754983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37653c2-bc1f-4796-af2d-0553a2098ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:14.755480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37653c2-bc1f-4796-af2d-0553a2098ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:14.756094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37653c2-bc1f-4796-af2d-0553a2098ec4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:14.766988 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37653c2-bc1f-4796-af2d-0553a2098ec4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:14.769406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37653c2-bc1f-4796-af2d-0553a2098ec4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:14.785634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-e37653c2-bc1f-4796-af2d-0553a2098ec4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 17:45:14.785634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:14.785634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:14.785634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:14.785634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:14.785634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:14.785634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:14.785634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:14.785634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:14.785634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:14.785634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:14.785634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:14.785634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:14.785634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:14.785634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:14.785634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:14.786618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:14.786618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:14.786618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:14.786618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:14.786618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:14.786618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:14.786618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:14.786618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:14.786618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:14.786618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:14.786618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:14.786618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:14.786618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:14.786618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:14.786618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:14.786618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:14.786618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:14.786618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:14.787534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:14.787534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:14.787534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:14.787534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:14.787534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:14.787534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:14.787534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:14.787534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:14.787534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 17:45:14.787534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:14.789940 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 292/594] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:14.790931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37653c2-bc1f-4796-af2d-0553a2098ec4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:14.797631 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ed6c6-1afe-49e3-a281-7a023a9c9d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:14.800531 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ed6c6-1afe-49e3-a281-7a023a9c9d47 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:14.801018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ed6c6-1afe-49e3-a281-7a023a9c9d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:14.801450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ed6c6-1afe-49e3-a281-7a023a9c9d47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:14.810450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ed6c6-1afe-49e3-a281-7a023a9c9d47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:14.812327 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ed6c6-1afe-49e3-a281-7a023a9c9d47 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:14.831522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-4a0ed6c6-1afe-49e3-a281-7a023a9c9d47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:14.831522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:14.831522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:14.831522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:14.831522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:14.831522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:14.831522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:14.831522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:14.831522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:14.831522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:14.831522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:14.831522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:14.831522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:14.831522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:14.831522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:14.840492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:14.840492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:14.840492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:14.840492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:14.840492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:14.840492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:14.840492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:14.840492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:14.840492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:14.840492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:14.840492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:14.840492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:14.840492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:14.840492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:14.840492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:14.840492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:14.840492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:14.841595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:14.841595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:14.841595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:14.841595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:14.841595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:14.841595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:14.841595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:14.841595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:14.841595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 303/595] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:14.842911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ed6c6-1afe-49e3-a281-7a023a9c9d47 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:14.929675 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37653c2-bc1f-4796-af2d-0553a2098ec4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:14.937982 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:14.945736 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:14.950361 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ed6c6-1afe-49e3-a281-7a023a9c9d47 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:14.973149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10ba97-0576-4928-a082-6dbc05f82eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:14.973923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10ba97-0576-4928-a082-6dbc05f82eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:14.974304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10ba97-0576-4928-a082-6dbc05f82eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:14.974679 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10ba97-0576-4928-a082-6dbc05f82eb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:14.975754 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10ba97-0576-4928-a082-6dbc05f82eb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:14.975880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10ba97-0576-4928-a082-6dbc05f82eb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:14.977450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10ba97-0576-4928-a082-6dbc05f82eb7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:14.992844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c044e2-f186-44da-b1fc-7d65f8f90f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:14.995967 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c044e2-f186-44da-b1fc-7d65f8f90f3e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:14.995967 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c044e2-f186-44da-b1fc-7d65f8f90f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:14.995967 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c044e2-f186-44da-b1fc-7d65f8f90f3e None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:14.996248 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 293/596] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:14.996438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c044e2-f186-44da-b1fc-7d65f8f90f3e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:14.996951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c044e2-f186-44da-b1fc-7d65f8f90f3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:14.997504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10ba97-0576-4928-a082-6dbc05f82eb7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:14.998867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c044e2-f186-44da-b1fc-7d65f8f90f3e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:15.025771 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 304/597] 10.222.0.75 () {56 vars in 1139 bytes} [Thu Jul 28 17:45:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:15.026939 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c044e2-f186-44da-b1fc-7d65f8f90f3e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:15.112811 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10ba97-0576-4928-a082-6dbc05f82eb7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:15.143585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c044e2-f186-44da-b1fc-7d65f8f90f3e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:15.149901 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459f0bc-d208-4059-b0f8-0e0b0a7e26e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:15.150529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459f0bc-d208-4059-b0f8-0e0b0a7e26e6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:15.150815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459f0bc-d208-4059-b0f8-0e0b0a7e26e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:15.151091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459f0bc-d208-4059-b0f8-0e0b0a7e26e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:15.151856 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459f0bc-d208-4059-b0f8-0e0b0a7e26e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:15.152169 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459f0bc-d208-4059-b0f8-0e0b0a7e26e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:15.153646 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459f0bc-d208-4059-b0f8-0e0b0a7e26e6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:15.166520 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 294/598] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:15.167478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459f0bc-d208-4059-b0f8-0e0b0a7e26e6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:15.176548 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:15.181592 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6b35c-aa76-4bc8-83d4-bba5c18abe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:15.182177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6b35c-aa76-4bc8-83d4-bba5c18abe42 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:15.182456 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6b35c-aa76-4bc8-83d4-bba5c18abe42 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:15.182728 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6b35c-aa76-4bc8-83d4-bba5c18abe42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:15.190936 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6b35c-aa76-4bc8-83d4-bba5c18abe42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:15.192386 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6b35c-aa76-4bc8-83d4-bba5c18abe42 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:15.199555 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:15.203686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-e3d6b35c-aa76-4bc8-83d4-bba5c18abe42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:15.203686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:15.203686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:15.203686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:15.203686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:15.203686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:15.203686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:15.203686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:15.203686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:15.203686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:15.203686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:15.203686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:15.203686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:15.203686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:15.203686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:15.205066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:15.205066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:15.205066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:15.205066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:15.205066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:15.205066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:15.205066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:15.205066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:15.205066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:15.205066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:15.205066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:15.205066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:15.205066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:15.205066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:15.205066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:15.205066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:15.205066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:15.205956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:15.205956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:15.205956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:15.205956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:15.205956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:15.205956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:15.205956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:15.205956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:15.205956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 305/599] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:15.207011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d4b91-122f-4bed-a89a-50ab1030a708 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:15.207117 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d4b91-122f-4bed-a89a-50ab1030a708 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:15.207348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d4b91-122f-4bed-a89a-50ab1030a708 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:15.212793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 306/600] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:15.213569 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d4b91-122f-4bed-a89a-50ab1030a708 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:15.280887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459f0bc-d208-4059-b0f8-0e0b0a7e26e6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:15.318602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb56bd-fd82-4976-a541-9fde529ba038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:15.319244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb56bd-fd82-4976-a541-9fde529ba038 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:15.319523 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb56bd-fd82-4976-a541-9fde529ba038 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:15.319791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb56bd-fd82-4976-a541-9fde529ba038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:15.320620 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d4b91-122f-4bed-a89a-50ab1030a708 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:15.330744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb56bd-fd82-4976-a541-9fde529ba038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:15.332198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb56bd-fd82-4976-a541-9fde529ba038 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:15.352273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-71fb56bd-fd82-4976-a541-9fde529ba038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:15.352273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:15.352273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:15.352273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:15.352273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:15.352273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:15.352273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:15.352273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:15.352273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:15.352273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:15.352273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:15.352273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:15.352273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:15.352273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:15.352273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:15.353198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:15.353198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:15.353198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:15.353198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:15.353198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:15.353198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:15.353198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:15.353198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:15.353198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:15.353198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:15.353198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:15.353198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:15.353198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:15.353198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:15.353198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:15.353198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:15.353198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:15.354070 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:15.354070 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:15.354070 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:15.354070 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:15.354070 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 295/601] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:15.354365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb56bd-fd82-4976-a541-9fde529ba038 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:15.365224 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2771f6c-3525-4af7-b30a-28eacb12dcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:15.365898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2771f6c-3525-4af7-b30a-28eacb12dcd3 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:15.366176 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2771f6c-3525-4af7-b30a-28eacb12dcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:15.366446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2771f6c-3525-4af7-b30a-28eacb12dcd3 None admin] PATH_INFO: `/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/be78ea573a674611807171c76f8003ce/roles/6f10ff8509da43688fba83e6a4fd5c5f` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:15.381535 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2771f6c-3525-4af7-b30a-28eacb12dcd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=883ec0c5aa374fbfbfc08eda6c626cfc, user_id=be78ea573a674611807171c76f8003ce, role_id=6f10ff8509da43688fba83e6a4fd5c5f)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:15.382996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2771f6c-3525-4af7-b30a-28eacb12dcd3 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:15.450701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:15.469454 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb56bd-fd82-4976-a541-9fde529ba038 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:15.502513 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd4588-db32-4920-b896-d9b6fbfa4fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:15.503129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd4588-db32-4920-b896-d9b6fbfa4fac None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:15.503416 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd4588-db32-4920-b896-d9b6fbfa4fac None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:15.503692 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd4588-db32-4920-b896-d9b6fbfa4fac None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:15.504443 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd4588-db32-4920-b896-d9b6fbfa4fac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:15.504773 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd4588-db32-4920-b896-d9b6fbfa4fac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:15.506281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd4588-db32-4920-b896-d9b6fbfa4fac None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:15.526788 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 296/602] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:15.528744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6beb6-c7c6-41a1-bf89-e0680c36ec75 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:15.529056 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6beb6-c7c6-41a1-bf89-e0680c36ec75 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:15.529334 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6beb6-c7c6-41a1-bf89-e0680c36ec75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:15.549006 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 307/603] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:45:15 2022] PUT /identity/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/be78ea573a674611807171c76f8003ce/roles/6f10ff8509da43688fba83e6a4fd5c5f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:45:15.549006 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2771f6c-3525-4af7-b30a-28eacb12dcd3 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:15.549483 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a0d6beb6-c7c6-41a1-bf89-e0680c36ec75 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:15.551711 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a0d6beb6-c7c6-41a1-bf89-e0680c36ec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:15.609965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:15.636812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 297/604] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:15.636812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6beb6-c7c6-41a1-bf89-e0680c36ec75 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:15.703391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2771f6c-3525-4af7-b30a-28eacb12dcd3 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:15.726652 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:15.750974 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a0d24-fa8f-410b-9f5b-c4cd665266c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:15.751645 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a0d24-fa8f-410b-9f5b-c4cd665266c5 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:15.752200 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a0d24-fa8f-410b-9f5b-c4cd665266c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:15.752489 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a0d24-fa8f-410b-9f5b-c4cd665266c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:15.753383 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a0d24-fa8f-410b-9f5b-c4cd665266c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:15.753697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a0d24-fa8f-410b-9f5b-c4cd665266c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:15.755703 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a0d24-fa8f-410b-9f5b-c4cd665266c5 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:15.763182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6beb6-c7c6-41a1-bf89-e0680c36ec75 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:15.771159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 308/605] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:15.772099 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a0d24-fa8f-410b-9f5b-c4cd665266c5 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:15.811324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a197666-3c51-4470-bff4-0607bf69ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:15.812072 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a197666-3c51-4470-bff4-0607bf69ef93 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:15.812362 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a197666-3c51-4470-bff4-0607bf69ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:15.812641 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a197666-3c51-4470-bff4-0607bf69ef93 None admin] PATH_INFO: `/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/1837a832a0da4d698984ce62057b81f4/roles/6f10ff8509da43688fba83e6a4fd5c5f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:15.833189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a197666-3c51-4470-bff4-0607bf69ef93 None admin] RBAC: Authorizing `identity:create_grant(project_id=883ec0c5aa374fbfbfc08eda6c626cfc, user_id=1837a832a0da4d698984ce62057b81f4, role_id=6f10ff8509da43688fba83e6a4fd5c5f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:15.835455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a197666-3c51-4470-bff4-0607bf69ef93 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:15.893510 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a0d24-fa8f-410b-9f5b-c4cd665266c5 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:15.895078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:15.928290 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508a1ed-2065-43f2-8aa5-13bd6c112c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:15.928971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508a1ed-2065-43f2-8aa5-13bd6c112c9b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:15.929281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508a1ed-2065-43f2-8aa5-13bd6c112c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:15.929558 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508a1ed-2065-43f2-8aa5-13bd6c112c9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:15.940551 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508a1ed-2065-43f2-8aa5-13bd6c112c9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:15.945608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-e508a1ed-2065-43f2-8aa5-13bd6c112c9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:15.945608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:15.945608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:15.945608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:15.945608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:15.945608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:15.945608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:15.945608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:15.945608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:15.945608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:15.945608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:15.945608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:15.945608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:15.945608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:15.945608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:15.945608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:15.947681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:15.947681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:15.947681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:15.947681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:15.947681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:15.947681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:15.947681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:15.947681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:15.947681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:15.947681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:15.947681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:15.947681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:15.947681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:15.947681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:15.947681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:15.947681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:15.949237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:15.949237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:15.949237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:15.949237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:15.949237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:15.949237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:15.949237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:15.949237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:15.949237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:15.949237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:15.949237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:15.949237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:15.949237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 309/606] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:15.949237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508a1ed-2065-43f2-8aa5-13bd6c112c9b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:16.001923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 298/607] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:45:15 2022] PUT /identity/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/1837a832a0da4d698984ce62057b81f4/roles/6f10ff8509da43688fba83e6a4fd5c5f => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:45:16.001923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a197666-3c51-4470-bff4-0607bf69ef93 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:16.105223 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508a1ed-2065-43f2-8aa5-13bd6c112c9b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:16.149915 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb30edd-4900-46b6-b322-0696d713c5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:16.151164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb30edd-4900-46b6-b322-0696d713c5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:16.151621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb30edd-4900-46b6-b322-0696d713c5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:16.152060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb30edd-4900-46b6-b322-0696d713c5c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:16.160995 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb30edd-4900-46b6-b322-0696d713c5c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:16.163553 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb30edd-4900-46b6-b322-0696d713c5c0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:16.178331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-bbb30edd-4900-46b6-b322-0696d713c5c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:16.178331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:16.178331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:16.178331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:16.178331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:16.178331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:16.178331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:16.178331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:16.178331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:16.178331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:16.178331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:16.178331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:16.178331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:16.178331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:16.178331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:16.179470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:16.179470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:16.179470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:16.179470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:16.179470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:16.179470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:16.179470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:16.179470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:16.179470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:16.179470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:16.179470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:16.179470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:16.179470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:16.179470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:16.179470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:16.179470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:16.179470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:16.180516 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:16.180516 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:16.180516 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:16.180516 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:16.180516 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:16.180516 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:16.180516 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:16.180516 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:16.182826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 310/608] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:16.188028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb30edd-4900-46b6-b322-0696d713c5c0 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:16.223352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a197666-3c51-4470-bff4-0607bf69ef93 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:16.225115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:16.264954 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:16.297701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46163a-1c71-4e62-a51f-e8c81cfc3ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:16.299116 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46163a-1c71-4e62-a51f-e8c81cfc3ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:16.299525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46163a-1c71-4e62-a51f-e8c81cfc3ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:16.299912 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46163a-1c71-4e62-a51f-e8c81cfc3ee5 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:16.300864 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46163a-1c71-4e62-a51f-e8c81cfc3ee5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:16.301278 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46163a-1c71-4e62-a51f-e8c81cfc3ee5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:16.302805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46163a-1c71-4e62-a51f-e8c81cfc3ee5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:16.328736 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 299/609] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:16.334151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46163a-1c71-4e62-a51f-e8c81cfc3ee5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:16.354924 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb30edd-4900-46b6-b322-0696d713c5c0 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:16.408869 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902825e-9c8c-4bc6-b4e2-3fc9d2ea2b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:16.409672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902825e-9c8c-4bc6-b4e2-3fc9d2ea2b32 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:16.410124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902825e-9c8c-4bc6-b4e2-3fc9d2ea2b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:16.410495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902825e-9c8c-4bc6-b4e2-3fc9d2ea2b32 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:16.411490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902825e-9c8c-4bc6-b4e2-3fc9d2ea2b32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:16.411922 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902825e-9c8c-4bc6-b4e2-3fc9d2ea2b32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:16.413556 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902825e-9c8c-4bc6-b4e2-3fc9d2ea2b32 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:16.429608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 311/610] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:16.431215 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600fe0c-48ea-43cd-b5a8-701a365c9d2c None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:16.431693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600fe0c-48ea-43cd-b5a8-701a365c9d2c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:16.432073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600fe0c-48ea-43cd-b5a8-701a365c9d2c None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:16.433786 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 312/611] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:16.435494 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600fe0c-48ea-43cd-b5a8-701a365c9d2c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:16.489423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46163a-1c71-4e62-a51f-e8c81cfc3ee5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:16.536951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:16.537231 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73843402-a286-47df-a3ab-e9ef4f392d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:16.539068 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73843402-a286-47df-a3ab-e9ef4f392d19 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:16.539354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73843402-a286-47df-a3ab-e9ef4f392d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:16.539848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73843402-a286-47df-a3ab-e9ef4f392d19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:16.556430 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73843402-a286-47df-a3ab-e9ef4f392d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:16.558839 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73843402-a286-47df-a3ab-e9ef4f392d19 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:16.562347 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600fe0c-48ea-43cd-b5a8-701a365c9d2c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:16.578242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-73843402-a286-47df-a3ab-e9ef4f392d19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:16.578242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:16.578242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:16.578242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:16.578242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:16.578242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:16.578242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:16.578242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:16.578242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:16.578242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:16.578242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:16.578242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:16.578242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:16.578242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:16.578242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:16.579315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:16.579315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:16.579315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:16.579315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:16.579315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:16.579315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:16.579315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:16.579315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:16.579315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:16.579315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:16.579315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:16.579315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:16.579315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:16.579315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:16.579315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:16.579315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:16.579315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:16.580507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:16.580507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:16.580507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:16.580507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:16.586893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 300/612] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:16.586893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a8563-c56a-40c6-baa7-508cd3c11ef7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:16.586893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a8563-c56a-40c6-baa7-508cd3c11ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:16.586893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a8563-c56a-40c6-baa7-508cd3c11ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:16.606144 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d94b3f-37ae-43f8-8283-3463db656a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:16.606887 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d94b3f-37ae-43f8-8283-3463db656a79 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:16.607170 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d94b3f-37ae-43f8-8283-3463db656a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:16.607499 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d94b3f-37ae-43f8-8283-3463db656a79 None admin] PATH_INFO: `/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/d0e56603b8704cb2b5587313c67254a9/roles/6f10ff8509da43688fba83e6a4fd5c5f` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:16.615168 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d94a8563-c56a-40c6-baa7-508cd3c11ef7 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:16.616663 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d94a8563-c56a-40c6-baa7-508cd3c11ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:16.626798 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d94b3f-37ae-43f8-8283-3463db656a79 None admin] RBAC: Authorizing `identity:create_grant(project_id=883ec0c5aa374fbfbfc08eda6c626cfc, user_id=d0e56603b8704cb2b5587313c67254a9, role_id=6f10ff8509da43688fba83e6a4fd5c5f)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:16.628402 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d94b3f-37ae-43f8-8283-3463db656a79 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:16.649200 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:16.689038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 301/613] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:16.690087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a8563-c56a-40c6-baa7-508cd3c11ef7 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:16.718451 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 313/614] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:45:16 2022] PUT /identity/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/d0e56603b8704cb2b5587313c67254a9/roles/6f10ff8509da43688fba83e6a4fd5c5f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:45:16.719616 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d94b3f-37ae-43f8-8283-3463db656a79 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:16.867760 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d94b3f-37ae-43f8-8283-3463db656a79 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:16.902369 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:16.908898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7676f3-a2b1-49e4-b0f2-68a159233bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:16.909690 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7676f3-a2b1-49e4-b0f2-68a159233bfa None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:16.909975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7676f3-a2b1-49e4-b0f2-68a159233bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:16.910257 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7676f3-a2b1-49e4-b0f2-68a159233bfa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:16.914789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a8563-c56a-40c6-baa7-508cd3c11ef7 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:16.921846 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7676f3-a2b1-49e4-b0f2-68a159233bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:16.927107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-6a7676f3-a2b1-49e4-b0f2-68a159233bfa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:16.927107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:16.927107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:16.927107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:16.927107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:16.927107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:16.927107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:16.927107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:16.927107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:16.927107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:16.927107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:16.927107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:16.927107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:16.927107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:16.927107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:16.927107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:16.928076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:16.928076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:16.928076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:16.928076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:16.928076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:16.928076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:16.928076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:16.928076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:16.928076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:16.928076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:16.928076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:16.928076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:16.928076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:16.928076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:16.928076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:16.928076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:16.929419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:16.929419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:16.929419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:16.929419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:16.929419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:16.929419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:16.929419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:16.929419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:16.929419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:16.929419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:16.929419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:16.929419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:16.929419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 314/615] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:16.938421 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7676f3-a2b1-49e4-b0f2-68a159233bfa None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:16.968457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f2558-9e5e-4cc1-9a68-8bb2eaeecb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:16.969135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f2558-9e5e-4cc1-9a68-8bb2eaeecb34 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:16.969401 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f2558-9e5e-4cc1-9a68-8bb2eaeecb34 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:16.969673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f2558-9e5e-4cc1-9a68-8bb2eaeecb34 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:16.971009 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f2558-9e5e-4cc1-9a68-8bb2eaeecb34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:16.971382 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f2558-9e5e-4cc1-9a68-8bb2eaeecb34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:16.973349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f2558-9e5e-4cc1-9a68-8bb2eaeecb34 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:16.986508 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 302/616] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:16.991576 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f2558-9e5e-4cc1-9a68-8bb2eaeecb34 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:17.037643 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:17.090231 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7676f3-a2b1-49e4-b0f2-68a159233bfa None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:17.155925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5b161-2b62-47d1-84e5-a3ed0a54807c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:17.156841 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5b161-2b62-47d1-84e5-a3ed0a54807c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:17.157342 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5b161-2b62-47d1-84e5-a3ed0a54807c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:17.157862 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5b161-2b62-47d1-84e5-a3ed0a54807c None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:17.158959 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5b161-2b62-47d1-84e5-a3ed0a54807c None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:17.159487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5b161-2b62-47d1-84e5-a3ed0a54807c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:17.164045 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5b161-2b62-47d1-84e5-a3ed0a54807c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:17.183107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 315/617] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:17.185161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5b161-2b62-47d1-84e5-a3ed0a54807c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:17.194708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f2558-9e5e-4cc1-9a68-8bb2eaeecb34 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:17.269175 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:17.269558 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b267fc3-1245-41cf-9597-f27f4c46791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:17.270223 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b267fc3-1245-41cf-9597-f27f4c46791e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:17.270509 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b267fc3-1245-41cf-9597-f27f4c46791e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:17.270786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b267fc3-1245-41cf-9597-f27f4c46791e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:17.284974 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b267fc3-1245-41cf-9597-f27f4c46791e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:17.286429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b267fc3-1245-41cf-9597-f27f4c46791e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:17.305012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-0b267fc3-1245-41cf-9597-f27f4c46791e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:45:17.305012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:17.305012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:17.305012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:17.305012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:17.305012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:17.305012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:17.305012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:17.305012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:17.305012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:17.305012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:17.305012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:17.305012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:17.305012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:17.305012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:17.305012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:17.306212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:17.306212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:17.306212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:17.306212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:17.306212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:17.306212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:17.306212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:17.306212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:17.306212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:17.306212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:17.306212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:17.306212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:17.306212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:17.306212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:17.306212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:17.306212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:17.306212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:17.306212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:17.307314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:17.307314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:17.307314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:17.307314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:17.307314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:17.307314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:17.307314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:17.307314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:17.307314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:45:17.307314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:17.307314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 303/618] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:45:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:17.312762 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b267fc3-1245-41cf-9597-f27f4c46791e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:17.365422 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5b161-2b62-47d1-84e5-a3ed0a54807c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:17.461825 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:17.462483 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b33232-a9d9-4f1d-b458-a78e939fb0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:17.463113 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b33232-a9d9-4f1d-b458-a78e939fb0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:17.463393 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b33232-a9d9-4f1d-b458-a78e939fb0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:17.463667 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b33232-a9d9-4f1d-b458-a78e939fb0e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:17.486749 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b33232-a9d9-4f1d-b458-a78e939fb0e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:17.488228 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b33232-a9d9-4f1d-b458-a78e939fb0e4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:17.491329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b267fc3-1245-41cf-9597-f27f4c46791e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:17.518747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-b8b33232-a9d9-4f1d-b458-a78e939fb0e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:17.518747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:17.518747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:17.518747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:17.518747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:17.518747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:17.518747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:17.518747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:17.518747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:17.518747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:17.518747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:17.518747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:17.518747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:17.518747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:17.518747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:17.519723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:17.519723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:17.519723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:17.519723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:17.519723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:17.519723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:17.519723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:17.519723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:17.519723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:17.519723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:17.519723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:17.519723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:17.519723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:17.519723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:17.519723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:17.519723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:17.519723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:17.520634 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:17.520634 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:17.520634 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:17.520634 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:17.523339 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 316/619] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:17.529046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b33232-a9d9-4f1d-b458-a78e939fb0e4 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:17.557626 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be43e5-2d85-4f78-819a-2931393ea5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:17.558293 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be43e5-2d85-4f78-819a-2931393ea5bf None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:17.558740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be43e5-2d85-4f78-819a-2931393ea5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:17.559012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be43e5-2d85-4f78-819a-2931393ea5bf None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:17.559824 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be43e5-2d85-4f78-819a-2931393ea5bf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:17.560133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be43e5-2d85-4f78-819a-2931393ea5bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:17.561604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be43e5-2d85-4f78-819a-2931393ea5bf None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:17.582420 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 304/620] 10.222.0.75 () {56 vars in 1135 bytes} [Thu Jul 28 17:45:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:17.589701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be43e5-2d85-4f78-819a-2931393ea5bf None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:17.707995 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b33232-a9d9-4f1d-b458-a78e939fb0e4 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:17.717070 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:17.771990 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be43e5-2d85-4f78-819a-2931393ea5bf None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:17.774958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934f090-3a56-4d9f-a50a-4cd10ef66822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:17.775611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934f090-3a56-4d9f-a50a-4cd10ef66822 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:17.775888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934f090-3a56-4d9f-a50a-4cd10ef66822 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:17.776159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934f090-3a56-4d9f-a50a-4cd10ef66822 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:17.776913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934f090-3a56-4d9f-a50a-4cd10ef66822 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:17.777324 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934f090-3a56-4d9f-a50a-4cd10ef66822 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:17.778806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934f090-3a56-4d9f-a50a-4cd10ef66822 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:17.808040 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 317/621] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:17.810597 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934f090-3a56-4d9f-a50a-4cd10ef66822 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:17.842802 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2cb7b-e3c1-452a-b6f3-0a983f9e1382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:17.843458 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2cb7b-e3c1-452a-b6f3-0a983f9e1382 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:17.843737 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2cb7b-e3c1-452a-b6f3-0a983f9e1382 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:17.844012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2cb7b-e3c1-452a-b6f3-0a983f9e1382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:17.862914 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2cb7b-e3c1-452a-b6f3-0a983f9e1382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:17.864372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2cb7b-e3c1-452a-b6f3-0a983f9e1382 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:17.888659 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:17.896131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-17d2cb7b-e3c1-452a-b6f3-0a983f9e1382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:17.896131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:17.896131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:17.896131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:17.896131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:17.896131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:17.896131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:17.896131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:17.896131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:17.896131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:17.896131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:17.896131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:17.896131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:17.896131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:17.896131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:17.897046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:17.897046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:17.897046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:17.897046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:17.897046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:17.897046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:17.897046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:17.897046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:17.897046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:17.897046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:17.897046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:17.897046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:17.897046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:17.897046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:17.897046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:17.897046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:17.897046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:17.897928 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:17.897928 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:17.897928 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:17.897928 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:17.897928 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 305/622] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:17.899716 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e2ba6-10e7-4905-a198-6d145639d89c None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:17.900001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e2ba6-10e7-4905-a198-6d145639d89c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:17.900281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e2ba6-10e7-4905-a198-6d145639d89c None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:17.901823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 306/623] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:17.903282 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e2ba6-10e7-4905-a198-6d145639d89c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:17.965780 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934f090-3a56-4d9f-a50a-4cd10ef66822 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:18.009177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c65c9-1981-4d6c-b9ad-1fe5117d15df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:18.009759 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c65c9-1981-4d6c-b9ad-1fe5117d15df None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:18.010041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c65c9-1981-4d6c-b9ad-1fe5117d15df None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:18.010315 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c65c9-1981-4d6c-b9ad-1fe5117d15df None admin] PATH_INFO: `/v3/users/nova` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:18.019937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c65c9-1981-4d6c-b9ad-1fe5117d15df None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:18.021147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c65c9-1981-4d6c-b9ad-1fe5117d15df None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:18.036788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-093c65c9-1981-4d6c-b9ad-1fe5117d15df None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:45:18.036788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:18.036788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:18.036788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:18.036788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:18.036788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:18.036788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:18.036788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:18.036788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:18.036788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:18.036788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:18.036788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:18.036788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:18.036788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:18.036788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:18.036788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:18.038736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:18.038736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:18.038736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:18.038736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:18.038736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:18.038736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:18.038736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:18.038736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:18.038736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:18.038736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:18.038736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:18.038736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:18.038736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:18.038736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:18.038736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:18.038736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:18.038736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:18.038736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:18.040977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:18.040977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:18.040977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:18.040977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:18.040977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:18.040977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:18.040977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:18.040977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:18.040977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:45:18.040977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:18.040977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 318/624] 10.222.0.75 () {56 vars in 1093 bytes} [Thu Jul 28 17:45:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:18.040977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9351b-49b8-40da-b6e0-83bf0818394d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:18.042463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9351b-49b8-40da-b6e0-83bf0818394d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:18.042463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9351b-49b8-40da-b6e0-83bf0818394d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:18.047886 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e2ba6-10e7-4905-a198-6d145639d89c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:18.062679 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c2c9351b-49b8-40da-b6e0-83bf0818394d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:18.064145 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c2c9351b-49b8-40da-b6e0-83bf0818394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:18.088980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:18.089181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75bfd2-02b9-49d3-bea5-cad55cd2b68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:18.090550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75bfd2-02b9-49d3-bea5-cad55cd2b68a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:18.090847 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75bfd2-02b9-49d3-bea5-cad55cd2b68a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:18.091125 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75bfd2-02b9-49d3-bea5-cad55cd2b68a None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:18.091839 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75bfd2-02b9-49d3-bea5-cad55cd2b68a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:18.092445 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75bfd2-02b9-49d3-bea5-cad55cd2b68a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:18.094027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75bfd2-02b9-49d3-bea5-cad55cd2b68a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:18.110177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 307/625] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:18.116568 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75bfd2-02b9-49d3-bea5-cad55cd2b68a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:18.153183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 319/626] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:18.154814 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9351b-49b8-40da-b6e0-83bf0818394d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:18.181792 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:18.228591 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75bfd2-02b9-49d3-bea5-cad55cd2b68a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:18.265681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71395674-0b54-450a-b831-864b14d54488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:18.266524 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71395674-0b54-450a-b831-864b14d54488 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:18.267508 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71395674-0b54-450a-b831-864b14d54488 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:18.267935 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71395674-0b54-450a-b831-864b14d54488 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:18.269465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71395674-0b54-450a-b831-864b14d54488 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:18.269919 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71395674-0b54-450a-b831-864b14d54488 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:18.272071 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71395674-0b54-450a-b831-864b14d54488 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:18.292339 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9351b-49b8-40da-b6e0-83bf0818394d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:18.294253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 308/627] 10.222.0.75 () {56 vars in 1133 bytes} [Thu Jul 28 17:45:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:18.295272 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71395674-0b54-450a-b831-864b14d54488 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:18.338945 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b583842-d3f4-47da-801f-1876888f5fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:18.340107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b583842-d3f4-47da-801f-1876888f5fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:18.340386 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b583842-d3f4-47da-801f-1876888f5fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:18.342655 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b583842-d3f4-47da-801f-1876888f5fa2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:18.349909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b583842-d3f4-47da-801f-1876888f5fa2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:18.351390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b583842-d3f4-47da-801f-1876888f5fa2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:18.362647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-5b583842-d3f4-47da-801f-1876888f5fa2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:18.362647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:18.362647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:18.362647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:18.362647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:18.362647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:18.362647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:18.362647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:18.362647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:18.362647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:18.362647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:18.362647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:18.362647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:18.362647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:18.362647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:18.363572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:18.363572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:18.363572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:18.363572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:18.363572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:18.363572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:18.363572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:18.363572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:18.363572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:18.363572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:18.363572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:18.363572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:18.363572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:18.363572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:18.363572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:18.363572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:18.363572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:18.364458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:18.364458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:18.364458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:18.364458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:18.364458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:18.364458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:18.364458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:18.364458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:18.364458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 320/628] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:18.365034 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b583842-d3f4-47da-801f-1876888f5fa2 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:18.382801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:18.415999 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71395674-0b54-450a-b831-864b14d54488 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:18.430129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:18.452000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356e9e0-91ae-4611-92cf-55cf3fa7c589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:18.452943 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356e9e0-91ae-4611-92cf-55cf3fa7c589 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:18.453229 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356e9e0-91ae-4611-92cf-55cf3fa7c589 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:18.453509 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356e9e0-91ae-4611-92cf-55cf3fa7c589 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:18.464912 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356e9e0-91ae-4611-92cf-55cf3fa7c589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:18.469826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-7356e9e0-91ae-4611-92cf-55cf3fa7c589 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:18.469826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:18.469826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:18.469826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:18.469826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:18.469826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:18.469826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:18.469826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:18.469826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:18.469826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:18.469826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:18.469826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:18.469826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:18.469826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:18.469826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:18.469826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:18.471346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:18.471346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:18.471346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:18.471346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:18.471346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:18.471346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:18.471346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:18.471346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:18.471346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:18.471346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:18.471346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:18.471346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:18.471346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:18.471346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:18.471346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:18.471346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:18.472194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:18.472194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:18.472194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:18.472194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:18.472194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:18.472194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:18.472194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:18.472194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:18.472194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:18.472194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:18.472194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:18.472194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:18.472194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 309/629] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:18.472932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b8317-318d-4477-abf4-1c58a679a807 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:18.473003 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b8317-318d-4477-abf4-1c58a679a807 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:18.473471 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b8317-318d-4477-abf4-1c58a679a807 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:18.474673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 310/630] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:18.479093 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b8317-318d-4477-abf4-1c58a679a807 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:18.486431 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b583842-d3f4-47da-801f-1876888f5fa2 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:18.529358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a8575-049a-41ea-9a84-fddc2509fc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:18.529915 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a8575-049a-41ea-9a84-fddc2509fc62 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:18.530240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a8575-049a-41ea-9a84-fddc2509fc62 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:18.530568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a8575-049a-41ea-9a84-fddc2509fc62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:18.590224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b8317-318d-4477-abf4-1c58a679a807 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:18.604843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a8575-049a-41ea-9a84-fddc2509fc62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:18.606336 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a8575-049a-41ea-9a84-fddc2509fc62 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:18.624117 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:18.629009 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f571f-805b-4f36-8c8a-ed7c30942953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:18.629641 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f571f-805b-4f36-8c8a-ed7c30942953 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:18.629922 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f571f-805b-4f36-8c8a-ed7c30942953 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:18.630193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f571f-805b-4f36-8c8a-ed7c30942953 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:18.630951 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f571f-805b-4f36-8c8a-ed7c30942953 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:18.631321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f571f-805b-4f36-8c8a-ed7c30942953 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:18.632785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f571f-805b-4f36-8c8a-ed7c30942953 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:18.650619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 311/631] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:18.650619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f571f-805b-4f36-8c8a-ed7c30942953 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:18.682946 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:18.719437 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 321/632] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:18.720965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d42f6c-675c-4c50-b02a-6701be2b42e2 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:18.721265 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d42f6c-675c-4c50-b02a-6701be2b42e2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:18.721538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d42f6c-675c-4c50-b02a-6701be2b42e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:18.740194 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-74d42f6c-675c-4c50-b02a-6701be2b42e2 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:18.741510 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-74d42f6c-675c-4c50-b02a-6701be2b42e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:18.755360 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f571f-805b-4f36-8c8a-ed7c30942953 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:18.794117 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5f919-b97c-40fd-8936-3b7a22a1d253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:18.794701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5f919-b97c-40fd-8936-3b7a22a1d253 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:18.795071 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5f919-b97c-40fd-8936-3b7a22a1d253 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:18.795362 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5f919-b97c-40fd-8936-3b7a22a1d253 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:18.796342 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5f919-b97c-40fd-8936-3b7a22a1d253 None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:18.796452 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5f919-b97c-40fd-8936-3b7a22a1d253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:18.797828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5f919-b97c-40fd-8936-3b7a22a1d253 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:18.807248 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 312/633] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:18.808366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5f919-b97c-40fd-8936-3b7a22a1d253 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:18.822899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 322/634] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:18.823989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d42f6c-675c-4c50-b02a-6701be2b42e2 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:18.874265 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:18.922195 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:18.928980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d42f6c-675c-4c50-b02a-6701be2b42e2 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:18.931516 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5f919-b97c-40fd-8936-3b7a22a1d253 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:18.965367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc46cbc-71db-43e5-87bf-a1dcd1ee3d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:18.966021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc46cbc-71db-43e5-87bf-a1dcd1ee3d3e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:18.966303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc46cbc-71db-43e5-87bf-a1dcd1ee3d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:18.966585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc46cbc-71db-43e5-87bf-a1dcd1ee3d3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:18.968086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120eaa9-3006-459f-b011-9959e5ad0648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:18.968773 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120eaa9-3006-459f-b011-9959e5ad0648 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:18.969081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120eaa9-3006-459f-b011-9959e5ad0648 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:18.969357 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120eaa9-3006-459f-b011-9959e5ad0648 None admin] PATH_INFO: `/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/d77b4fcb974d48a0bda4852c8d304511/roles/6f10ff8509da43688fba83e6a4fd5c5f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:18.976975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc46cbc-71db-43e5-87bf-a1dcd1ee3d3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:18.978451 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc46cbc-71db-43e5-87bf-a1dcd1ee3d3e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:18.984541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120eaa9-3006-459f-b011-9959e5ad0648 None admin] RBAC: Authorizing `identity:create_grant(project_id=883ec0c5aa374fbfbfc08eda6c626cfc, user_id=d77b4fcb974d48a0bda4852c8d304511, role_id=6f10ff8509da43688fba83e6a4fd5c5f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:18.986553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120eaa9-3006-459f-b011-9959e5ad0648 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:18.994299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-0cc46cbc-71db-43e5-87bf-a1dcd1ee3d3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:18.994299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:18.994299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:18.994299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:18.994299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:18.994299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:18.994299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:18.994299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:18.994299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:18.994299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:18.994299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:18.994299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:18.994299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:18.994299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:18.994299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:18.995302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:18.995302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:18.995302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:18.995302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:18.995302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:18.995302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:18.995302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:18.995302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:18.995302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:18.995302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:18.995302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:18.995302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:18.995302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:18.995302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:18.995302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:18.995302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:18.995302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:18.996174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:18.996174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:18.996174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:18.996174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:18.996174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 323/635] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:18.996462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc46cbc-71db-43e5-87bf-a1dcd1ee3d3e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:19.089579 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:19.093210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc46cbc-71db-43e5-87bf-a1dcd1ee3d3e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:19.099007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 313/636] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:45:18 2022] PUT /identity/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/d77b4fcb974d48a0bda4852c8d304511/roles/6f10ff8509da43688fba83e6a4fd5c5f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:45:19.105078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120eaa9-3006-459f-b011-9959e5ad0648 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:19.130852 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29896a5b-d745-492b-a3f7-151f66a08bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:19.131630 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29896a5b-d745-492b-a3f7-151f66a08bae None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:19.131914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29896a5b-d745-492b-a3f7-151f66a08bae None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:19.132228 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29896a5b-d745-492b-a3f7-151f66a08bae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:19.146012 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29896a5b-d745-492b-a3f7-151f66a08bae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:19.147577 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29896a5b-d745-492b-a3f7-151f66a08bae None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:19.164818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-29896a5b-d745-492b-a3f7-151f66a08bae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:19.164818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:19.164818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:19.164818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:19.164818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:19.164818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:19.164818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:19.164818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:19.164818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:19.164818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:19.164818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:19.164818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:19.164818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:19.164818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:19.164818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:19.165951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:19.165951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:19.165951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:19.165951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:19.165951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:19.165951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:19.165951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:19.165951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:19.165951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:19.165951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:19.165951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:19.165951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:19.165951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:19.165951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:19.165951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:19.165951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:19.165951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:19.167015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:19.167015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:19.167015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:19.167015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:19.169323 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 324/637] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:19.171074 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbe42d-63bb-4150-9e60-47907dac209b None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:19.171533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbe42d-63bb-4150-9e60-47907dac209b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:19.172035 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbe42d-63bb-4150-9e60-47907dac209b None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:19.177007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 325/638] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:19.177007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbe42d-63bb-4150-9e60-47907dac209b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:19.245806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120eaa9-3006-459f-b011-9959e5ad0648 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:19.290412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8a9a2-94ef-402b-87a4-d754fb7cd645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:19.291071 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8a9a2-94ef-402b-87a4-d754fb7cd645 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:19.291358 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8a9a2-94ef-402b-87a4-d754fb7cd645 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:19.291634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8a9a2-94ef-402b-87a4-d754fb7cd645 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:19.302401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbe42d-63bb-4150-9e60-47907dac209b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:19.302873 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8a9a2-94ef-402b-87a4-d754fb7cd645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:19.307728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-5bd8a9a2-94ef-402b-87a4-d754fb7cd645 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:19.307728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:19.307728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:19.307728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:19.307728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:19.307728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:19.307728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:19.307728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:19.307728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:19.307728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:19.307728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:19.307728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:19.307728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:19.307728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:19.307728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:19.307728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:19.308844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:19.308844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:19.308844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:19.308844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:19.308844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:19.308844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:19.308844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:19.308844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:19.308844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:19.308844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:19.308844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:19.308844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:19.308844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:19.308844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:19.308844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:19.308844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:19.309819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:19.309819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:19.309819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:19.309819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:19.309819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:19.309819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:19.309819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:19.309819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:19.309819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:19.309819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:19.309819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:19.309819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:19.309819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 314/639] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:19.309819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8a9a2-94ef-402b-87a4-d754fb7cd645 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:19.315326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:19.346730 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8862c7f-2398-4506-9ab8-ede50387c06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:19.347345 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8862c7f-2398-4506-9ab8-ede50387c06d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:19.347633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8862c7f-2398-4506-9ab8-ede50387c06d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:19.347913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8862c7f-2398-4506-9ab8-ede50387c06d None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:19.348646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8862c7f-2398-4506-9ab8-ede50387c06d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:19.349132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8862c7f-2398-4506-9ab8-ede50387c06d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:19.350570 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8862c7f-2398-4506-9ab8-ede50387c06d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:19.363945 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 326/640] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:19.365571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dcb1c-99f6-4be4-8574-280b74e90252 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:19.365859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dcb1c-99f6-4be4-8574-280b74e90252 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:19.366137 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dcb1c-99f6-4be4-8574-280b74e90252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:19.385877 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b12dcb1c-99f6-4be4-8574-280b74e90252 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:19.387083 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b12dcb1c-99f6-4be4-8574-280b74e90252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:19.390397 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:19.426594 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8a9a2-94ef-402b-87a4-d754fb7cd645 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:19.465652 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9673867-cdc5-41d4-9966-6de0d38bb26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:19.466280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9673867-cdc5-41d4-9966-6de0d38bb26a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:19.466563 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9673867-cdc5-41d4-9966-6de0d38bb26a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:19.466837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9673867-cdc5-41d4-9966-6de0d38bb26a None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:19.467557 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9673867-cdc5-41d4-9966-6de0d38bb26a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:19.467839 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9673867-cdc5-41d4-9966-6de0d38bb26a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:19.469155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 327/641] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:19.469316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9673867-cdc5-41d4-9966-6de0d38bb26a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:19.470548 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12dcb1c-99f6-4be4-8574-280b74e90252 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:19.492188 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 315/642] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:19.493341 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9673867-cdc5-41d4-9966-6de0d38bb26a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:19.561516 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:19.596569 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12dcb1c-99f6-4be4-8574-280b74e90252 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:19.603270 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9673867-cdc5-41d4-9966-6de0d38bb26a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:19.632890 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfec0f-50cb-47f1-b8f4-14d37ad7a0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:19.633518 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfec0f-50cb-47f1-b8f4-14d37ad7a0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:19.633802 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfec0f-50cb-47f1-b8f4-14d37ad7a0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:19.634081 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfec0f-50cb-47f1-b8f4-14d37ad7a0d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:19.634869 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfec0f-50cb-47f1-b8f4-14d37ad7a0d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:19.635175 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfec0f-50cb-47f1-b8f4-14d37ad7a0d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:19.636570 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfec0f-50cb-47f1-b8f4-14d37ad7a0d8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:19.637529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ddcd3-11b1-4a5f-bb78-df368ec02ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:19.638178 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ddcd3-11b1-4a5f-bb78-df368ec02ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:19.638461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ddcd3-11b1-4a5f-bb78-df368ec02ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:19.638734 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ddcd3-11b1-4a5f-bb78-df368ec02ca9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:19.646044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 328/643] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:19.646196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ddcd3-11b1-4a5f-bb78-df368ec02ca9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:19.647496 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ddcd3-11b1-4a5f-bb78-df368ec02ca9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:19.651547 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfec0f-50cb-47f1-b8f4-14d37ad7a0d8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:19.654347 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:19.660460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-b75ddcd3-11b1-4a5f-bb78-df368ec02ca9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:19.660460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:19.660460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:19.660460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:19.660460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:19.660460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:19.660460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:19.660460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:19.660460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:19.660460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:19.660460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:19.660460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:19.660460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:19.660460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:19.660460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:19.661604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:19.661604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:19.661604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:19.661604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:19.661604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:19.661604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:19.661604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:19.661604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:19.661604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:19.661604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:19.661604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:19.661604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:19.661604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:19.661604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:19.661604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:19.661604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:19.661604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:19.662690 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:19.662690 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:19.662690 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:19.662690 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:19.662690 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:19.662690 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:19.662690 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:19.662690 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:19.665481 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 316/644] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:19.666799 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ddcd3-11b1-4a5f-bb78-df368ec02ca9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:19.764181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfec0f-50cb-47f1-b8f4-14d37ad7a0d8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:19.774972 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ddcd3-11b1-4a5f-bb78-df368ec02ca9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:19.799629 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d045a1-5dab-4986-8598-86e29a35a668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:19.800278 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d045a1-5dab-4986-8598-86e29a35a668 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:19.800555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d045a1-5dab-4986-8598-86e29a35a668 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:19.800851 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d045a1-5dab-4986-8598-86e29a35a668 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:19.804507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:19.809882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d045a1-5dab-4986-8598-86e29a35a668 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:19.811379 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d045a1-5dab-4986-8598-86e29a35a668 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:19.815041 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57690e7a-d319-4133-b91f-931df7430210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:19.818740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57690e7a-d319-4133-b91f-931df7430210 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:19.818740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57690e7a-d319-4133-b91f-931df7430210 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:19.818740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57690e7a-d319-4133-b91f-931df7430210 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:19.823041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-14d045a1-5dab-4986-8598-86e29a35a668 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:45:19.823041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:19.823041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:19.823041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:19.823041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:19.823041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:19.823041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:19.823041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:19.823041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:19.823041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:19.823041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:19.823041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:19.823041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:19.823041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:19.823041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:19.823041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:19.823966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:19.823966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:19.823966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:19.823966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:19.823966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:19.823966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:19.823966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:19.823966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:19.823966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:19.823966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:19.823966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:19.823966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:19.823966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:19.823966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:19.823966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:19.823966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:19.823966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:19.823966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:19.825678 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:19.825678 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:19.825678 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:19.825678 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:19.825678 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:19.825678 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:19.825678 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:19.825678 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:19.825678 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:45:19.825678 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:19.825678 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 329/645] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:45:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:19.825678 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d045a1-5dab-4986-8598-86e29a35a668 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:19.833996 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57690e7a-d319-4133-b91f-931df7430210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:19.839167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-57690e7a-d319-4133-b91f-931df7430210 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:19.839167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:19.839167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:19.839167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:19.839167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:19.839167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:19.839167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:19.839167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:19.839167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:19.839167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:19.839167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:19.839167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:19.839167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:19.839167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:19.839167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:19.839167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:19.840418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:19.840418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:19.840418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:19.840418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:19.840418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:19.840418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:19.840418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:19.840418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:19.840418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:19.840418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:19.840418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:19.840418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:19.840418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:19.840418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:19.840418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:19.840418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:19.842423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:19.842423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:19.842423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:19.842423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:19.842423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:19.842423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:19.842423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:19.842423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:19.842423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:19.842423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:19.842423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:19.842423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:19.852511 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 317/646] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:19.854132 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57690e7a-d319-4133-b91f-931df7430210 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:19.895713 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:19.936349 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d045a1-5dab-4986-8598-86e29a35a668 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:19.960566 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57690e7a-d319-4133-b91f-931df7430210 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:19.973370 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133b708-ad3c-48f0-9806-e5b68f7ccdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:19.974077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133b708-ad3c-48f0-9806-e5b68f7ccdcc None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:19.974362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133b708-ad3c-48f0-9806-e5b68f7ccdcc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:19.974633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133b708-ad3c-48f0-9806-e5b68f7ccdcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:19.985389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133b708-ad3c-48f0-9806-e5b68f7ccdcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:19.986946 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133b708-ad3c-48f0-9806-e5b68f7ccdcc None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:20.000873 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505903dd-7bc2-4aa7-9f23-5748650f9e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:20.001516 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505903dd-7bc2-4aa7-9f23-5748650f9e45 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:20.001796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505903dd-7bc2-4aa7-9f23-5748650f9e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:20.002068 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505903dd-7bc2-4aa7-9f23-5748650f9e45 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:20.002385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-b133b708-ad3c-48f0-9806-e5b68f7ccdcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:20.002385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:20.002385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:20.002385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:20.002385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:20.002385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:20.002385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:20.002385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:20.002385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:20.002385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:20.002385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:20.002385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:20.002385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:20.002385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:20.002385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:20.003244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:20.003244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:20.003244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:20.003244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:20.003244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:20.003244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:20.003244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:20.003244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:20.003244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:20.003244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:20.003244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:20.003244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:20.003244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:20.003244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:20.003244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:20.003244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:20.003244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:20.004129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:20.004129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:20.004129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:20.004129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:20.004370 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505903dd-7bc2-4aa7-9f23-5748650f9e45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:20.004370 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505903dd-7bc2-4aa7-9f23-5748650f9e45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:20.004908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505903dd-7bc2-4aa7-9f23-5748650f9e45 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:20.008277 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 330/647] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:20.009144 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133b708-ad3c-48f0-9806-e5b68f7ccdcc None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:20.021177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 318/648] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:20.022601 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505903dd-7bc2-4aa7-9f23-5748650f9e45 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:20.077245 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:20.122995 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133b708-ad3c-48f0-9806-e5b68f7ccdcc None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:20.136763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505903dd-7bc2-4aa7-9f23-5748650f9e45 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:20.137994 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:20.159844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a062915-53f3-4610-a94c-2a7b5dee8c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:20.160636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a062915-53f3-4610-a94c-2a7b5dee8c32 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:20.160949 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a062915-53f3-4610-a94c-2a7b5dee8c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:20.161231 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a062915-53f3-4610-a94c-2a7b5dee8c32 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:20.162024 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a062915-53f3-4610-a94c-2a7b5dee8c32 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:20.162335 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a062915-53f3-4610-a94c-2a7b5dee8c32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:20.163861 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a062915-53f3-4610-a94c-2a7b5dee8c32 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:20.173812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00d8c1-db2f-4e07-a199-7a1b33c2feba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:20.174437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00d8c1-db2f-4e07-a199-7a1b33c2feba None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:20.174728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00d8c1-db2f-4e07-a199-7a1b33c2feba None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:20.175002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00d8c1-db2f-4e07-a199-7a1b33c2feba None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:20.175733 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00d8c1-db2f-4e07-a199-7a1b33c2feba None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:20.176044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00d8c1-db2f-4e07-a199-7a1b33c2feba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:20.177439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00d8c1-db2f-4e07-a199-7a1b33c2feba None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:20.188364 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 331/649] 10.222.0.75 () {56 vars in 1137 bytes} [Thu Jul 28 17:45:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:20.188364 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a062915-53f3-4610-a94c-2a7b5dee8c32 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:20.191481 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 319/650] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:20.192323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00d8c1-db2f-4e07-a199-7a1b33c2feba None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:20.303768 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00d8c1-db2f-4e07-a199-7a1b33c2feba None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:20.307905 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a062915-53f3-4610-a94c-2a7b5dee8c32 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:20.312649 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:20.346868 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4736c-5ca9-4966-9645-94103894edc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:20.347100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c99bc-24ad-4a3a-935a-867048725fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:20.347510 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4736c-5ca9-4966-9645-94103894edc1 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:20.347675 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c99bc-24ad-4a3a-935a-867048725fcd None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:20.347770 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4736c-5ca9-4966-9645-94103894edc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:20.347965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c99bc-24ad-4a3a-935a-867048725fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:20.348061 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4736c-5ca9-4966-9645-94103894edc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:20.348238 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c99bc-24ad-4a3a-935a-867048725fcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:20.348727 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4736c-5ca9-4966-9645-94103894edc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:20.349064 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c99bc-24ad-4a3a-935a-867048725fcd None admin] RBAC: Adding query filter params (role.id=6f10ff8509da43688fba83e6a4fd5c5f, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=c456a787159844feb7eabfd1e527e46e) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:20.349160 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4736c-5ca9-4966-9645-94103894edc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:20.349374 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c99bc-24ad-4a3a-935a-867048725fcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:20.350452 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4736c-5ca9-4966-9645-94103894edc1 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:20.350774 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c99bc-24ad-4a3a-935a-867048725fcd None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:20.363366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 320/651] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:20 2022] GET /identity/v3/role_assignments?user.id=c456a787159844feb7eabfd1e527e46e&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=6f10ff8509da43688fba83e6a4fd5c5f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:20.363366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c99bc-24ad-4a3a-935a-867048725fcd None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:20.363637 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 332/652] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:20.363637 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4736c-5ca9-4966-9645-94103894edc1 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:20.401259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:20.492398 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4736c-5ca9-4966-9645-94103894edc1 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:20.506834 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c99bc-24ad-4a3a-935a-867048725fcd None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:20.541420 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d76d8-a19b-499e-a537-7316d95bddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:20.542072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d76d8-a19b-499e-a537-7316d95bddcc None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:20.542356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d76d8-a19b-499e-a537-7316d95bddcc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:20.542766 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d76d8-a19b-499e-a537-7316d95bddcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:20.550772 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88653813-00ef-4edb-9162-e679e69eb646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:20.554663 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88653813-00ef-4edb-9162-e679e69eb646 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:20.554663 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88653813-00ef-4edb-9162-e679e69eb646 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:20.554663 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88653813-00ef-4edb-9162-e679e69eb646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:20.554947 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d76d8-a19b-499e-a537-7316d95bddcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:20.557757 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d76d8-a19b-499e-a537-7316d95bddcc None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:20.579135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-e97d76d8-a19b-499e-a537-7316d95bddcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:20.579135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:20.579135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:20.579135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:20.579135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:20.579135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:20.579135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:20.579135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:20.579135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:20.579135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:20.579135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:20.579135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:20.579135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:20.579135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:20.579135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:20.580150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:20.580150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:20.580150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:20.580150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:20.580150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:20.580150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:20.580150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:20.580150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:20.580150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:20.580150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:20.580150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:20.580150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:20.580150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:20.580150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:20.580150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:20.580150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:20.580150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:20.581086 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:20.581086 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:20.581086 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:20.581086 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:20.581086 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 333/653] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:20.581086 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d76d8-a19b-499e-a537-7316d95bddcc None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:20.604984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:20.644060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88653813-00ef-4edb-9162-e679e69eb646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:20.645951 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88653813-00ef-4edb-9162-e679e69eb646 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:20.698673 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:20.716268 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d76d8-a19b-499e-a537-7316d95bddcc None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:20.753832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f5e6e-4d54-4761-a30a-2579be181791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:20.754676 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f5e6e-4d54-4761-a30a-2579be181791 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:20.755082 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f5e6e-4d54-4761-a30a-2579be181791 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:20.755454 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f5e6e-4d54-4761-a30a-2579be181791 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:20.762081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 321/654] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:20.763217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88653813-00ef-4edb-9162-e679e69eb646 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:20.764054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f5e6e-4d54-4761-a30a-2579be181791 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:20.765821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f5e6e-4d54-4761-a30a-2579be181791 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:20.778559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-704f5e6e-4d54-4761-a30a-2579be181791 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 17:45:20.778559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:20.778559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:20.778559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:20.778559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:20.778559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:20.778559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:20.778559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:20.778559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:20.778559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:20.778559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:20.778559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:20.778559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:20.778559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:20.778559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:20.778559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:20.779533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:20.779533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:20.779533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:20.779533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:20.779533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:20.779533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:20.779533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:20.779533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:20.779533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:20.779533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:20.779533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:20.779533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:20.779533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:20.779533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:20.779533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:20.779533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:20.779533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:20.779533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:20.780472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:20.780472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:20.780472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:20.780472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:20.780472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:20.780472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:20.780472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:20.780472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:20.780472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 17:45:20.780472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:20.780472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 334/655] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:45:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:20.785139 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f5e6e-4d54-4761-a30a-2579be181791 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:20.842189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:20.876558 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88653813-00ef-4edb-9162-e679e69eb646 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:20.896330 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f5e6e-4d54-4761-a30a-2579be181791 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:20.921031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ca8c9-cec0-4043-8692-97c02778243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:20.925718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ca8c9-cec0-4043-8692-97c02778243d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:20.926210 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ca8c9-cec0-4043-8692-97c02778243d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:20.926682 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ca8c9-cec0-4043-8692-97c02778243d None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:20.927653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ca8c9-cec0-4043-8692-97c02778243d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:20.928189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ca8c9-cec0-4043-8692-97c02778243d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:20.929812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ca8c9-cec0-4043-8692-97c02778243d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:20.939388 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba6cc1-7f4f-40ee-a2a0-7f71d8df59fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:20.940146 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba6cc1-7f4f-40ee-a2a0-7f71d8df59fe None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:20.940496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba6cc1-7f4f-40ee-a2a0-7f71d8df59fe None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:20.940864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba6cc1-7f4f-40ee-a2a0-7f71d8df59fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:20.948424 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 322/656] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:20.949685 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ca8c9-cec0-4043-8692-97c02778243d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:20.957929 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba6cc1-7f4f-40ee-a2a0-7f71d8df59fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:20.959415 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba6cc1-7f4f-40ee-a2a0-7f71d8df59fe None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:20.967964 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:20.975611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-9cba6cc1-7f4f-40ee-a2a0-7f71d8df59fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:20.975611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:20.975611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:20.975611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:20.975611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:20.975611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:20.975611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:20.975611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:20.975611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:20.975611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:20.975611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:20.975611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:20.975611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:20.975611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:20.975611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:20.976515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:20.976515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:20.976515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:20.976515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:20.976515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:20.976515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:20.976515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:20.976515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:20.976515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:20.976515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:20.976515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:20.976515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:20.976515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:20.976515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:20.976515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:20.976515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:20.976515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:20.977652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:20.977652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:20.977652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:20.977652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:20.977652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 335/657] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:20.977652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba6cc1-7f4f-40ee-a2a0-7f71d8df59fe None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:21.096302 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ca8c9-cec0-4043-8692-97c02778243d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:21.127475 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:21.133981 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab80c5-82a6-40b1-86e3-0207566d32ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:21.134915 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab80c5-82a6-40b1-86e3-0207566d32ef None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:21.135492 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab80c5-82a6-40b1-86e3-0207566d32ef None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:21.135961 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab80c5-82a6-40b1-86e3-0207566d32ef None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:21.136984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab80c5-82a6-40b1-86e3-0207566d32ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:21.137922 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab80c5-82a6-40b1-86e3-0207566d32ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:21.139666 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab80c5-82a6-40b1-86e3-0207566d32ef None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:21.157021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba6cc1-7f4f-40ee-a2a0-7f71d8df59fe None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:21.161555 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 323/658] 10.222.0.75 () {56 vars in 1137 bytes} [Thu Jul 28 17:45:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:21.162697 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab80c5-82a6-40b1-86e3-0207566d32ef None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:21.214172 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59144f94-b3d6-4560-824f-0a3d4920235e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:21.215283 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59144f94-b3d6-4560-824f-0a3d4920235e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:21.215818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59144f94-b3d6-4560-824f-0a3d4920235e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:21.216155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59144f94-b3d6-4560-824f-0a3d4920235e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:21.225514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59144f94-b3d6-4560-824f-0a3d4920235e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:21.227104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59144f94-b3d6-4560-824f-0a3d4920235e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:21.243646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-59144f94-b3d6-4560-824f-0a3d4920235e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 17:45:21.243646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:21.243646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:21.243646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:21.243646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:21.243646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:21.243646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:21.243646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:21.243646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:21.243646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:21.243646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:21.243646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:21.243646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:21.243646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:21.243646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:21.243646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:21.244632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:21.244632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:21.244632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:21.244632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:21.244632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:21.244632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:21.244632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:21.244632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:21.244632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:21.244632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:21.244632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:21.244632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:21.244632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:21.244632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:21.244632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:21.244632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:21.244632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:21.244632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:21.245605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:21.245605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:21.245605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:21.245605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:21.245605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:21.245605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:21.245605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:21.245605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:21.245605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 17:45:21.245605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:21.248897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 336/659] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:21.251528 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e6992-1937-4575-8f36-e9a53d846d86 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:21.253358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e6992-1937-4575-8f36-e9a53d846d86 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:21.253748 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e6992-1937-4575-8f36-e9a53d846d86 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:21.255961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 337/660] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:21.257066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e6992-1937-4575-8f36-e9a53d846d86 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:21.295893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab80c5-82a6-40b1-86e3-0207566d32ef None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:21.338095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:21.340526 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff7f1b-663c-4781-a8fc-2d85bb80c245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:21.341210 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff7f1b-663c-4781-a8fc-2d85bb80c245 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:21.341487 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff7f1b-663c-4781-a8fc-2d85bb80c245 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:21.341764 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff7f1b-663c-4781-a8fc-2d85bb80c245 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:21.342474 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff7f1b-663c-4781-a8fc-2d85bb80c245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:21.342785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff7f1b-663c-4781-a8fc-2d85bb80c245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:21.344328 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff7f1b-663c-4781-a8fc-2d85bb80c245 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:21.366699 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 324/661] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:21.367658 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff7f1b-663c-4781-a8fc-2d85bb80c245 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:21.404363 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e6992-1937-4575-8f36-e9a53d846d86 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:21.423100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:21.448013 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db289754-bcd4-4d10-b71a-d55318015a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:21.448650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db289754-bcd4-4d10-b71a-d55318015a4f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:21.448961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db289754-bcd4-4d10-b71a-d55318015a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:21.449241 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db289754-bcd4-4d10-b71a-d55318015a4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:21.478983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff7f1b-663c-4781-a8fc-2d85bb80c245 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:21.515032 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf5993-d137-439d-aaa1-18c29e4c405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:21.515705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf5993-d137-439d-aaa1-18c29e4c405d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:21.515929 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf5993-d137-439d-aaa1-18c29e4c405d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:21.516201 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf5993-d137-439d-aaa1-18c29e4c405d None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:21.517655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf5993-d137-439d-aaa1-18c29e4c405d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:21.518172 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf5993-d137-439d-aaa1-18c29e4c405d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:21.519538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf5993-d137-439d-aaa1-18c29e4c405d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:21.524741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db289754-bcd4-4d10-b71a-d55318015a4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:21.526261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db289754-bcd4-4d10-b71a-d55318015a4f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:21.544228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 325/662] 10.222.0.75 () {56 vars in 1139 bytes} [Thu Jul 28 17:45:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:21.544228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7af7c7-5145-4d7f-900f-ddc1f956dfa3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:21.544228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7af7c7-5145-4d7f-900f-ddc1f956dfa3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:21.544228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7af7c7-5145-4d7f-900f-ddc1f956dfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:21.559978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0b7af7c7-5145-4d7f-900f-ddc1f956dfa3 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:21.561248 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0b7af7c7-5145-4d7f-900f-ddc1f956dfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:21.587748 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:21.637888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 338/663] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:21.637888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db289754-bcd4-4d10-b71a-d55318015a4f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:21.638187 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 326/664] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:21.638187 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7af7c7-5145-4d7f-900f-ddc1f956dfa3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:21.682174 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:21.750378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7af7c7-5145-4d7f-900f-ddc1f956dfa3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:21.750645 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db289754-bcd4-4d10-b71a-d55318015a4f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:21.785446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27035c0a-87fa-4bb5-9e0b-bb60bb18591e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:21.786098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27035c0a-87fa-4bb5-9e0b-bb60bb18591e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:21.786380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27035c0a-87fa-4bb5-9e0b-bb60bb18591e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:21.786479 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f071d2-5d81-4be0-bbfa-46357d01f9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:21.786757 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27035c0a-87fa-4bb5-9e0b-bb60bb18591e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:21.787020 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f071d2-5d81-4be0-bbfa-46357d01f9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:21.787396 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f071d2-5d81-4be0-bbfa-46357d01f9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:21.787757 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f071d2-5d81-4be0-bbfa-46357d01f9f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:21.793728 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27035c0a-87fa-4bb5-9e0b-bb60bb18591e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:21.795191 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27035c0a-87fa-4bb5-9e0b-bb60bb18591e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:21.806993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-27035c0a-87fa-4bb5-9e0b-bb60bb18591e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:21.806993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:21.806993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:21.806993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:21.806993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:21.806993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:21.806993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:21.806993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:21.806993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:21.806993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:21.806993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:21.806993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:21.806993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:21.806993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:21.806993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:21.807910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:21.807910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:21.807910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:21.807910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:21.807910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:21.807910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:21.807910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:21.807910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:21.807910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:21.807910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:21.807910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:21.807910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:21.807910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:21.807910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:21.807910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:21.807910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:21.807910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:21.808832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:21.808832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:21.808832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:21.808832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:21.808832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:21.808832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:21.808832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:21.808832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:21.808832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 339/665] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:21.810117 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27035c0a-87fa-4bb5-9e0b-bb60bb18591e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:21.831422 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:21.866632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f071d2-5d81-4be0-bbfa-46357d01f9f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:21.868099 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f071d2-5d81-4be0-bbfa-46357d01f9f3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:21.906080 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:21.928534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27035c0a-87fa-4bb5-9e0b-bb60bb18591e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:21.962172 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c384077-093c-4bd5-9a91-03f90a34a94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:21.962812 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c384077-093c-4bd5-9a91-03f90a34a94b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:21.963090 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c384077-093c-4bd5-9a91-03f90a34a94b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:21.963359 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c384077-093c-4bd5-9a91-03f90a34a94b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:21.973507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c384077-093c-4bd5-9a91-03f90a34a94b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:21.974981 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c384077-093c-4bd5-9a91-03f90a34a94b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:21.979820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 327/666] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:21.979820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f071d2-5d81-4be0-bbfa-46357d01f9f3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:21.996091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-3c384077-093c-4bd5-9a91-03f90a34a94b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:21.996091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:21.996091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:21.996091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:21.996091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:21.996091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:21.996091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:21.996091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:21.996091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:21.996091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:21.996091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:21.996091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:21.996091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:21.996091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:21.996091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:21.997044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:21.997044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:21.997044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:21.997044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:21.997044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:21.997044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:21.997044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:21.997044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:21.997044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:21.997044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:21.997044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:21.997044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:21.997044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:21.997044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:21.997044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:21.997044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:21.997044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:21.997920 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:21.997920 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:21.997920 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:21.997920 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:21.997920 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 340/667] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:21.998188 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c384077-093c-4bd5-9a91-03f90a34a94b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:22.069633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:22.088455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f071d2-5d81-4be0-bbfa-46357d01f9f3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:22.106892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c384077-093c-4bd5-9a91-03f90a34a94b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:22.127362 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71723f-abcc-4b93-a55b-c064feebbb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:22.128004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71723f-abcc-4b93-a55b-c064feebbb74 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:22.128282 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71723f-abcc-4b93-a55b-c064feebbb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:22.128554 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71723f-abcc-4b93-a55b-c064feebbb74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:22.131145 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:22.139879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71723f-abcc-4b93-a55b-c064feebbb74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:22.144427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e05f21-6df2-4bd4-84d4-6e1490c6cdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:22.145083 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e05f21-6df2-4bd4-84d4-6e1490c6cdf3 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:22.145181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-7e71723f-abcc-4b93-a55b-c064feebbb74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:22.145181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:22.145181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:22.145181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:22.145181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:22.145181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:22.145181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:22.145181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:22.145181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:22.145181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:22.145181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:22.145181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:22.145181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:22.145181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:22.145181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:22.145181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:22.146028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:22.146028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:22.146028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:22.146028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:22.146028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:22.146028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:22.146028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:22.146028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:22.146028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:22.146028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:22.146028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:22.146028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:22.146028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:22.146028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:22.146028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:22.146028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:22.146879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:22.146879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:22.146879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:22.146879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:22.146879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:22.146879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:22.146879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:22.146879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:22.146879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:22.146879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:22.146879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:22.146879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:22.147511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e05f21-6df2-4bd4-84d4-6e1490c6cdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:22.147511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e05f21-6df2-4bd4-84d4-6e1490c6cdf3 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:22.147633 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 328/668] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:22.147633 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71723f-abcc-4b93-a55b-c064feebbb74 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:22.152670 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e05f21-6df2-4bd4-84d4-6e1490c6cdf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:22.152670 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e05f21-6df2-4bd4-84d4-6e1490c6cdf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:22.152670 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e05f21-6df2-4bd4-84d4-6e1490c6cdf3 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:22.164305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 341/669] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:22.166549 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e05f21-6df2-4bd4-84d4-6e1490c6cdf3 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:22.256260 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71723f-abcc-4b93-a55b-c064feebbb74 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:22.280625 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e05f21-6df2-4bd4-84d4-6e1490c6cdf3 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:22.292559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690d221-2e04-4265-964a-0d400b95073a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:22.293249 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690d221-2e04-4265-964a-0d400b95073a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:22.293527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690d221-2e04-4265-964a-0d400b95073a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:22.293797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690d221-2e04-4265-964a-0d400b95073a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:22.304705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690d221-2e04-4265-964a-0d400b95073a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:22.307894 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690d221-2e04-4265-964a-0d400b95073a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:22.313004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:22.328019 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc87d3-62b9-45d3-9b88-4d07defb6249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:22.328019 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc87d3-62b9-45d3-9b88-4d07defb6249 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:22.328019 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc87d3-62b9-45d3-9b88-4d07defb6249 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:22.328019 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc87d3-62b9-45d3-9b88-4d07defb6249 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:22.328423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-4690d221-2e04-4265-964a-0d400b95073a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:22.328423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:22.328423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:22.328423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:22.328423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:22.328423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:22.328423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:22.328423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:22.328423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:22.328423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:22.328423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:22.328423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:22.328423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:22.328423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:22.328423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:22.329469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:22.329469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:22.329469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:22.329469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:22.329469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:22.329469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:22.329469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:22.329469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:22.329469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:22.329469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:22.329469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:22.329469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:22.329469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:22.329469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:22.329469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:22.329469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:22.329469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:22.330345 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:22.330345 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:22.330345 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:22.330345 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:22.330557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc87d3-62b9-45d3-9b88-4d07defb6249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:22.330557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc87d3-62b9-45d3-9b88-4d07defb6249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:22.330677 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 329/670] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:22.330677 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690d221-2e04-4265-964a-0d400b95073a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:22.330807 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc87d3-62b9-45d3-9b88-4d07defb6249 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:22.345519 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 342/671] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:22.346558 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc87d3-62b9-45d3-9b88-4d07defb6249 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:22.407455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:22.462381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690d221-2e04-4265-964a-0d400b95073a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:22.466444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc87d3-62b9-45d3-9b88-4d07defb6249 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:22.498138 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d01649-8f31-4f16-926e-5c0ec65d51b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:22.498768 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d01649-8f31-4f16-926e-5c0ec65d51b3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:22.499054 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d01649-8f31-4f16-926e-5c0ec65d51b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:22.499334 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d01649-8f31-4f16-926e-5c0ec65d51b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:22.500063 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d01649-8f31-4f16-926e-5c0ec65d51b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:22.500375 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d01649-8f31-4f16-926e-5c0ec65d51b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:22.501914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07efe9-398a-4153-b469-81f7825927c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:22.502307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d01649-8f31-4f16-926e-5c0ec65d51b3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:22.502529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07efe9-398a-4153-b469-81f7825927c6 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:22.502807 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07efe9-398a-4153-b469-81f7825927c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:22.503074 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07efe9-398a-4153-b469-81f7825927c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:22.503859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07efe9-398a-4153-b469-81f7825927c6 None admin] RBAC: Adding query filter params (role.id=6f10ff8509da43688fba83e6a4fd5c5f, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=be78ea573a674611807171c76f8003ce) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:22.504302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07efe9-398a-4153-b469-81f7825927c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:22.505758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07efe9-398a-4153-b469-81f7825927c6 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:22.515580 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 330/672] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:22.515580 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d01649-8f31-4f16-926e-5c0ec65d51b3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:22.515839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 343/673] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:22 2022] GET /identity/v3/role_assignments?user.id=be78ea573a674611807171c76f8003ce&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=6f10ff8509da43688fba83e6a4fd5c5f => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:22.515839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07efe9-398a-4153-b469-81f7825927c6 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:22.588809 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:22.641125 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07efe9-398a-4153-b469-81f7825927c6 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:22.646889 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d01649-8f31-4f16-926e-5c0ec65d51b3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:22.660215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:22.681476 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303c097-7ea1-4f49-bf52-2d2389ce42b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:22.682135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303c097-7ea1-4f49-bf52-2d2389ce42b3 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:22.682530 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303c097-7ea1-4f49-bf52-2d2389ce42b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:22.682811 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303c097-7ea1-4f49-bf52-2d2389ce42b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:22.687642 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db2651-0777-4055-a061-4a624d812958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:22.687642 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db2651-0777-4055-a061-4a624d812958 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:22.687870 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db2651-0777-4055-a061-4a624d812958 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:22.688078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db2651-0777-4055-a061-4a624d812958 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:22.689460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db2651-0777-4055-a061-4a624d812958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:22.689771 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db2651-0777-4055-a061-4a624d812958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:22.691061 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303c097-7ea1-4f49-bf52-2d2389ce42b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:22.691202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db2651-0777-4055-a061-4a624d812958 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:22.693332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303c097-7ea1-4f49-bf52-2d2389ce42b3 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:22.704492 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 331/674] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:22.705680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-1303c097-7ea1-4f49-bf52-2d2389ce42b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:22.705680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:22.705680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:22.705680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:22.705680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:22.705680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:22.705680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:22.705680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:22.705680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:22.705680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:22.705680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:22.705680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:22.705680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:22.705680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:22.705680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:22.706571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:22.706571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:22.706571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:22.706571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:22.706571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:22.706571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:22.706571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:22.706571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:22.706571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:22.706571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:22.706571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:22.706571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:22.706571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:22.706571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:22.706571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:22.706571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:22.706571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:22.707444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:22.707444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:22.707444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:22.707444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:22.707444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:22.707444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:22.707444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:22.707444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:22.707444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 344/675] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:22.708668 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94604d-9781-45c9-87d4-72a703412598 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:22.708668 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94604d-9781-45c9-87d4-72a703412598 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:22.709000 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94604d-9781-45c9-87d4-72a703412598 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:22.710105 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db2651-0777-4055-a061-4a624d812958 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:22.710462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 345/676] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:22.711952 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94604d-9781-45c9-87d4-72a703412598 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:22.823206 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db2651-0777-4055-a061-4a624d812958 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:22.824295 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94604d-9781-45c9-87d4-72a703412598 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:22.837732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:22.865131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f19237-708e-427e-be17-3e3114f964fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:22.865131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f19237-708e-427e-be17-3e3114f964fa None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:22.865131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f19237-708e-427e-be17-3e3114f964fa None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:22.865521 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f14497-a0ef-4ac4-bb2a-d35b85da3ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:22.865625 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f19237-708e-427e-be17-3e3114f964fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:22.865722 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f14497-a0ef-4ac4-bb2a-d35b85da3ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:22.865722 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f14497-a0ef-4ac4-bb2a-d35b85da3ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:22.865722 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f14497-a0ef-4ac4-bb2a-d35b85da3ed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:22.869130 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f19237-708e-427e-be17-3e3114f964fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:22.870626 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f19237-708e-427e-be17-3e3114f964fa None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:22.876854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f14497-a0ef-4ac4-bb2a-d35b85da3ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:22.878311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f14497-a0ef-4ac4-bb2a-d35b85da3ed0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:22.884914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-62f19237-708e-427e-be17-3e3114f964fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:22.884914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:22.884914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:22.884914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:22.884914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:22.884914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:22.884914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:22.884914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:22.884914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:22.884914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:22.884914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:22.884914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:22.884914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:22.884914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:22.884914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:22.885817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:22.885817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:22.885817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:22.885817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:22.885817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:22.885817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:22.885817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:22.885817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:22.885817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:22.885817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:22.885817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:22.885817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:22.885817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:22.885817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:22.885817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:22.885817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:22.885817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:22.886704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:22.886704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:22.886704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:22.886704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:22.886704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:22.886704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:22.886704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:22.886704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:22.889717 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 346/677] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:22.889717 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f19237-708e-427e-be17-3e3114f964fa None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:22.896984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-32f14497-a0ef-4ac4-bb2a-d35b85da3ed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:22.896984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:22.896984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:22.896984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:22.896984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:22.896984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:22.896984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:22.896984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:22.896984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:22.896984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:22.896984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:22.896984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:22.896984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:22.896984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:22.896984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:22.897885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:22.897885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:22.897885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:22.897885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:22.897885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:22.897885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:22.897885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:22.897885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:22.897885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:22.897885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:22.897885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:22.897885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:22.897885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:22.897885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:22.897885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:22.897885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:22.897885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:22.898793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:22.898793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:22.898793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:22.898793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:22.898793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 332/678] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:22.900262 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d7ee1-f3e8-4c52-b8da-d1cbe15a5f23 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:22.900262 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d7ee1-f3e8-4c52-b8da-d1cbe15a5f23 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:22.900432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d7ee1-f3e8-4c52-b8da-d1cbe15a5f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:22.918801 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8c7d7ee1-f3e8-4c52-b8da-d1cbe15a5f23 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:22.919996 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8c7d7ee1-f3e8-4c52-b8da-d1cbe15a5f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:22.938101 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:22.992841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 333/679] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:22.992841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d7ee1-f3e8-4c52-b8da-d1cbe15a5f23 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:23.006650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f19237-708e-427e-be17-3e3114f964fa None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:23.044227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8be9c-0048-488a-a3e7-3f037690872e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:23.045028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8be9c-0048-488a-a3e7-3f037690872e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:23.045137 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8be9c-0048-488a-a3e7-3f037690872e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:23.045413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8be9c-0048-488a-a3e7-3f037690872e None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:23.046157 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8be9c-0048-488a-a3e7-3f037690872e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:23.046563 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8be9c-0048-488a-a3e7-3f037690872e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:23.048580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8be9c-0048-488a-a3e7-3f037690872e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:23.061908 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 347/680] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:23.067250 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8be9c-0048-488a-a3e7-3f037690872e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:23.101132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:23.106349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d7ee1-f3e8-4c52-b8da-d1cbe15a5f23 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:23.144161 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c24c8f-ff8d-4696-9c68-59944a4933f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:23.144942 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c24c8f-ff8d-4696-9c68-59944a4933f7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:23.145035 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c24c8f-ff8d-4696-9c68-59944a4933f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:23.145256 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c24c8f-ff8d-4696-9c68-59944a4933f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:23.146009 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c24c8f-ff8d-4696-9c68-59944a4933f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:23.146320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c24c8f-ff8d-4696-9c68-59944a4933f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:23.148226 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c24c8f-ff8d-4696-9c68-59944a4933f7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:23.166068 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 334/681] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:23.166068 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c24c8f-ff8d-4696-9c68-59944a4933f7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:23.178452 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8be9c-0048-488a-a3e7-3f037690872e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:23.180831 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:23.218160 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eeaaa1-390b-4c53-8959-871b339b090c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:23.218787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeaaa1-390b-4c53-8959-871b339b090c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:23.219060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeaaa1-390b-4c53-8959-871b339b090c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:23.220400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeaaa1-390b-4c53-8959-871b339b090c None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:23.221129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eeaaa1-390b-4c53-8959-871b339b090c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:23.221701 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eeaaa1-390b-4c53-8959-871b339b090c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:23.223269 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eeaaa1-390b-4c53-8959-871b339b090c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:23.236278 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 348/682] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:23.237135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eeaaa1-390b-4c53-8959-871b339b090c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:23.279506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c24c8f-ff8d-4696-9c68-59944a4933f7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:23.316097 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366c27d-a1f1-49b4-b30a-b50bafaf986c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:23.316743 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366c27d-a1f1-49b4-b30a-b50bafaf986c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:23.317064 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366c27d-a1f1-49b4-b30a-b50bafaf986c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:23.317334 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366c27d-a1f1-49b4-b30a-b50bafaf986c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:23.328349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366c27d-a1f1-49b4-b30a-b50bafaf986c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:23.333718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-e366c27d-a1f1-49b4-b30a-b50bafaf986c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:45:23.333718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:23.333718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:23.333718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:23.333718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:23.333718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:23.333718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:23.333718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:23.333718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:23.333718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:23.333718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:23.333718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:23.333718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:23.333718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:23.333718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:23.333718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:23.334715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:23.334715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:23.334715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:23.334715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:23.334715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:23.334715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:23.334715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:23.334715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:23.334715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:23.334715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:23.334715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:23.334715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:23.334715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:23.334715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:23.334715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:23.334715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:23.335553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:23.335553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:23.335553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:23.335553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:23.335553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:23.335553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:23.335553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:23.335553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:23.335553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:23.335553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:23.335553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:45:23.335553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:23.340225 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 335/683] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:45:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:23.341129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366c27d-a1f1-49b4-b30a-b50bafaf986c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:23.347849 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:23.351965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eeaaa1-390b-4c53-8959-871b339b090c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:23.387425 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a9e16-eee7-47a7-a52a-d0aa5c1e8dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:23.388160 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a9e16-eee7-47a7-a52a-d0aa5c1e8dba None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:23.388438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a9e16-eee7-47a7-a52a-d0aa5c1e8dba None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:23.388852 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a9e16-eee7-47a7-a52a-d0aa5c1e8dba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:23.389644 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a9e16-eee7-47a7-a52a-d0aa5c1e8dba None admin] RBAC: Adding query filter params (role.id=6f10ff8509da43688fba83e6a4fd5c5f, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=1837a832a0da4d698984ce62057b81f4) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:23.389957 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a9e16-eee7-47a7-a52a-d0aa5c1e8dba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:23.392030 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a9e16-eee7-47a7-a52a-d0aa5c1e8dba None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:23.406279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 349/684] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:23 2022] GET /identity/v3/role_assignments?user.id=1837a832a0da4d698984ce62057b81f4&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=6f10ff8509da43688fba83e6a4fd5c5f => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:23.406279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a9e16-eee7-47a7-a52a-d0aa5c1e8dba None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:23.425812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:23.461787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366c27d-a1f1-49b4-b30a-b50bafaf986c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:23.506416 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2bae1-371e-41d9-b5bb-5799d9150143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:23.507323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2bae1-371e-41d9-b5bb-5799d9150143 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:23.507699 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2bae1-371e-41d9-b5bb-5799d9150143 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:23.508065 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2bae1-371e-41d9-b5bb-5799d9150143 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:23.509089 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2bae1-371e-41d9-b5bb-5799d9150143 None admin] RBAC: Adding query filter params (role.id=6f10ff8509da43688fba83e6a4fd5c5f, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=d0e56603b8704cb2b5587313c67254a9) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:23.509501 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2bae1-371e-41d9-b5bb-5799d9150143 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:23.511177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2bae1-371e-41d9-b5bb-5799d9150143 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:23.519173 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 336/685] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:23 2022] GET /identity/v3/role_assignments?user.id=d0e56603b8704cb2b5587313c67254a9&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=6f10ff8509da43688fba83e6a4fd5c5f => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:23.520370 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2bae1-371e-41d9-b5bb-5799d9150143 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:23.546460 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a9e16-eee7-47a7-a52a-d0aa5c1e8dba None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:23.600632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c5598-fe51-4523-8fb4-0a556ed215db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:23.601486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c5598-fe51-4523-8fb4-0a556ed215db None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:23.601860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c5598-fe51-4523-8fb4-0a556ed215db None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:23.602228 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c5598-fe51-4523-8fb4-0a556ed215db None admin] PATH_INFO: `/v3/users/swift` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:23.618600 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c5598-fe51-4523-8fb4-0a556ed215db None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:23.620340 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c5598-fe51-4523-8fb4-0a556ed215db None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:23.634854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-c62c5598-fe51-4523-8fb4-0a556ed215db None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:45:23.634854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:23.634854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:23.634854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:23.634854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:23.634854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:23.634854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:23.634854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:23.634854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:23.634854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:23.634854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:23.634854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:23.634854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:23.634854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:23.634854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:23.634854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:23.636001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:23.636001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:23.636001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:23.636001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:23.636001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:23.636001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:23.636001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:23.636001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:23.636001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:23.636001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:23.636001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:23.636001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:23.636001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:23.636001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:23.636001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:23.636001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:23.636001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:23.636001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:23.637155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:23.637155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:23.637155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:23.637155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:23.637155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:23.637155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:23.637155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:23.637155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:23.637155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:45:23.637155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:23.640384 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 350/686] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:45:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:23.645639 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c5598-fe51-4523-8fb4-0a556ed215db None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:23.670867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:23.677237 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2bae1-371e-41d9-b5bb-5799d9150143 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:23.730149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da1e7f-52cb-49a4-ba8a-a48dd8f9c2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:23.730491 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da1e7f-52cb-49a4-ba8a-a48dd8f9c2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:23.730644 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da1e7f-52cb-49a4-ba8a-a48dd8f9c2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:23.731059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da1e7f-52cb-49a4-ba8a-a48dd8f9c2a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:23.732520 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da1e7f-52cb-49a4-ba8a-a48dd8f9c2a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:23.732520 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da1e7f-52cb-49a4-ba8a-a48dd8f9c2a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:23.734575 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da1e7f-52cb-49a4-ba8a-a48dd8f9c2a6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:23.743285 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:23.749699 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 337/687] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:45:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:23.760229 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da1e7f-52cb-49a4-ba8a-a48dd8f9c2a6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:23.787406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c5598-fe51-4523-8fb4-0a556ed215db None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:23.833861 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e44e32-0880-4ce3-b092-a72b64803cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:23.834282 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e44e32-0880-4ce3-b092-a72b64803cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:23.834574 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e44e32-0880-4ce3-b092-a72b64803cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:23.834859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e44e32-0880-4ce3-b092-a72b64803cb8 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:23.835703 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e44e32-0880-4ce3-b092-a72b64803cb8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:23.835975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e44e32-0880-4ce3-b092-a72b64803cb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:23.839340 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e44e32-0880-4ce3-b092-a72b64803cb8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:23.867505 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 351/688] 10.222.0.75 () {56 vars in 1135 bytes} [Thu Jul 28 17:45:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:23.870365 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e44e32-0880-4ce3-b092-a72b64803cb8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:23.888014 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da1e7f-52cb-49a4-ba8a-a48dd8f9c2a6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:23.929478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6c5f2-4e4f-4c9f-b915-48b968899496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:23.930232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6c5f2-4e4f-4c9f-b915-48b968899496 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:23.930672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6c5f2-4e4f-4c9f-b915-48b968899496 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:23.931419 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6c5f2-4e4f-4c9f-b915-48b968899496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:23.942797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6c5f2-4e4f-4c9f-b915-48b968899496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:23.944305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6c5f2-4e4f-4c9f-b915-48b968899496 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:23.961213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-35d6c5f2-4e4f-4c9f-b915-48b968899496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:23.961213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:23.961213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:23.961213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:23.961213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:23.961213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:23.961213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:23.961213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:23.961213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:23.961213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:23.961213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:23.961213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:23.961213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:23.961213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:23.961213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:23.962151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:23.962151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:23.962151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:23.962151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:23.962151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:23.962151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:23.962151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:23.962151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:23.962151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:23.962151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:23.962151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:23.962151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:23.962151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:23.962151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:23.962151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:23.962151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:23.962151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:23.963029 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:23.963029 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:23.963029 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:23.963029 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:23.963029 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 338/689] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:23.969720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6c5f2-4e4f-4c9f-b915-48b968899496 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:23.976044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:24.005975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e44e32-0880-4ce3-b092-a72b64803cb8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:24.070630 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ede605-d9e1-47d1-a017-acb2765da570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:24.071623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ede605-d9e1-47d1-a017-acb2765da570 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:24.073027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ede605-d9e1-47d1-a017-acb2765da570 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:24.073523 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ede605-d9e1-47d1-a017-acb2765da570 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:24.084521 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:24.145442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6c5f2-4e4f-4c9f-b915-48b968899496 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:24.184872 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ede605-d9e1-47d1-a017-acb2765da570 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:24.186307 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ede605-d9e1-47d1-a017-acb2765da570 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:24.208395 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648ee7f-9b2b-4023-b52a-6dab5f92b9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:24.209069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648ee7f-9b2b-4023-b52a-6dab5f92b9bb None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:24.209359 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648ee7f-9b2b-4023-b52a-6dab5f92b9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:24.209637 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648ee7f-9b2b-4023-b52a-6dab5f92b9bb None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:24.210351 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648ee7f-9b2b-4023-b52a-6dab5f92b9bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:24.210662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648ee7f-9b2b-4023-b52a-6dab5f92b9bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:24.212071 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648ee7f-9b2b-4023-b52a-6dab5f92b9bb None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:24.238199 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 339/690] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:24.243773 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648ee7f-9b2b-4023-b52a-6dab5f92b9bb None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:24.273179 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:24.310261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 352/691] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:24.317748 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ede605-d9e1-47d1-a017-acb2765da570 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:24.435166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648ee7f-9b2b-4023-b52a-6dab5f92b9bb None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:24.457104 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:24.507320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbb4f2-2f50-4860-8216-f69d95964257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:24.507987 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbb4f2-2f50-4860-8216-f69d95964257 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:24.508272 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbb4f2-2f50-4860-8216-f69d95964257 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:24.508551 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbb4f2-2f50-4860-8216-f69d95964257 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:24.511332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ede605-d9e1-47d1-a017-acb2765da570 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:24.525935 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbb4f2-2f50-4860-8216-f69d95964257 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:24.527404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbb4f2-2f50-4860-8216-f69d95964257 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:24.546859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-cccbb4f2-2f50-4860-8216-f69d95964257 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:45:24.546859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:24.546859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:24.546859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:24.546859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:24.546859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:24.546859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:24.546859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:24.546859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:24.546859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:24.546859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:24.546859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:24.546859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:24.546859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:24.546859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:24.546859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:24.548461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:24.548461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:24.548461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:24.548461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:24.548461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:24.548461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:24.548461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:24.548461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:24.548461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:24.548461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:24.548461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:24.548461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:24.548461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:24.548461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:24.548461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:24.548461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:24.548461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:24.548461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:24.549544 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:24.549544 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:24.549544 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:24.549544 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:24.549544 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:24.549544 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:24.549544 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:24.549544 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:24.549544 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:45:24.549544 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:24.555888 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 340/692] 10.222.0.75 () {56 vars in 1093 bytes} [Thu Jul 28 17:45:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:24.556822 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbb4f2-2f50-4860-8216-f69d95964257 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:24.578264 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b13d87-791d-4ec4-832c-a46027c1e75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:24.578947 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b13d87-791d-4ec4-832c-a46027c1e75e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:24.579236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b13d87-791d-4ec4-832c-a46027c1e75e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:24.579515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b13d87-791d-4ec4-832c-a46027c1e75e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:24.590777 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b13d87-791d-4ec4-832c-a46027c1e75e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:24.592235 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b13d87-791d-4ec4-832c-a46027c1e75e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:24.608705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-22b13d87-791d-4ec4-832c-a46027c1e75e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:24.608705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:24.608705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:24.608705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:24.608705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:24.608705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:24.608705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:24.608705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:24.608705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:24.608705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:24.608705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:24.608705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:24.608705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:24.608705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:24.608705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:24.624513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:24.624513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:24.624513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:24.624513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:24.624513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:24.624513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:24.624513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:24.624513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:24.624513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:24.624513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:24.624513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:24.624513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:24.624513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:24.624513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:24.624513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:24.624513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:24.624513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:24.625444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:24.625444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:24.625444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:24.625444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:24.625444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 353/693] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:24.625444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b13d87-791d-4ec4-832c-a46027c1e75e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:24.673849 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:24.753434 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b13d87-791d-4ec4-832c-a46027c1e75e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:24.774666 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbb4f2-2f50-4860-8216-f69d95964257 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:24.795593 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111b4bc-abc1-44db-9a5f-cbc5a88473b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:24.796226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111b4bc-abc1-44db-9a5f-cbc5a88473b1 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:24.796508 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111b4bc-abc1-44db-9a5f-cbc5a88473b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:24.796805 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111b4bc-abc1-44db-9a5f-cbc5a88473b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:24.797507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111b4bc-abc1-44db-9a5f-cbc5a88473b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:24.798385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111b4bc-abc1-44db-9a5f-cbc5a88473b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:24.799799 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111b4bc-abc1-44db-9a5f-cbc5a88473b1 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:24.822958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 354/694] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:24.824312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8956de4-5efa-40d4-8e0d-ff7098923420 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:24.824601 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8956de4-5efa-40d4-8e0d-ff7098923420 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:24.824906 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8956de4-5efa-40d4-8e0d-ff7098923420 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:24.826594 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 355/695] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:24.827388 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8956de4-5efa-40d4-8e0d-ff7098923420 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:24.834033 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4435b8-1c98-41e4-ad62-b5505983340f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:24.834673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4435b8-1c98-41e4-ad62-b5505983340f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:24.834956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4435b8-1c98-41e4-ad62-b5505983340f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:24.835229 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4435b8-1c98-41e4-ad62-b5505983340f None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:24.836039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4435b8-1c98-41e4-ad62-b5505983340f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:24.836350 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4435b8-1c98-41e4-ad62-b5505983340f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:24.837818 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4435b8-1c98-41e4-ad62-b5505983340f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:24.858546 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 341/696] 10.222.0.75 () {56 vars in 1133 bytes} [Thu Jul 28 17:45:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:24.859806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5d71f-7b7f-4179-a131-6388d2bdc2e5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:24.860093 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5d71f-7b7f-4179-a131-6388d2bdc2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:24.860960 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5d71f-7b7f-4179-a131-6388d2bdc2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:24.881210 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7ef5d71f-7b7f-4179-a131-6388d2bdc2e5 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:24.882459 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7ef5d71f-7b7f-4179-a131-6388d2bdc2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:24.910679 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:24.949199 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:24.965131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 342/697] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:24.965131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5d71f-7b7f-4179-a131-6388d2bdc2e5 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:24.980172 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8956de4-5efa-40d4-8e0d-ff7098923420 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:25.027481 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d6a5b-f514-4a4c-8ed4-74cce53a03e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:25.028364 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d6a5b-f514-4a4c-8ed4-74cce53a03e8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:25.028841 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d6a5b-f514-4a4c-8ed4-74cce53a03e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:25.029270 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d6a5b-f514-4a4c-8ed4-74cce53a03e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:25.037186 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d6a5b-f514-4a4c-8ed4-74cce53a03e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:25.038878 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d6a5b-f514-4a4c-8ed4-74cce53a03e8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:25.051640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-675d6a5b-f514-4a4c-8ed4-74cce53a03e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:25.051640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:25.051640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:25.051640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:25.051640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:25.051640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:25.051640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:25.051640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:25.051640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:25.051640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:25.051640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:25.051640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:25.051640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:25.051640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:25.051640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:25.052663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:25.052663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:25.052663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:25.052663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:25.052663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:25.052663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:25.052663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:25.052663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:25.052663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:25.052663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:25.052663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:25.052663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:25.052663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:25.052663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:25.052663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:25.052663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:25.052663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:25.053588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:25.053588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:25.053588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:25.053588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:25.053588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:25.053588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:25.053588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:25.053588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:25.055925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 356/698] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:25.057095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d6a5b-f514-4a4c-8ed4-74cce53a03e8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:25.086815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5d71f-7b7f-4179-a131-6388d2bdc2e5 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:25.123548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce99825-e29d-47a0-acd4-11a4eb8c794f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:25.124264 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce99825-e29d-47a0-acd4-11a4eb8c794f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:25.124536 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce99825-e29d-47a0-acd4-11a4eb8c794f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:25.124865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce99825-e29d-47a0-acd4-11a4eb8c794f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:25.155428 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:25.161332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d6a5b-f514-4a4c-8ed4-74cce53a03e8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:25.195953 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e09317-28c6-40fd-a8b2-4dd9f6482b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:25.197002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e09317-28c6-40fd-a8b2-4dd9f6482b5b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:25.197492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e09317-28c6-40fd-a8b2-4dd9f6482b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:25.197985 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e09317-28c6-40fd-a8b2-4dd9f6482b5b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:25.198855 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e09317-28c6-40fd-a8b2-4dd9f6482b5b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:25.199737 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce99825-e29d-47a0-acd4-11a4eb8c794f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:25.200672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e09317-28c6-40fd-a8b2-4dd9f6482b5b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:25.201354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce99825-e29d-47a0-acd4-11a4eb8c794f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:25.213095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-d0e09317-28c6-40fd-a8b2-4dd9f6482b5b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:45:25.213095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:25.213095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:25.213095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:25.213095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:25.213095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:25.213095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:25.213095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:25.213095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:45:25.213095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:25.213095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:25.213095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:25.213095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:25.213095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:25.213095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:25.213095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:25.214093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:25.214093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:25.214093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:25.214093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:25.214093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:25.214093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:25.214093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:25.214093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:25.214093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:25.214093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:25.214093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:25.214093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:25.214093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:25.214093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:25.214093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:25.214093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:25.214976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:25.214976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:25.214976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:25.214976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:25.214976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:25.214976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:25.214976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:25.214976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:25.214976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:25.214976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:25.214976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:25.214976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:25.214976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:25.214976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:45:25.214976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:25.222843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 357/699] 10.222.0.75 () {56 vars in 1129 bytes} [Thu Jul 28 17:45:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:25.223905 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e09317-28c6-40fd-a8b2-4dd9f6482b5b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:25.237104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:25.313798 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 343/700] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:25.314643 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce99825-e29d-47a0-acd4-11a4eb8c794f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:25.328034 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e09317-28c6-40fd-a8b2-4dd9f6482b5b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:25.368890 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5498f00-eb93-40d2-8cd5-3d07b97514f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:25.369531 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5498f00-eb93-40d2-8cd5-3d07b97514f9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:25.369814 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5498f00-eb93-40d2-8cd5-3d07b97514f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:25.370093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5498f00-eb93-40d2-8cd5-3d07b97514f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:25.370938 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5498f00-eb93-40d2-8cd5-3d07b97514f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:25.371251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5498f00-eb93-40d2-8cd5-3d07b97514f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:25.372718 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5498f00-eb93-40d2-8cd5-3d07b97514f9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:25.376438 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:25.386404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 358/701] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:25.388538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5498f00-eb93-40d2-8cd5-3d07b97514f9 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:25.421634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce99825-e29d-47a0-acd4-11a4eb8c794f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:25.458794 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f08fd5-1470-456e-90ae-6808a09567a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:25.459673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f08fd5-1470-456e-90ae-6808a09567a1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:25.460105 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f08fd5-1470-456e-90ae-6808a09567a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:25.460628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f08fd5-1470-456e-90ae-6808a09567a1 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:25.461286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:25.462291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f08fd5-1470-456e-90ae-6808a09567a1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:25.462816 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f08fd5-1470-456e-90ae-6808a09567a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:25.464339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f08fd5-1470-456e-90ae-6808a09567a1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:25.469999 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 344/702] 10.222.0.75 () {56 vars in 1124 bytes} [Thu Jul 28 17:45:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:25.471313 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f08fd5-1470-456e-90ae-6808a09567a1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:25.493373 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5498f00-eb93-40d2-8cd5-3d07b97514f9 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:25.531462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38a614-a46e-4ca6-9a7e-5d7d01d57e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:25.532130 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38a614-a46e-4ca6-9a7e-5d7d01d57e48 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:25.532380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38a614-a46e-4ca6-9a7e-5d7d01d57e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:25.532666 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38a614-a46e-4ca6-9a7e-5d7d01d57e48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:25.543369 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38a614-a46e-4ca6-9a7e-5d7d01d57e48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:25.544895 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38a614-a46e-4ca6-9a7e-5d7d01d57e48 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:25.560439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-6d38a614-a46e-4ca6-9a7e-5d7d01d57e48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:25.560439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:25.560439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:25.560439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:25.560439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:25.560439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:25.560439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:25.560439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:25.560439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:25.560439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:25.560439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:25.560439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:25.560439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:25.560439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:25.560439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:25.561568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:25.561568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:25.561568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:25.561568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:25.561568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:25.561568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:25.561568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:25.561568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:25.561568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:25.561568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:25.561568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:25.561568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:25.561568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:25.561568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:25.561568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:25.561568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:25.561568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:25.562450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:25.562450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:25.562450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:25.562450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:25.567032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 359/703] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:25.567849 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38a614-a46e-4ca6-9a7e-5d7d01d57e48 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:25.586753 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f08fd5-1470-456e-90ae-6808a09567a1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:25.612617 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:25.626445 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981941a-bf08-4d2a-bf95-206233e5a901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:25.627445 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981941a-bf08-4d2a-bf95-206233e5a901 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:25.627873 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981941a-bf08-4d2a-bf95-206233e5a901 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:25.628291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981941a-bf08-4d2a-bf95-206233e5a901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:25.629997 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981941a-bf08-4d2a-bf95-206233e5a901 None admin] RBAC: Adding query filter params (role.id=6f10ff8509da43688fba83e6a4fd5c5f, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=d77b4fcb974d48a0bda4852c8d304511) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:25.629997 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981941a-bf08-4d2a-bf95-206233e5a901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:25.631533 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981941a-bf08-4d2a-bf95-206233e5a901 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:25.638459 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 345/704] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:25 2022] GET /identity/v3/role_assignments?user.id=d77b4fcb974d48a0bda4852c8d304511&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=6f10ff8509da43688fba83e6a4fd5c5f => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:25.639558 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981941a-bf08-4d2a-bf95-206233e5a901 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:25.675747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38a614-a46e-4ca6-9a7e-5d7d01d57e48 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:25.700960 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:25.732864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bda6de-e197-49da-952a-f1c4cb82cdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:25.733517 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bda6de-e197-49da-952a-f1c4cb82cdb5 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:25.733801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bda6de-e197-49da-952a-f1c4cb82cdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:25.734094 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bda6de-e197-49da-952a-f1c4cb82cdb5 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:25.734853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bda6de-e197-49da-952a-f1c4cb82cdb5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:25.735758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bda6de-e197-49da-952a-f1c4cb82cdb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:25.737244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bda6de-e197-49da-952a-f1c4cb82cdb5 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:25.758451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981941a-bf08-4d2a-bf95-206233e5a901 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:25.758896 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 360/705] 10.222.0.75 () {56 vars in 1124 bytes} [Thu Jul 28 17:45:25 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:25.799775 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51ee1c-1205-4b2b-9bdd-d92d1de9ef0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:25.800682 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51ee1c-1205-4b2b-9bdd-d92d1de9ef0e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:25.801264 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51ee1c-1205-4b2b-9bdd-d92d1de9ef0e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:25.801696 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51ee1c-1205-4b2b-9bdd-d92d1de9ef0e None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:25.802597 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51ee1c-1205-4b2b-9bdd-d92d1de9ef0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:25.803078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51ee1c-1205-4b2b-9bdd-d92d1de9ef0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:25.804715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51ee1c-1205-4b2b-9bdd-d92d1de9ef0e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:25.819980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 346/706] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:25.825236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bda6de-e197-49da-952a-f1c4cb82cdb5 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:25.972834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bda6de-e197-49da-952a-f1c4cb82cdb5 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:25.973575 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11af0d-f712-4785-8103-b35e715e78c3 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:25.974081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11af0d-f712-4785-8103-b35e715e78c3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:25.974597 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11af0d-f712-4785-8103-b35e715e78c3 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:25.976121 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 347/707] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:45:25.981904 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9188b5b-1000-4b19-9a31-c5ef2002966a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:25.982600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9188b5b-1000-4b19-9a31-c5ef2002966a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:25.983084 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9188b5b-1000-4b19-9a31-c5ef2002966a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:26.006250 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f9188b5b-1000-4b19-9a31-c5ef2002966a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:26.007905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f9188b5b-1000-4b19-9a31-c5ef2002966a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:26.012308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df3c37-eb1e-426b-bcd5-9ef3c7c6e999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:26.013057 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df3c37-eb1e-426b-bcd5-9ef3c7c6e999 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:26.013341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df3c37-eb1e-426b-bcd5-9ef3c7c6e999 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:26.013616 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df3c37-eb1e-426b-bcd5-9ef3c7c6e999 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:26.021800 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df3c37-eb1e-426b-bcd5-9ef3c7c6e999 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:26.022762 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df3c37-eb1e-426b-bcd5-9ef3c7c6e999 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:26.160882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-70df3c37-eb1e-426b-bcd5-9ef3c7c6e999 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:26.160882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:26.160882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:26.160882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:26.160882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:26.160882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:26.160882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:26.160882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:26.160882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:26.160882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:26.160882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:26.160882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:26.160882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:26.160882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:26.160882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:26.161806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:26.161806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:26.161806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:26.161806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:26.161806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:26.161806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:26.161806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:26.161806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:26.161806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:26.161806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:26.161806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:26.161806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:26.161806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:26.161806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:26.161806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:26.161806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:26.161806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:26.163148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:26.163148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:26.163148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:26.163148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:26.163148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:26.163148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:26.163148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:26.163148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:26.163148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 361/708] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:26.163633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d9075-4380-4c11-b6cf-c6f355ca3f19 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:26.163918 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d9075-4380-4c11-b6cf-c6f355ca3f19 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:26.164787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d9075-4380-4c11-b6cf-c6f355ca3f19 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:26.173233 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 362/709] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:26.173233 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d9075-4380-4c11-b6cf-c6f355ca3f19 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:26.201839 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:26.235947 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 348/710] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:45:26.237322 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef56644-d569-414e-91c3-7bf54db0cc39 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:26.237607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef56644-d569-414e-91c3-7bf54db0cc39 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:26.237879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef56644-d569-414e-91c3-7bf54db0cc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:26.242201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:26.263241 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1ef56644-d569-414e-91c3-7bf54db0cc39 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:26.264522 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1ef56644-d569-414e-91c3-7bf54db0cc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:26.312635 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d9075-4380-4c11-b6cf-c6f355ca3f19 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:26.360773 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 349/711] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:26.360773 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef56644-d569-414e-91c3-7bf54db0cc39 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:26.368259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae56f5-0de5-4a4f-bda7-0299b905d398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:26.368920 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae56f5-0de5-4a4f-bda7-0299b905d398 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:26.370717 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae56f5-0de5-4a4f-bda7-0299b905d398 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:26.371060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae56f5-0de5-4a4f-bda7-0299b905d398 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:26.371831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae56f5-0de5-4a4f-bda7-0299b905d398 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:26.372151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae56f5-0de5-4a4f-bda7-0299b905d398 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:26.376296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae56f5-0de5-4a4f-bda7-0299b905d398 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:26.396216 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 363/712] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:26.398175 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae56f5-0de5-4a4f-bda7-0299b905d398 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:26.488005 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef56644-d569-414e-91c3-7bf54db0cc39 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:26.496168 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:26.507300 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae56f5-0de5-4a4f-bda7-0299b905d398 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:26.515035 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:26.528096 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab3f86-9f66-46b1-ada8-d0303de3af3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:26.529026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab3f86-9f66-46b1-ada8-d0303de3af3e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:26.529488 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab3f86-9f66-46b1-ada8-d0303de3af3e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:26.529968 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab3f86-9f66-46b1-ada8-d0303de3af3e None admin] PATH_INFO: `/v3/services/network` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:26.530796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab3f86-9f66-46b1-ada8-d0303de3af3e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:26.532425 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab3f86-9f66-46b1-ada8-d0303de3af3e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:26.543937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d51e79-0f17-4b95-83aa-d60aec32aaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:26.544599 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d51e79-0f17-4b95-83aa-d60aec32aaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:26.544817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-96ab3f86-9f66-46b1-ada8-d0303de3af3e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:45:26.544817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:26.544817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:26.544817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:26.544817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:26.544817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:26.544817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:26.544817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:26.544817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:45:26.544817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:26.544817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:26.544817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:26.544817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:26.544817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:26.544817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:26.544817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:26.544817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:26.545789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:26.545789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:26.545789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:26.545789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:26.545789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:26.545789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:26.545789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:26.545789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:26.545789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:26.545789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:26.545789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:26.545789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:26.545789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:26.545789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:26.545789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:26.545789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:26.546608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:26.546608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:26.546608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:26.546608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:26.546608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:26.546608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:26.546608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:26.546608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:26.546608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:26.546608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:26.546608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:26.546608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:26.546608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:45:26.546608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:26.547429 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d51e79-0f17-4b95-83aa-d60aec32aaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:26.547429 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d51e79-0f17-4b95-83aa-d60aec32aaa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:26.551389 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 350/713] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:26 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:26.552569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab3f86-9f66-46b1-ada8-d0303de3af3e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:26.558270 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d51e79-0f17-4b95-83aa-d60aec32aaa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:26.559758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d51e79-0f17-4b95-83aa-d60aec32aaa8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:26.575299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-40d51e79-0f17-4b95-83aa-d60aec32aaa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:26.575299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:26.575299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:26.575299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:26.575299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:26.575299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:26.575299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:26.575299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:26.575299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:26.575299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:26.575299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:26.575299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:26.575299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:26.575299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:26.575299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:26.576304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:26.576304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:26.576304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:26.576304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:26.576304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:26.576304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:26.576304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:26.576304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:26.576304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:26.576304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:26.576304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:26.576304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:26.576304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:26.576304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:26.576304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:26.576304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:26.576304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:26.582738 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:26.582738 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:26.582738 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:26.582738 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:26.582738 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 364/714] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:26.582738 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d51e79-0f17-4b95-83aa-d60aec32aaa8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:26.690459 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab3f86-9f66-46b1-ada8-d0303de3af3e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:26.706663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d51e79-0f17-4b95-83aa-d60aec32aaa8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:26.727411 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0d81b-2058-4494-8794-e19a55a4b3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:26.728087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0d81b-2058-4494-8794-e19a55a4b3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:26.728371 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0d81b-2058-4494-8794-e19a55a4b3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:26.728646 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0d81b-2058-4494-8794-e19a55a4b3e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:26.729469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0d81b-2058-4494-8794-e19a55a4b3e4 None admin] RBAC: Adding query filter params (role.id=d371062e071845ffa4570a76d40dff88, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=c456a787159844feb7eabfd1e527e46e) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:26.729777 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0d81b-2058-4494-8794-e19a55a4b3e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:26.731407 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0d81b-2058-4494-8794-e19a55a4b3e4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:26.736890 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 351/715] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:26 2022] GET /identity/v3/role_assignments?user.id=c456a787159844feb7eabfd1e527e46e&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=d371062e071845ffa4570a76d40dff88 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:26.737671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0d81b-2058-4494-8794-e19a55a4b3e4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:26.746011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49d4d2-d9da-4e28-b834-357fb97f6874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:26.747156 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49d4d2-d9da-4e28-b834-357fb97f6874 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:26.747645 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49d4d2-d9da-4e28-b834-357fb97f6874 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:26.748122 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49d4d2-d9da-4e28-b834-357fb97f6874 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:26.749082 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49d4d2-d9da-4e28-b834-357fb97f6874 None admin] RBAC: Adding query filter params (name=network) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:26.749606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49d4d2-d9da-4e28-b834-357fb97f6874 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:26.751389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49d4d2-d9da-4e28-b834-357fb97f6874 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:26.757117 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 365/716] 10.222.0.75 () {56 vars in 1112 bytes} [Thu Jul 28 17:45:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:26.771550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49d4d2-d9da-4e28-b834-357fb97f6874 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:26.785064 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:26.828034 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:26.870253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0d81b-2058-4494-8794-e19a55a4b3e4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:26.909979 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa057005-d4ab-466c-aa87-a9b6bced2080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:26.910619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa057005-d4ab-466c-aa87-a9b6bced2080 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:26.910903 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa057005-d4ab-466c-aa87-a9b6bced2080 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:26.911178 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa057005-d4ab-466c-aa87-a9b6bced2080 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:26.911893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa057005-d4ab-466c-aa87-a9b6bced2080 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:26.912205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa057005-d4ab-466c-aa87-a9b6bced2080 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:26.913694 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa057005-d4ab-466c-aa87-a9b6bced2080 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:26.927207 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 352/717] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:26.938841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa057005-d4ab-466c-aa87-a9b6bced2080 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:26.974255 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49d4d2-d9da-4e28-b834-357fb97f6874 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:27.033633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11876e8d-122c-492f-9322-2fe24649eb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:27.034193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11876e8d-122c-492f-9322-2fe24649eb89 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:27.034470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11876e8d-122c-492f-9322-2fe24649eb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:27.034743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11876e8d-122c-492f-9322-2fe24649eb89 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:27.035430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11876e8d-122c-492f-9322-2fe24649eb89 None admin] RBAC: Adding query filter params (type=network) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:27.035732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11876e8d-122c-492f-9322-2fe24649eb89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:27.037176 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11876e8d-122c-492f-9322-2fe24649eb89 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:27.049225 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 366/718] 10.222.0.75 () {56 vars in 1112 bytes} [Thu Jul 28 17:45:26 2022] GET /identity/v3/services?type=network => generated 124 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:27.076799 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:27.089592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa057005-d4ab-466c-aa87-a9b6bced2080 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:27.152496 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789af41-6a22-4957-9c6e-02289146c05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:27.153327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789af41-6a22-4957-9c6e-02289146c05b None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:27.153617 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789af41-6a22-4957-9c6e-02289146c05b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:27.153892 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789af41-6a22-4957-9c6e-02289146c05b None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:27.154592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789af41-6a22-4957-9c6e-02289146c05b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:27.156107 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789af41-6a22-4957-9c6e-02289146c05b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:27.242644 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 353/719] 10.222.0.75 () {60 vars in 1132 bytes} [Thu Jul 28 17:45:26 2022] POST /identity/v3/users => generated 254 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:45:27.984397 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d47cad-cb53-434b-84ed-6e634d01b89c None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:27.984972 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d47cad-cb53-434b-84ed-6e634d01b89c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:27.984972 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d47cad-cb53-434b-84ed-6e634d01b89c None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:27.986572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 367/720] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:27.991944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904d688-f34e-4cae-9b29-12f1665bea5c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:27.992457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904d688-f34e-4cae-9b29-12f1665bea5c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:27.992984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904d688-f34e-4cae-9b29-12f1665bea5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:28.018690 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7904d688-f34e-4cae-9b29-12f1665bea5c None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:28.020244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7904d688-f34e-4cae-9b29-12f1665bea5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:28.109658 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 354/721] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:28.144012 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d47cad-cb53-434b-84ed-6e634d01b89c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:28.250620 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:28.271580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d47cad-cb53-434b-84ed-6e634d01b89c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:28.272833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c6303-c760-41dd-81ba-448079b64312 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:28.273273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c6303-c760-41dd-81ba-448079b64312 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:28.273459 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c6303-c760-41dd-81ba-448079b64312 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:28.275002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 355/722] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:45:28.292812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31de39c-5cc6-45e8-b311-84d6d3961d1a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:28.292812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31de39c-5cc6-45e8-b311-84d6d3961d1a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:28.292812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31de39c-5cc6-45e8-b311-84d6d3961d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:28.319393 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d31de39c-5cc6-45e8-b311-84d6d3961d1a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:28.319585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08132c1b-55f6-4f11-8c86-f452fd0c0d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:28.320121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08132c1b-55f6-4f11-8c86-f452fd0c0d7c None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:28.320401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08132c1b-55f6-4f11-8c86-f452fd0c0d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:28.320570 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d31de39c-5cc6-45e8-b311-84d6d3961d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:28.320667 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08132c1b-55f6-4f11-8c86-f452fd0c0d7c None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:28.321408 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08132c1b-55f6-4f11-8c86-f452fd0c0d7c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:28.322916 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08132c1b-55f6-4f11-8c86-f452fd0c0d7c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:28.396315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 356/723] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:28.420147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31de39c-5cc6-45e8-b311-84d6d3961d1a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:28.435355 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:28.449394 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 368/724] 10.222.0.75 () {60 vars in 1141 bytes} [Thu Jul 28 17:45:28 2022] POST /identity/v3/services => generated 251 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:45:28.536366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31de39c-5cc6-45e8-b311-84d6d3961d1a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:28.590181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135b8ad-a96a-4f81-9c4d-37cbcce0df12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:28.590852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135b8ad-a96a-4f81-9c4d-37cbcce0df12 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:28.591132 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135b8ad-a96a-4f81-9c4d-37cbcce0df12 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:28.591402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135b8ad-a96a-4f81-9c4d-37cbcce0df12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:28.613548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135b8ad-a96a-4f81-9c4d-37cbcce0df12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:28.618833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-7135b8ad-a96a-4f81-9c4d-37cbcce0df12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:45:28.618833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:28.618833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:28.618833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:28.618833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:28.618833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:28.618833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:28.618833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:28.618833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:28.618833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:28.618833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:28.618833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:28.618833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:28.618833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:28.618833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:28.618833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:28.619787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:28.619787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:28.619787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:28.619787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:28.619787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:28.619787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:28.619787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:28.619787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:28.619787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:28.619787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:28.619787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:28.619787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:28.619787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:28.619787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:28.619787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:28.619787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:28.621076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:28.621076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:28.621076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:28.621076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:28.621076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:28.621076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:28.621076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:28.621076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:28.621076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:28.621076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:28.621076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:45:28.621076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:28.621076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 357/725] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:45:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:28.628359 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08132c1b-55f6-4f11-8c86-f452fd0c0d7c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:28.760521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08132c1b-55f6-4f11-8c86-f452fd0c0d7c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:28.795304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6b560-e985-4953-b44e-c336c1c8c14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:28.795854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6b560-e985-4953-b44e-c336c1c8c14b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:28.796128 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6b560-e985-4953-b44e-c336c1c8c14b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:28.796396 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6b560-e985-4953-b44e-c336c1c8c14b None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:28.797212 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6b560-e985-4953-b44e-c336c1c8c14b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:28.798064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6b560-e985-4953-b44e-c336c1c8c14b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:28.799455 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6b560-e985-4953-b44e-c336c1c8c14b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:28.808517 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 369/726] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:45:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:28.814627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135b8ad-a96a-4f81-9c4d-37cbcce0df12 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:28.884638 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:28.919760 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135b8ad-a96a-4f81-9c4d-37cbcce0df12 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:28.939601 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4d308-9911-4e15-8320-5808828c5515 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:28.939885 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4d308-9911-4e15-8320-5808828c5515 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:28.940157 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4d308-9911-4e15-8320-5808828c5515 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:28.941547 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 370/727] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:45:28.946841 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331555a-3219-401d-a909-d59097fb85ce None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:28.947149 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331555a-3219-401d-a909-d59097fb85ce None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:28.947411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331555a-3219-401d-a909-d59097fb85ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:28.966783 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ba3ab-10dd-46e1-8b9d-2dfcf561f003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:28.967797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ba3ab-10dd-46e1-8b9d-2dfcf561f003 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:28.968309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ba3ab-10dd-46e1-8b9d-2dfcf561f003 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:28.968820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ba3ab-10dd-46e1-8b9d-2dfcf561f003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:28.971778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-7331555a-3219-401d-a909-d59097fb85ce None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:28.974024 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7331555a-3219-401d-a909-d59097fb85ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:28.981063 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:28.983663 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ba3ab-10dd-46e1-8b9d-2dfcf561f003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:28.985454 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ba3ab-10dd-46e1-8b9d-2dfcf561f003 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:29.009354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-760ba3ab-10dd-46e1-8b9d-2dfcf561f003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:29.009354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:29.009354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:29.009354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:29.009354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:29.009354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:29.009354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:29.009354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:29.009354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:29.009354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:29.009354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:29.009354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:29.009354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:29.009354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:29.009354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:29.010329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:29.010329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:29.010329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:29.010329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:29.010329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:29.010329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:29.010329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:29.010329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:29.010329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:29.010329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:29.010329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:29.010329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:29.010329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:29.010329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:29.010329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:29.010329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:29.010329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:29.011279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:29.011279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:29.011279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:29.011279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:29.013506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 358/728] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:29.029525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ba3ab-10dd-46e1-8b9d-2dfcf561f003 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:29.059464 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 371/729] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:28 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:45:29.078405 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331555a-3219-401d-a909-d59097fb85ce None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:29.183979 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331555a-3219-401d-a909-d59097fb85ce None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:29.221024 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca723893-a891-4ee7-9959-1832d3bbfe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:29.221711 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca723893-a891-4ee7-9959-1832d3bbfe93 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:29.222016 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca723893-a891-4ee7-9959-1832d3bbfe93 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:29.222273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca723893-a891-4ee7-9959-1832d3bbfe93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:29.230809 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:29.237553 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca723893-a891-4ee7-9959-1832d3bbfe93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:29.242864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-ca723893-a891-4ee7-9959-1832d3bbfe93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:45:29.242864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:29.242864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:29.242864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:29.242864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:29.242864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:29.242864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:29.242864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:29.242864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:29.242864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:29.242864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:29.242864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:29.242864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:29.242864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:29.242864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:29.242864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:29.260935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:29.260935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:29.260935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:29.260935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:29.260935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:29.260935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:29.260935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:29.260935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:29.260935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:29.260935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:29.260935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:29.260935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:29.260935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:29.260935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:29.260935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:29.260935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:29.261843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:29.261843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:29.261843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:29.261843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:29.261843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:29.261843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:29.261843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:29.261843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:29.261843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:29.261843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:29.261843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:45:29.261843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:29.261843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 372/730] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:45:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:29.261843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca723893-a891-4ee7-9959-1832d3bbfe93 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:29.311761 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ba3ab-10dd-46e1-8b9d-2dfcf561f003 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:29.353304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:29.387220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046099ed-06b4-49fb-a19c-9c84058e7bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:29.387859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046099ed-06b4-49fb-a19c-9c84058e7bbd None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:29.388144 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046099ed-06b4-49fb-a19c-9c84058e7bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:29.388424 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046099ed-06b4-49fb-a19c-9c84058e7bbd None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:29.389166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046099ed-06b4-49fb-a19c-9c84058e7bbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:29.389480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046099ed-06b4-49fb-a19c-9c84058e7bbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:29.393179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046099ed-06b4-49fb-a19c-9c84058e7bbd None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:29.406981 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 359/731] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:29.408247 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1010e-79e1-4899-b111-76f87b683fb6 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:29.408535 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1010e-79e1-4899-b111-76f87b683fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:29.408829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1010e-79e1-4899-b111-76f87b683fb6 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:29.414845 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 360/732] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:29.416138 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19524a98-6818-485b-86fd-c4963baa0f96 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:29.416532 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19524a98-6818-485b-86fd-c4963baa0f96 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:29.416885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19524a98-6818-485b-86fd-c4963baa0f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:29.437122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-19524a98-6818-485b-86fd-c4963baa0f96 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:29.437516 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca723893-a891-4ee7-9959-1832d3bbfe93 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:29.438887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-19524a98-6818-485b-86fd-c4963baa0f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:29.479520 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c946d8-b57d-4a44-a448-5d76da6cf4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:29.480309 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c946d8-b57d-4a44-a448-5d76da6cf4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:29.480599 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c946d8-b57d-4a44-a448-5d76da6cf4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:29.481216 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c946d8-b57d-4a44-a448-5d76da6cf4b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:29.482228 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c946d8-b57d-4a44-a448-5d76da6cf4b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:29.482642 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c946d8-b57d-4a44-a448-5d76da6cf4b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:29.484245 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c946d8-b57d-4a44-a448-5d76da6cf4b4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:29.496843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 373/733] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:45:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:29.497708 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c946d8-b57d-4a44-a448-5d76da6cf4b4 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:29.533764 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 361/734] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:29 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:45:29.536995 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19524a98-6818-485b-86fd-c4963baa0f96 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:29.588780 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:29.636415 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c946d8-b57d-4a44-a448-5d76da6cf4b4 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:29.685873 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5fd1d-6135-4e13-b6af-9f3142f206f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:29.686539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5fd1d-6135-4e13-b6af-9f3142f206f6 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:29.686823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5fd1d-6135-4e13-b6af-9f3142f206f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:29.687101 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5fd1d-6135-4e13-b6af-9f3142f206f6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:29.690617 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19524a98-6818-485b-86fd-c4963baa0f96 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:29.697487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5fd1d-6135-4e13-b6af-9f3142f206f6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:29.698967 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5fd1d-6135-4e13-b6af-9f3142f206f6 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:29.703740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:29.715115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-54d5fd1d-6135-4e13-b6af-9f3142f206f6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:45:29.715115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:29.715115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:29.715115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:29.715115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:29.715115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:29.715115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:29.715115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:29.715115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:29.715115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:29.715115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:29.715115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:29.715115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:29.715115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:29.715115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:29.715115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:29.716129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:29.716129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:29.716129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:29.716129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:29.716129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:29.716129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:29.716129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:29.716129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:29.716129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:29.716129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:29.716129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:29.716129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:29.716129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:29.716129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:29.716129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:29.716129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:29.716129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:29.716129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:29.717675 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:29.717675 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:29.717675 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:29.717675 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:29.717675 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:29.717675 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:29.717675 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:29.717675 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:29.717675 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:45:29.717675 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:29.721043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 374/735] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:45:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:29.722003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5fd1d-6135-4e13-b6af-9f3142f206f6 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:29.744424 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa4ef2-265c-4efc-a8d0-525744b01468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:29.745141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa4ef2-265c-4efc-a8d0-525744b01468 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:29.745374 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa4ef2-265c-4efc-a8d0-525744b01468 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:29.745645 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa4ef2-265c-4efc-a8d0-525744b01468 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:29.756986 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa4ef2-265c-4efc-a8d0-525744b01468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:29.758676 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa4ef2-265c-4efc-a8d0-525744b01468 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:29.773669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-d1aa4ef2-265c-4efc-a8d0-525744b01468 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:29.773669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:29.773669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:29.773669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:29.773669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:29.773669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:29.773669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:29.773669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:29.773669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:29.773669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:29.773669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:29.773669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:29.773669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:29.773669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:29.773669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:29.775086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:29.775086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:29.775086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:29.775086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:29.775086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:29.775086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:29.775086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:29.775086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:29.775086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:29.775086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:29.775086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:29.775086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:29.775086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:29.775086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:29.775086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:29.775086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:29.775086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:29.775972 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:29.775972 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:29.775972 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:29.775972 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:29.779678 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 362/736] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:29.780531 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa4ef2-265c-4efc-a8d0-525744b01468 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:29.854742 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5fd1d-6135-4e13-b6af-9f3142f206f6 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:29.876928 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:29.898009 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3b667-1931-4380-ab29-c1796b49a35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:29.899515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3b667-1931-4380-ab29-c1796b49a35c None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:29.900008 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3b667-1931-4380-ab29-c1796b49a35c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:29.900785 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3b667-1931-4380-ab29-c1796b49a35c None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:29.902136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d3b667-1931-4380-ab29-c1796b49a35c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:29.904397 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d3b667-1931-4380-ab29-c1796b49a35c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:29.910461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa4ef2-265c-4efc-a8d0-525744b01468 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:29.947273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabef79d-94bd-4b1a-aca2-759ca89a3bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:29.948288 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabef79d-94bd-4b1a-aca2-759ca89a3bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:29.948816 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabef79d-94bd-4b1a-aca2-759ca89a3bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:29.949314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabef79d-94bd-4b1a-aca2-759ca89a3bc3 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:29.950792 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabef79d-94bd-4b1a-aca2-759ca89a3bc3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:29.951356 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabef79d-94bd-4b1a-aca2-759ca89a3bc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:29.954644 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabef79d-94bd-4b1a-aca2-759ca89a3bc3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:29.980317 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 363/737] 10.222.0.75 () {56 vars in 1135 bytes} [Thu Jul 28 17:45:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:29.980317 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabef79d-94bd-4b1a-aca2-759ca89a3bc3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:30.001108 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:30.008664 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 375/738] 10.222.0.75 () {60 vars in 1141 bytes} [Thu Jul 28 17:45:29 2022] POST /identity/v3/services => generated 240 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:45:30.009765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3b667-1931-4380-ab29-c1796b49a35c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:30.150344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabef79d-94bd-4b1a-aca2-759ca89a3bc3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:30.196822 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15a2c7-22d8-4932-8dd3-c743f2f208e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:30.197907 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15a2c7-22d8-4932-8dd3-c743f2f208e3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:30.198410 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15a2c7-22d8-4932-8dd3-c743f2f208e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:30.198893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15a2c7-22d8-4932-8dd3-c743f2f208e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:30.199786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15a2c7-22d8-4932-8dd3-c743f2f208e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:30.200312 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15a2c7-22d8-4932-8dd3-c743f2f208e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:30.201945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15a2c7-22d8-4932-8dd3-c743f2f208e3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:30.219089 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 364/739] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:30.225005 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15a2c7-22d8-4932-8dd3-c743f2f208e3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:30.231930 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3b667-1931-4380-ab29-c1796b49a35c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:30.271364 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a56928-0bd5-4858-8034-6d81ceb49989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:30.272411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a56928-0bd5-4858-8034-6d81ceb49989 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:30.272945 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a56928-0bd5-4858-8034-6d81ceb49989 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:30.273424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a56928-0bd5-4858-8034-6d81ceb49989 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:30.324427 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:30.333050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:30.361481 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15a2c7-22d8-4932-8dd3-c743f2f208e3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:30.368730 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a56928-0bd5-4858-8034-6d81ceb49989 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:30.371013 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a56928-0bd5-4858-8034-6d81ceb49989 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:30.407418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344f2f7-1215-47f6-b94a-c55eb8b75e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:30.408650 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344f2f7-1215-47f6-b94a-c55eb8b75e08 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:30.409134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344f2f7-1215-47f6-b94a-c55eb8b75e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:30.409734 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344f2f7-1215-47f6-b94a-c55eb8b75e08 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:30.420470 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344f2f7-1215-47f6-b94a-c55eb8b75e08 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:30.422326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344f2f7-1215-47f6-b94a-c55eb8b75e08 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:30.439442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-8344f2f7-1215-47f6-b94a-c55eb8b75e08 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:45:30.439442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:30.439442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:30.439442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:30.439442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:30.439442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:30.439442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:30.439442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:30.439442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:30.439442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:30.439442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:30.439442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:30.439442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:30.439442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:30.439442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:30.439442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:30.440451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:30.440451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:30.440451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:30.440451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:30.440451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:30.440451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:30.440451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:30.440451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:30.440451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:30.440451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:30.440451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:30.440451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:30.440451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:30.440451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:30.440451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:30.440451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:30.440451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:30.440451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:30.441422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:30.441422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:30.441422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:30.441422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:30.441422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:30.441422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:30.441422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:30.441422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:30.441422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:45:30.441422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:30.442634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 365/740] 10.222.0.75 () {56 vars in 1093 bytes} [Thu Jul 28 17:45:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:30.443679 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec864f-7b77-451b-b4c7-a30e8a457547 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:30.443963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec864f-7b77-451b-b4c7-a30e8a457547 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:30.444237 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec864f-7b77-451b-b4c7-a30e8a457547 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:30.445765 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 366/741] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:30.449983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec864f-7b77-451b-b4c7-a30e8a457547 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:30.513901 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 376/742] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:45:30.515646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a7210-e6e7-4490-a345-b41f00b0e3d2 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:30.516615 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a7210-e6e7-4490-a345-b41f00b0e3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:30.517092 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a7210-e6e7-4490-a345-b41f00b0e3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:30.543595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-5a0a7210-e6e7-4490-a345-b41f00b0e3d2 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:30.545367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5a0a7210-e6e7-4490-a345-b41f00b0e3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:30.566414 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec864f-7b77-451b-b4c7-a30e8a457547 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:30.628858 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 377/743] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:30.630247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a7210-e6e7-4490-a345-b41f00b0e3d2 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:30.647215 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:30.657549 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f62a6-42f2-4252-9148-caed6396927d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:30.658447 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f62a6-42f2-4252-9148-caed6396927d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:30.659119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f62a6-42f2-4252-9148-caed6396927d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:30.659902 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f62a6-42f2-4252-9148-caed6396927d None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:30.660936 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f62a6-42f2-4252-9148-caed6396927d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:30.661450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f62a6-42f2-4252-9148-caed6396927d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:30.663616 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f62a6-42f2-4252-9148-caed6396927d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:30.668390 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:30.687908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 367/744] 10.222.0.75 () {56 vars in 1133 bytes} [Thu Jul 28 17:45:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:30.690563 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f62a6-42f2-4252-9148-caed6396927d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:30.755137 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a7210-e6e7-4490-a345-b41f00b0e3d2 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:30.792698 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc506fec-1efc-4d13-ba40-97443940fee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:30.793484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc506fec-1efc-4d13-ba40-97443940fee2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:30.793826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc506fec-1efc-4d13-ba40-97443940fee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:30.794221 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc506fec-1efc-4d13-ba40-97443940fee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:30.805867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc506fec-1efc-4d13-ba40-97443940fee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:30.807680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc506fec-1efc-4d13-ba40-97443940fee2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:30.818072 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f62a6-42f2-4252-9148-caed6396927d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:30.824662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-dc506fec-1efc-4d13-ba40-97443940fee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:30.824662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:30.824662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:30.824662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:30.824662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:30.824662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:30.824662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:30.824662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:30.824662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:30.824662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:30.824662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:30.824662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:30.824662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:30.824662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:30.824662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:30.825606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:30.825606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:30.825606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:30.825606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:30.825606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:30.825606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:30.825606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:30.825606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:30.825606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:30.825606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:30.825606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:30.825606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:30.825606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:30.825606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:30.825606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:30.825606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:30.825606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:30.826521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:30.826521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:30.826521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:30.826521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:30.831497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 378/745] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:30.832428 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc506fec-1efc-4d13-ba40-97443940fee2 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:30.856784 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4415e-b478-4af3-a35a-d92141f09edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:30.857750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4415e-b478-4af3-a35a-d92141f09edd None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:30.858205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4415e-b478-4af3-a35a-d92141f09edd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:30.858668 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4415e-b478-4af3-a35a-d92141f09edd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:30.869758 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4415e-b478-4af3-a35a-d92141f09edd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:30.875004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-2ec4415e-b478-4af3-a35a-d92141f09edd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:30.875004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:30.875004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:30.875004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:30.875004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:30.875004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:30.875004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:30.875004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:30.875004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:30.875004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:30.875004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:30.875004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:30.875004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:30.875004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:30.875004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:30.875004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:30.876463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:30.876463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:30.876463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:30.876463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:30.876463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:30.876463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:30.876463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:30.876463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:30.876463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:30.876463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:30.876463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:30.876463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:30.876463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:30.876463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:30.876463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:30.876463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:30.877333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:30.877333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:30.877333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:30.877333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:30.877333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:30.877333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:30.877333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:30.877333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:30.877333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:30.877333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:30.877333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:30.877333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:30.880025 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 368/746] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:30.881013 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4415e-b478-4af3-a35a-d92141f09edd None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:30.907825 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:30.937658 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:30.953914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc506fec-1efc-4d13-ba40-97443940fee2 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:30.987001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4415e-b478-4af3-a35a-d92141f09edd None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:30.991389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ee429-2b2d-4e85-83e3-269c033e27d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:30.992270 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ee429-2b2d-4e85-83e3-269c033e27d8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:30.992842 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ee429-2b2d-4e85-83e3-269c033e27d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:30.993318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ee429-2b2d-4e85-83e3-269c033e27d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:31.005691 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ee429-2b2d-4e85-83e3-269c033e27d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:31.007790 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ee429-2b2d-4e85-83e3-269c033e27d8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:31.022471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-b49ee429-2b2d-4e85-83e3-269c033e27d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:31.022471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:31.022471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:31.022471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:31.022471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:31.022471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:31.022471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:31.022471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:31.022471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:31.022471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:31.022471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:31.022471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:31.022471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:31.022471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:31.022471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:31.023619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:31.023619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:31.023619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:31.023619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:31.023619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:31.023619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:31.023619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:31.023619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:31.023619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:31.023619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:31.023619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:31.023619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:31.023619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:31.023619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:31.023619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:31.023619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:31.023619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:31.024903 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:31.024903 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:31.024903 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:31.024903 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:31.024903 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 379/747] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:31.025984 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ee429-2b2d-4e85-83e3-269c033e27d8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:31.029572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8594e-b703-41e5-b073-ce063f1e7f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:31.030367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8594e-b703-41e5-b073-ce063f1e7f46 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:31.030813 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8594e-b703-41e5-b073-ce063f1e7f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:31.031243 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8594e-b703-41e5-b073-ce063f1e7f46 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:31.031985 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8594e-b703-41e5-b073-ce063f1e7f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:31.032296 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8594e-b703-41e5-b073-ce063f1e7f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:31.033714 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8594e-b703-41e5-b073-ce063f1e7f46 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:31.050119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 369/748] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:31.050119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910b0c4-3da6-4917-a708-17e24e9a5b0f None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:31.050119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910b0c4-3da6-4917-a708-17e24e9a5b0f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:31.050119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910b0c4-3da6-4917-a708-17e24e9a5b0f None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:31.050119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 370/749] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:31.050119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910b0c4-3da6-4917-a708-17e24e9a5b0f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:31.143342 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ee429-2b2d-4e85-83e3-269c033e27d8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:31.157491 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:31.159045 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910b0c4-3da6-4917-a708-17e24e9a5b0f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:31.173883 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:31.180097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa84fc5-4330-4738-a802-25c871fb2696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:31.180717 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa84fc5-4330-4738-a802-25c871fb2696 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:31.181032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa84fc5-4330-4738-a802-25c871fb2696 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:31.181310 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa84fc5-4330-4738-a802-25c871fb2696 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:31.182067 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa84fc5-4330-4738-a802-25c871fb2696 None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:31.182456 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa84fc5-4330-4738-a802-25c871fb2696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:31.183881 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa84fc5-4330-4738-a802-25c871fb2696 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:31.198329 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 380/750] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:31.198329 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa84fc5-4330-4738-a802-25c871fb2696 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:31.200581 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63197e49-91bb-4c72-99e7-e509a525032e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:31.201229 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63197e49-91bb-4c72-99e7-e509a525032e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:31.201510 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63197e49-91bb-4c72-99e7-e509a525032e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:31.201787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63197e49-91bb-4c72-99e7-e509a525032e None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:31.202484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63197e49-91bb-4c72-99e7-e509a525032e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:31.202790 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63197e49-91bb-4c72-99e7-e509a525032e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:31.204201 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63197e49-91bb-4c72-99e7-e509a525032e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:31.216665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 371/751] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:31.222263 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d11bf-1869-4a89-836e-3e84d0f42bda None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:31.223031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d11bf-1869-4a89-836e-3e84d0f42bda None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:31.223401 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d11bf-1869-4a89-836e-3e84d0f42bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:31.241991 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0a1d11bf-1869-4a89-836e-3e84d0f42bda None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:31.243845 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0a1d11bf-1869-4a89-836e-3e84d0f42bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:31.304126 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa84fc5-4330-4738-a802-25c871fb2696 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:31.320910 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 372/752] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:31.320910 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d11bf-1869-4a89-836e-3e84d0f42bda None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:31.358379 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243d3db-002c-4cbc-9b06-686dbbff10dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:31.359036 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243d3db-002c-4cbc-9b06-686dbbff10dd None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:31.359319 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243d3db-002c-4cbc-9b06-686dbbff10dd None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:31.359593 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243d3db-002c-4cbc-9b06-686dbbff10dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:31.367478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243d3db-002c-4cbc-9b06-686dbbff10dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:31.369179 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243d3db-002c-4cbc-9b06-686dbbff10dd None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:31.381783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-d243d3db-002c-4cbc-9b06-686dbbff10dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:31.381783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:31.381783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:31.381783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:31.381783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:31.381783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:31.381783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:31.381783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:31.381783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:31.381783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:31.381783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:31.381783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:31.381783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:31.381783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:31.381783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:31.382801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:31.382801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:31.382801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:31.382801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:31.382801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:31.382801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:31.382801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:31.382801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:31.382801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:31.382801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:31.382801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:31.382801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:31.382801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:31.382801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:31.382801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:31.382801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:31.382801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:31.383704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:31.383704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:31.383704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:31.383704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:31.383704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:31.383704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:31.383704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:31.383704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:31.383704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 381/753] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:31.383704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243d3db-002c-4cbc-9b06-686dbbff10dd None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:31.424212 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:31.441180 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d11bf-1869-4a89-836e-3e84d0f42bda None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:31.442701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:31.477197 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b3117-b168-4eb5-9482-a5c5fe091bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:31.477836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b3117-b168-4eb5-9482-a5c5fe091bed None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:31.478122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b3117-b168-4eb5-9482-a5c5fe091bed None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:31.478403 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b3117-b168-4eb5-9482-a5c5fe091bed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:31.488631 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b3117-b168-4eb5-9482-a5c5fe091bed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:31.490601 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b3117-b168-4eb5-9482-a5c5fe091bed None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:31.492395 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243d3db-002c-4cbc-9b06-686dbbff10dd None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:31.506632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-eb6b3117-b168-4eb5-9482-a5c5fe091bed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:31.506632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:31.506632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:31.506632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:31.506632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:31.506632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:31.506632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:31.506632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:31.506632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:31.506632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:31.506632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:31.506632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:31.506632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:31.506632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:31.506632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:31.507541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:31.507541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:31.507541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:31.507541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:31.507541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:31.507541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:31.507541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:31.507541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:31.507541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:31.507541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:31.507541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:31.507541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:31.507541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:31.507541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:31.507541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:31.507541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:31.507541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:31.508941 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:31.508941 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:31.508941 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:31.508941 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:31.508941 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 373/754] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:31.509573 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b3117-b168-4eb5-9482-a5c5fe091bed None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:31.532165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a38e4-8965-4538-bf19-aeb4fcd8dd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:31.532956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a38e4-8965-4538-bf19-aeb4fcd8dd4b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:31.533291 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a38e4-8965-4538-bf19-aeb4fcd8dd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:31.533620 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a38e4-8965-4538-bf19-aeb4fcd8dd4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:31.540630 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a38e4-8965-4538-bf19-aeb4fcd8dd4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:31.542204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a38e4-8965-4538-bf19-aeb4fcd8dd4b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:31.553623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-3e4a38e4-8965-4538-bf19-aeb4fcd8dd4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:31.553623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:31.553623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:31.553623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:31.553623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:31.553623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:31.553623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:31.553623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:31.553623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:31.553623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:31.553623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:31.553623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:31.553623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:31.553623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:31.553623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:31.554672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:31.554672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:31.554672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:31.554672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:31.554672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:31.554672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:31.554672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:31.554672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:31.554672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:31.554672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:31.554672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:31.554672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:31.554672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:31.554672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:31.554672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:31.554672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:31.554672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:31.555767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:31.555767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:31.555767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:31.555767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:31.555767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:31.555767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:31.555767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:31.555767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:31.556927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 382/755] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:31.557707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a38e4-8965-4538-bf19-aeb4fcd8dd4b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:31.621202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b3117-b168-4eb5-9482-a5c5fe091bed None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:31.658890 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f527e9a-fe19-4178-9778-bc41bb2594fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:31.660004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f527e9a-fe19-4178-9778-bc41bb2594fb None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:31.660341 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f527e9a-fe19-4178-9778-bc41bb2594fb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:31.660619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f527e9a-fe19-4178-9778-bc41bb2594fb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:31.660959 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:31.661468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f527e9a-fe19-4178-9778-bc41bb2594fb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:31.662999 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f527e9a-fe19-4178-9778-bc41bb2594fb None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:31.667053 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a38e4-8965-4538-bf19-aeb4fcd8dd4b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:31.678655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-7f527e9a-fe19-4178-9778-bc41bb2594fb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:45:31.678655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:31.678655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:31.678655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:31.678655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:31.678655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:31.678655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:31.678655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:31.678655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:45:31.678655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:31.678655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:31.678655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:31.678655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:31.678655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:31.678655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:31.678655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:31.679628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:31.679628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:31.679628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:31.679628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:31.679628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:31.679628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:31.679628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:31.679628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:31.679628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:31.679628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:31.679628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:31.679628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:31.679628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:31.679628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:31.679628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:31.679628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:31.680530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:31.680530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:31.680530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:31.680530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:31.680530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:31.680530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:31.680530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:31.680530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:31.680530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:31.680530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:31.680530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:31.680530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:31.680530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:31.680530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:45:31.680530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:31.680530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 374/756] 10.222.0.75 () {56 vars in 1129 bytes} [Thu Jul 28 17:45:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:31.681405 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f527e9a-fe19-4178-9778-bc41bb2594fb None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:31.704626 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:31.708943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bf974-8953-42c7-bebe-f053ac1db6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:31.709959 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bf974-8953-42c7-bebe-f053ac1db6cc None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:31.710556 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bf974-8953-42c7-bebe-f053ac1db6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:31.711756 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bf974-8953-42c7-bebe-f053ac1db6cc None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:31.713027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bf974-8953-42c7-bebe-f053ac1db6cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:31.713342 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bf974-8953-42c7-bebe-f053ac1db6cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:31.714828 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bf974-8953-42c7-bebe-f053ac1db6cc None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:31.732153 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 383/757] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:31.732153 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bf974-8953-42c7-bebe-f053ac1db6cc None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:31.799325 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f527e9a-fe19-4178-9778-bc41bb2594fb None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:31.835742 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d3834-f3b0-4a26-9af8-104e5dcb57f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:31.836652 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d3834-f3b0-4a26-9af8-104e5dcb57f9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:31.837101 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d3834-f3b0-4a26-9af8-104e5dcb57f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:31.837524 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d3834-f3b0-4a26-9af8-104e5dcb57f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:31.838364 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bf974-8953-42c7-bebe-f053ac1db6cc None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:31.838518 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d3834-f3b0-4a26-9af8-104e5dcb57f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:31.838962 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d3834-f3b0-4a26-9af8-104e5dcb57f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:31.840473 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d3834-f3b0-4a26-9af8-104e5dcb57f9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:31.852492 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 375/758] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:31.853559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d3834-f3b0-4a26-9af8-104e5dcb57f9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:31.882435 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d202c3-5513-4c0e-8aeb-b746011695cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:31.883049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d202c3-5513-4c0e-8aeb-b746011695cf None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:31.883330 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d202c3-5513-4c0e-8aeb-b746011695cf None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:31.883603 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d202c3-5513-4c0e-8aeb-b746011695cf None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:31.884355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d202c3-5513-4c0e-8aeb-b746011695cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:31.884664 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d202c3-5513-4c0e-8aeb-b746011695cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:31.886155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d202c3-5513-4c0e-8aeb-b746011695cf None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:31.903906 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 384/759] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:31.904817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d202c3-5513-4c0e-8aeb-b746011695cf None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:31.924603 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:31.946739 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:31.970860 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d3834-f3b0-4a26-9af8-104e5dcb57f9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:32.010924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd5773-07b4-46a4-9485-8df6ada26577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:32.011558 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd5773-07b4-46a4-9485-8df6ada26577 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:32.011865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd5773-07b4-46a4-9485-8df6ada26577 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:32.012139 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd5773-07b4-46a4-9485-8df6ada26577 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:32.012862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd5773-07b4-46a4-9485-8df6ada26577 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:32.013176 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd5773-07b4-46a4-9485-8df6ada26577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:32.014539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd5773-07b4-46a4-9485-8df6ada26577 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:32.017452 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d202c3-5513-4c0e-8aeb-b746011695cf None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:32.019811 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 376/760] 10.222.0.75 () {56 vars in 1124 bytes} [Thu Jul 28 17:45:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:32.020823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd5773-07b4-46a4-9485-8df6ada26577 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:32.057977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858d90b-11f8-443c-805a-396dc1c940d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:32.058629 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858d90b-11f8-443c-805a-396dc1c940d4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:32.058914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858d90b-11f8-443c-805a-396dc1c940d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:32.059193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858d90b-11f8-443c-805a-396dc1c940d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:32.059985 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858d90b-11f8-443c-805a-396dc1c940d4 None admin] RBAC: Adding query filter params (role.id=d371062e071845ffa4570a76d40dff88, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=d77b4fcb974d48a0bda4852c8d304511) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:32.060301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858d90b-11f8-443c-805a-396dc1c940d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:32.061791 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858d90b-11f8-443c-805a-396dc1c940d4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:32.068106 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 385/761] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:31 2022] GET /identity/v3/role_assignments?user.id=d77b4fcb974d48a0bda4852c8d304511&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=d371062e071845ffa4570a76d40dff88 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:32.068936 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858d90b-11f8-443c-805a-396dc1c940d4 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:32.156165 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd5773-07b4-46a4-9485-8df6ada26577 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:32.180057 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:32.196953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86849fc-7b13-4021-8f2e-5828ccdb4734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:32.197598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86849fc-7b13-4021-8f2e-5828ccdb4734 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:32.197901 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86849fc-7b13-4021-8f2e-5828ccdb4734 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:32.198215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86849fc-7b13-4021-8f2e-5828ccdb4734 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:32.207091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858d90b-11f8-443c-805a-396dc1c940d4 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:32.211671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86849fc-7b13-4021-8f2e-5828ccdb4734 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:32.213203 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86849fc-7b13-4021-8f2e-5828ccdb4734 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:32.226388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-e86849fc-7b13-4021-8f2e-5828ccdb4734 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:45:32.226388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:32.226388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:32.226388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:32.226388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:32.226388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:32.226388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:32.226388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:32.226388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:32.226388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:32.226388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:32.226388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:32.226388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:32.226388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:32.226388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:32.226388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:32.227434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:32.227434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:32.227434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:32.227434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:32.227434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:32.227434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:32.227434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:32.227434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:32.227434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:32.227434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:32.227434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:32.227434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:32.227434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:32.227434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:32.227434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:32.227434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:32.227434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:32.227434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:32.229525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:32.229525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:32.229525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:32.229525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:32.229525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:32.229525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:32.229525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:32.229525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:32.229525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:45:32.229525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:32.229525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 377/762] 10.222.0.75 () {56 vars in 1117 bytes} [Thu Jul 28 17:45:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:32.229525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86849fc-7b13-4021-8f2e-5828ccdb4734 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:32.231300 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:32.252701 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9e56d-df25-4656-bec3-661c171bd240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:32.253411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9e56d-df25-4656-bec3-661c171bd240 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:32.253707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9e56d-df25-4656-bec3-661c171bd240 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:32.253973 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9e56d-df25-4656-bec3-661c171bd240 None admin] PATH_INFO: `/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/c456a787159844feb7eabfd1e527e46e/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:32.255934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9e56d-df25-4656-bec3-661c171bd240 None admin] RBAC: Authorizing `identity:create_grant(project_id=883ec0c5aa374fbfbfc08eda6c626cfc, user_id=c456a787159844feb7eabfd1e527e46e, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:32.257531 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9e56d-df25-4656-bec3-661c171bd240 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:32.330115 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86849fc-7b13-4021-8f2e-5828ccdb4734 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:32.365721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063c70a-b3a3-4dc2-9236-7bc2c5950184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:32.366344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063c70a-b3a3-4dc2-9236-7bc2c5950184 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:32.366621 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063c70a-b3a3-4dc2-9236-7bc2c5950184 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:32.366892 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063c70a-b3a3-4dc2-9236-7bc2c5950184 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:32.367562 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063c70a-b3a3-4dc2-9236-7bc2c5950184 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:32.367865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063c70a-b3a3-4dc2-9236-7bc2c5950184 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:32.369262 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063c70a-b3a3-4dc2-9236-7bc2c5950184 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:32.375033 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 378/763] 10.222.0.75 () {56 vars in 1124 bytes} [Thu Jul 28 17:45:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:32.376743 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd31350-e934-4c83-8d03-eeffcb3b011e None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:32.377054 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd31350-e934-4c83-8d03-eeffcb3b011e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:32.377330 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd31350-e934-4c83-8d03-eeffcb3b011e None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:32.380938 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 379/764] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:32.380938 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd31350-e934-4c83-8d03-eeffcb3b011e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:32.400617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 386/765] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:45:32 2022] PUT /identity/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/c456a787159844feb7eabfd1e527e46e/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:45:32.406298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9e56d-df25-4656-bec3-661c171bd240 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:32.484476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:32.526534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9e56d-df25-4656-bec3-661c171bd240 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:32.544016 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd31350-e934-4c83-8d03-eeffcb3b011e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:32.577025 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53705671-de61-4629-aa80-49e728ce0e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:32.577667 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53705671-de61-4629-aa80-49e728ce0e17 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:32.577954 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53705671-de61-4629-aa80-49e728ce0e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:32.578229 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53705671-de61-4629-aa80-49e728ce0e17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:32.579086 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53705671-de61-4629-aa80-49e728ce0e17 None admin] RBAC: Adding query filter params (interface=public, service_id=acbfe023cbcd43fd87458e293288902c, region_id=RegionOne) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:32.579404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53705671-de61-4629-aa80-49e728ce0e17 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:32.581618 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53705671-de61-4629-aa80-49e728ce0e17 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:32.589265 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 387/766] 10.222.0.75 () {56 vars in 1251 bytes} [Thu Jul 28 17:45:32 2022] GET /identity/v3/endpoints?service_id=acbfe023cbcd43fd87458e293288902c&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:32.593103 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69f4fa-6232-4b7b-a493-8bcc3199e8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:32.593805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69f4fa-6232-4b7b-a493-8bcc3199e8ac None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:32.594121 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69f4fa-6232-4b7b-a493-8bcc3199e8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:32.594400 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69f4fa-6232-4b7b-a493-8bcc3199e8ac None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:32.595220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69f4fa-6232-4b7b-a493-8bcc3199e8ac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:32.595537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69f4fa-6232-4b7b-a493-8bcc3199e8ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:32.595721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e203c-0f47-40b3-9e01-be5a84f43052 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:32.596224 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e203c-0f47-40b3-9e01-be5a84f43052 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:32.596712 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e203c-0f47-40b3-9e01-be5a84f43052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:32.597113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69f4fa-6232-4b7b-a493-8bcc3199e8ac None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:32.606452 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:32.618722 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 380/767] 10.222.0.75 () {56 vars in 1149 bytes} [Thu Jul 28 17:45:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:32.619320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-2a1e203c-0f47-40b3-9e01-be5a84f43052 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:32.619703 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69f4fa-6232-4b7b-a493-8bcc3199e8ac None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:32.621157 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2a1e203c-0f47-40b3-9e01-be5a84f43052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:32.712617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 388/768] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:32.713544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e203c-0f47-40b3-9e01-be5a84f43052 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:32.762707 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69f4fa-6232-4b7b-a493-8bcc3199e8ac None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:32.787878 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:32.799799 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61f56f-f79e-44b6-af6f-48849c4d5cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:32.800438 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61f56f-f79e-44b6-af6f-48849c4d5cff None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:32.800723 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61f56f-f79e-44b6-af6f-48849c4d5cff None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:32.801031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61f56f-f79e-44b6-af6f-48849c4d5cff None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:32.801697 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61f56f-f79e-44b6-af6f-48849c4d5cff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:32.812605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61f56f-f79e-44b6-af6f-48849c4d5cff None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:32.812605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 381/769] 10.222.0.75 () {56 vars in 1087 bytes} [Thu Jul 28 17:45:32 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:32.812605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61f56f-f79e-44b6-af6f-48849c4d5cff None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:32.863009 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e203c-0f47-40b3-9e01-be5a84f43052 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:32.924453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ddd21-e5ab-4840-8322-ab71466ada6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:32.925151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ddd21-e5ab-4840-8322-ab71466ada6e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:32.925438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ddd21-e5ab-4840-8322-ab71466ada6e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:32.925719 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ddd21-e5ab-4840-8322-ab71466ada6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:32.937926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:33.004979 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61f56f-f79e-44b6-af6f-48849c4d5cff None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:33.042608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71489791-4f14-4886-8e4b-1c244b9f468f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:33.043264 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71489791-4f14-4886-8e4b-1c244b9f468f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:33.043457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71489791-4f14-4886-8e4b-1c244b9f468f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:33.043735 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71489791-4f14-4886-8e4b-1c244b9f468f None admin] PATH_INFO: `/v3/services/network` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:33.044369 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71489791-4f14-4886-8e4b-1c244b9f468f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:33.047985 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71489791-4f14-4886-8e4b-1c244b9f468f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:33.048245 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ddd21-e5ab-4840-8322-ab71466ada6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:33.050211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ddd21-e5ab-4840-8322-ab71466ada6e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:33.058110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-71489791-4f14-4886-8e4b-1c244b9f468f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:45:33.058110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:33.058110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:33.058110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:33.058110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:33.058110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:33.058110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:33.058110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:33.058110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:45:33.058110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:33.058110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:33.058110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:33.058110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:33.058110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:33.058110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:33.058110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:33.058110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:33.059122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:33.059122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:33.059122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:33.059122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:33.059122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:33.059122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:33.059122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:33.059122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:33.059122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:33.059122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:33.059122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:33.059122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:33.059122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:33.059122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:33.059122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:33.059122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:33.059952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:33.059952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:33.059952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:33.059952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:33.059952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:33.059952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:33.059952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:33.059952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:33.059952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:33.059952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:33.059952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:33.059952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:33.059952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:45:33.059952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:33.059952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 382/770] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:32 2022] GET /identity/v3/services/network => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:33.066914 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71489791-4f14-4886-8e4b-1c244b9f468f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:33.144937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:33.194038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 389/771] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:45:33.205909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ddd21-e5ab-4840-8322-ab71466ada6e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:33.212842 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71489791-4f14-4886-8e4b-1c244b9f468f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:33.260377 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3f61d-3592-4b7d-9ba3-e8f926210be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:33.261143 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3f61d-3592-4b7d-9ba3-e8f926210be8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:33.261428 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3f61d-3592-4b7d-9ba3-e8f926210be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:33.261702 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3f61d-3592-4b7d-9ba3-e8f926210be8 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:33.262491 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3f61d-3592-4b7d-9ba3-e8f926210be8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:33.262808 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3f61d-3592-4b7d-9ba3-e8f926210be8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:33.264185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3f61d-3592-4b7d-9ba3-e8f926210be8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:33.274321 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:33.279478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 383/772] 10.222.0.75 () {56 vars in 1112 bytes} [Thu Jul 28 17:45:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:33.285639 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3f61d-3592-4b7d-9ba3-e8f926210be8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:33.397323 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ddd21-e5ab-4840-8322-ab71466ada6e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:33.435565 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc5294-64c0-46a0-91e9-3607a326d98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:33.436391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc5294-64c0-46a0-91e9-3607a326d98b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:33.436781 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc5294-64c0-46a0-91e9-3607a326d98b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:33.437155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc5294-64c0-46a0-91e9-3607a326d98b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:33.461901 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc5294-64c0-46a0-91e9-3607a326d98b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:33.463394 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc5294-64c0-46a0-91e9-3607a326d98b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:33.487824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-39dc5294-64c0-46a0-91e9-3607a326d98b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:33.487824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:33.487824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:33.487824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:33.487824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:33.487824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:33.487824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:33.487824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:33.487824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:33.487824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:33.487824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:33.487824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:33.487824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:33.487824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:33.487824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:33.488900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:33.488900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:33.488900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:33.488900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:33.488900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:33.488900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:33.488900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:33.488900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:33.488900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:33.488900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:33.488900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:33.488900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:33.488900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:33.488900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:33.488900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:33.488900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:33.488900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:33.489800 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:33.489800 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:33.489800 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:33.489800 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:33.489800 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 390/773] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:33.494917 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc5294-64c0-46a0-91e9-3607a326d98b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:33.497127 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3f61d-3592-4b7d-9ba3-e8f926210be8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:33.514907 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:33.574152 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0421f76-c68f-4f17-aab1-da2aa2e34771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:33.574788 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0421f76-c68f-4f17-aab1-da2aa2e34771 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:33.575068 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0421f76-c68f-4f17-aab1-da2aa2e34771 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:33.575341 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0421f76-c68f-4f17-aab1-da2aa2e34771 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:33.576027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0421f76-c68f-4f17-aab1-da2aa2e34771 None admin] RBAC: Adding query filter params (type=network) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:33.576331 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0421f76-c68f-4f17-aab1-da2aa2e34771 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:33.577791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0421f76-c68f-4f17-aab1-da2aa2e34771 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:33.592193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 384/774] 10.222.0.75 () {56 vars in 1112 bytes} [Thu Jul 28 17:45:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:33.599520 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0421f76-c68f-4f17-aab1-da2aa2e34771 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:33.602641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:33.621709 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc5294-64c0-46a0-91e9-3607a326d98b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:33.656544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c9518-5a9b-4aa2-adac-299ebab374f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:33.657312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c9518-5a9b-4aa2-adac-299ebab374f2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:33.657597 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c9518-5a9b-4aa2-adac-299ebab374f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:33.657869 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c9518-5a9b-4aa2-adac-299ebab374f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:33.658567 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c9518-5a9b-4aa2-adac-299ebab374f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:33.658877 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c9518-5a9b-4aa2-adac-299ebab374f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:33.660383 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c9518-5a9b-4aa2-adac-299ebab374f2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:33.673596 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 391/775] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:33.685302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c9518-5a9b-4aa2-adac-299ebab374f2 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:33.755852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0421f76-c68f-4f17-aab1-da2aa2e34771 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:33.792131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e867d-7a45-4f99-b8ec-39c61cd065d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:33.792776 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e867d-7a45-4f99-b8ec-39c61cd065d5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:33.793081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e867d-7a45-4f99-b8ec-39c61cd065d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:33.793362 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e867d-7a45-4f99-b8ec-39c61cd065d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:33.794124 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e867d-7a45-4f99-b8ec-39c61cd065d5 None admin] RBAC: Adding query filter params (interface=public, service_id=333a36f9f60d451cb28d8e03f02c164d, region_id=RegionOne) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:33.794433 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e867d-7a45-4f99-b8ec-39c61cd065d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:33.795915 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e867d-7a45-4f99-b8ec-39c61cd065d5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:33.804238 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 385/776] 10.222.0.75 () {56 vars in 1251 bytes} [Thu Jul 28 17:45:33 2022] GET /identity/v3/endpoints?service_id=333a36f9f60d451cb28d8e03f02c164d&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:33.813217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e867d-7a45-4f99-b8ec-39c61cd065d5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:33.865509 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:33.917726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c9518-5a9b-4aa2-adac-299ebab374f2 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:33.924931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e867d-7a45-4f99-b8ec-39c61cd065d5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:33.956422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c338a9-cc67-441b-9a15-eef6d97214ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:33.957093 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c338a9-cc67-441b-9a15-eef6d97214ad None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:33.957378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c338a9-cc67-441b-9a15-eef6d97214ad None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:33.957927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c338a9-cc67-441b-9a15-eef6d97214ad None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:33.958413 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c338a9-cc67-441b-9a15-eef6d97214ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:33.959791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c338a9-cc67-441b-9a15-eef6d97214ad None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:33.966016 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 386/777] 10.222.0.75 () {56 vars in 1087 bytes} [Thu Jul 28 17:45:33 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:34.011800 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6609b-a5d2-4f20-81a9-cfdccc7bdb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:34.012478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6609b-a5d2-4f20-81a9-cfdccc7bdb02 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:34.012775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6609b-a5d2-4f20-81a9-cfdccc7bdb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:34.013066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6609b-a5d2-4f20-81a9-cfdccc7bdb02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:34.030374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6609b-a5d2-4f20-81a9-cfdccc7bdb02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:34.031923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6609b-a5d2-4f20-81a9-cfdccc7bdb02 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:34.044503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-4dc6609b-a5d2-4f20-81a9-cfdccc7bdb02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:34.044503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:34.044503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:34.044503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:34.044503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:34.044503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:34.044503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:34.044503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:34.044503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:34.044503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:34.044503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:34.044503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:34.044503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:34.044503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:34.044503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:34.045511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:34.045511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:34.045511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:34.045511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:34.045511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:34.045511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:34.045511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:34.045511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:34.045511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:34.045511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:34.045511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:34.045511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:34.045511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:34.045511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:34.045511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:34.045511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:34.045511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:34.046413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:34.046413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:34.046413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:34.046413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:34.046413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:34.046413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:34.046413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:34.046413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:34.046413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 392/778] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:34.052276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c338a9-cc67-441b-9a15-eef6d97214ad None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:34.183025 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c338a9-cc67-441b-9a15-eef6d97214ad None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:34.193833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:34.221165 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd421a-3f6a-4071-9fe0-0a7a7a1b241d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:34.221797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd421a-3f6a-4071-9fe0-0a7a7a1b241d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:34.222088 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd421a-3f6a-4071-9fe0-0a7a7a1b241d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:34.222359 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd421a-3f6a-4071-9fe0-0a7a7a1b241d None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:34.223190 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd421a-3f6a-4071-9fe0-0a7a7a1b241d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:34.223485 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd421a-3f6a-4071-9fe0-0a7a7a1b241d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:34.225012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd421a-3f6a-4071-9fe0-0a7a7a1b241d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:34.240202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 387/779] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:34.249897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6609b-a5d2-4f20-81a9-cfdccc7bdb02 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:34.266741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:34.303314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63dfe3-a735-4718-9aeb-ae14b2363df2 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:34.303623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63dfe3-a735-4718-9aeb-ae14b2363df2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:34.303859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63dfe3-a735-4718-9aeb-ae14b2363df2 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:34.305629 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 388/780] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:45:34.311565 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054b2df-b371-4500-9e96-fcc29011d43b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:34.311875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054b2df-b371-4500-9e96-fcc29011d43b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:34.312127 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054b2df-b371-4500-9e96-fcc29011d43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:34.335942 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0054b2df-b371-4500-9e96-fcc29011d43b None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:34.337243 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0054b2df-b371-4500-9e96-fcc29011d43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:34.448031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6609b-a5d2-4f20-81a9-cfdccc7bdb02 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:34.469505 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 389/781] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:45:34.512423 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6db59a-c019-4b39-9835-ab3df23f4fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:34.513078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6db59a-c019-4b39-9835-ab3df23f4fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:34.513361 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6db59a-c019-4b39-9835-ab3df23f4fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:34.513636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6db59a-c019-4b39-9835-ab3df23f4fc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:34.514437 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6db59a-c019-4b39-9835-ab3df23f4fc7 None admin] RBAC: Adding query filter params (role.id=6f10ff8509da43688fba83e6a4fd5c5f, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=1cbbfdda843a4ab98ff9cf0742513f44) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:34.514748 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6db59a-c019-4b39-9835-ab3df23f4fc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:34.516253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6db59a-c019-4b39-9835-ab3df23f4fc7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:34.522809 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 393/782] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:34 2022] GET /identity/v3/role_assignments?user.id=1cbbfdda843a4ab98ff9cf0742513f44&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=6f10ff8509da43688fba83e6a4fd5c5f => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:34.526525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054b2df-b371-4500-9e96-fcc29011d43b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:34.633464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:34.637905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054b2df-b371-4500-9e96-fcc29011d43b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:34.694204 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d6f7a-d1f8-496e-ab64-6bddac63047b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:34.695218 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d6f7a-d1f8-496e-ab64-6bddac63047b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:34.695615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d6f7a-d1f8-496e-ab64-6bddac63047b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:34.696072 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d6f7a-d1f8-496e-ab64-6bddac63047b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:34.715827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d6f7a-d1f8-496e-ab64-6bddac63047b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:34.722153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-bb4d6f7a-d1f8-496e-ab64-6bddac63047b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:45:34.722153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:34.722153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:34.722153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:34.722153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:34.722153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:34.722153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:34.722153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:34.722153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:34.722153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:34.722153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:34.722153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:34.722153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:34.722153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:34.722153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:34.722153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:34.723155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:34.723155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:34.723155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:34.723155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:34.723155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:34.723155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:34.723155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:34.723155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:34.723155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:34.723155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:34.723155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:34.723155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:34.723155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:34.723155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:34.723155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:34.723155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:34.724002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:34.724002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:34.724002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:34.724002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:34.724002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:34.724002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:34.724002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:34.724002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:34.724002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:34.724002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:34.724002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:45:34.724002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:34.724002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 390/783] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:45:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:34.731330 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6db59a-c019-4b39-9835-ab3df23f4fc7 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:34.821208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:34.856809 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6db59a-c019-4b39-9835-ab3df23f4fc7 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:34.901426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdc67e-f43e-4e55-82c4-65d9735dfb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:34.902045 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdc67e-f43e-4e55-82c4-65d9735dfb82 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:34.902380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdc67e-f43e-4e55-82c4-65d9735dfb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:34.902664 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdc67e-f43e-4e55-82c4-65d9735dfb82 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:34.903386 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdc67e-f43e-4e55-82c4-65d9735dfb82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:34.903697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdc67e-f43e-4e55-82c4-65d9735dfb82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:34.905111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdc67e-f43e-4e55-82c4-65d9735dfb82 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:34.916351 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 394/784] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:45:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:34.921992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d6f7a-d1f8-496e-ab64-6bddac63047b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:34.956256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604c5fe-dde7-4108-b101-dc9b7a77e979 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:34.956951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604c5fe-dde7-4108-b101-dc9b7a77e979 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:34.957436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604c5fe-dde7-4108-b101-dc9b7a77e979 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:34.959233 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 395/785] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:34.964634 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27a425-ce72-4741-8d3f-2d852931351b None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:34.965315 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27a425-ce72-4741-8d3f-2d852931351b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:34.965808 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27a425-ce72-4741-8d3f-2d852931351b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:34.986062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-da27a425-ce72-4741-8d3f-2d852931351b None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:34.987690 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-da27a425-ce72-4741-8d3f-2d852931351b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:35.030580 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d6f7a-d1f8-496e-ab64-6bddac63047b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:35.066378 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 396/786] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:45:35.075726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64a0d9-c18c-444c-9bbc-8117c40ee2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:35.076397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64a0d9-c18c-444c-9bbc-8117c40ee2ed None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:35.076679 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64a0d9-c18c-444c-9bbc-8117c40ee2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:35.076981 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64a0d9-c18c-444c-9bbc-8117c40ee2ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:35.092134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64a0d9-c18c-444c-9bbc-8117c40ee2ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:35.100389 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64a0d9-c18c-444c-9bbc-8117c40ee2ed None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:35.115618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-5e64a0d9-c18c-444c-9bbc-8117c40ee2ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:35.115618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:35.115618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:35.115618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:35.115618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:35.115618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:35.115618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:35.115618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:35.115618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:35.115618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:35.115618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:35.115618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:35.115618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:35.115618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:35.115618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:35.116497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:35.116497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:35.116497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:35.116497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:35.116497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:35.116497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:35.116497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:35.116497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:35.116497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:35.116497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:35.116497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:35.116497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:35.116497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:35.116497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:35.116497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:35.116497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:35.116497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:35.117529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:35.117529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:35.117529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:35.117529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:35.121201 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 391/787] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:35.127338 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27a425-ce72-4741-8d3f-2d852931351b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:35.129511 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64a0d9-c18c-444c-9bbc-8117c40ee2ed None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:35.145498 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:35.233423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64a0d9-c18c-444c-9bbc-8117c40ee2ed None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:35.241139 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:35.269560 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d0de4-5e66-4686-8a9e-80ddf65e0cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:35.270206 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d0de4-5e66-4686-8a9e-80ddf65e0cac None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:35.270488 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d0de4-5e66-4686-8a9e-80ddf65e0cac None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:35.270763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d0de4-5e66-4686-8a9e-80ddf65e0cac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:35.281891 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d0de4-5e66-4686-8a9e-80ddf65e0cac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:35.287367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-de6d0de4-5e66-4686-8a9e-80ddf65e0cac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:45:35.287367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:35.287367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:35.287367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:35.287367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:35.287367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:35.287367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:35.287367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:35.287367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:35.287367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:35.287367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:35.287367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:35.287367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:35.287367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:35.287367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:35.287367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:35.288269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:35.288269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:35.288269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:35.288269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:35.288269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:35.288269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:35.288269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:35.288269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:35.288269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:35.288269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:35.288269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:35.288269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:35.288269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:35.288269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:35.288269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:35.288269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:35.289291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:35.289291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:35.289291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:35.289291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:35.289291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:35.289291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:35.289291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:35.289291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:35.289291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:35.289291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:35.289291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:45:35.289291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:35.289291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 392/788] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:45:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:35.294517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d0de4-5e66-4686-8a9e-80ddf65e0cac None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:35.297516 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27a425-ce72-4741-8d3f-2d852931351b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:35.368181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:35.369276 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287ca0a-ca33-403f-8179-aedc9d48dae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:35.369913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287ca0a-ca33-403f-8179-aedc9d48dae0 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:35.370190 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287ca0a-ca33-403f-8179-aedc9d48dae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:35.370460 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287ca0a-ca33-403f-8179-aedc9d48dae0 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:35.371158 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287ca0a-ca33-403f-8179-aedc9d48dae0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:35.371461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287ca0a-ca33-403f-8179-aedc9d48dae0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:35.372873 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287ca0a-ca33-403f-8179-aedc9d48dae0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:35.397761 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 397/789] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:35.406825 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d0de4-5e66-4686-8a9e-80ddf65e0cac None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:35.408563 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287ca0a-ca33-403f-8179-aedc9d48dae0 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:35.460280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591647d-28d2-46db-abd1-55f3a20c3374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:35.461003 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591647d-28d2-46db-abd1-55f3a20c3374 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:35.461245 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591647d-28d2-46db-abd1-55f3a20c3374 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:35.461496 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591647d-28d2-46db-abd1-55f3a20c3374 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:35.462224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591647d-28d2-46db-abd1-55f3a20c3374 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:35.462530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591647d-28d2-46db-abd1-55f3a20c3374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:35.463949 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591647d-28d2-46db-abd1-55f3a20c3374 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:35.476797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 393/790] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:45:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:35.478463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9561ff-d2e9-42a2-9984-f90c59452730 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:35.478947 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9561ff-d2e9-42a2-9984-f90c59452730 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:35.479476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9561ff-d2e9-42a2-9984-f90c59452730 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:35.481204 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 394/791] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:35.487234 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc9931-0411-4c1e-87d5-b1e546cf23fd None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:35.487767 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc9931-0411-4c1e-87d5-b1e546cf23fd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:35.488242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc9931-0411-4c1e-87d5-b1e546cf23fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:35.509290 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-33fc9931-0411-4c1e-87d5-b1e546cf23fd None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:35.510553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-33fc9931-0411-4c1e-87d5-b1e546cf23fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:35.567248 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287ca0a-ca33-403f-8179-aedc9d48dae0 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:35.588712 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 395/792] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:45:35.589825 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc9931-0411-4c1e-87d5-b1e546cf23fd None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:35.597596 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:35.612540 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45c5fc-0bfb-47fc-95b9-ce725be756f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:35.613574 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45c5fc-0bfb-47fc-95b9-ce725be756f4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:35.614058 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45c5fc-0bfb-47fc-95b9-ce725be756f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:35.614583 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45c5fc-0bfb-47fc-95b9-ce725be756f4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:35.624600 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45c5fc-0bfb-47fc-95b9-ce725be756f4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:35.627671 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45c5fc-0bfb-47fc-95b9-ce725be756f4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:35.644725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-9f45c5fc-0bfb-47fc-95b9-ce725be756f4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:45:35.644725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:35.644725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:35.644725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:35.644725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:35.644725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:35.644725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:35.644725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:35.644725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:35.644725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:35.644725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:35.644725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:35.644725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:35.644725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:35.644725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:35.644725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:35.645758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:35.645758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:35.645758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:35.645758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:35.645758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:35.645758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:35.645758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:35.645758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:35.645758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:35.645758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:35.645758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:35.645758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:35.645758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:35.645758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:35.645758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:35.645758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:35.645758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:35.645758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:35.647204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:35.647204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:35.647204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:35.647204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:35.647204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:35.647204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:35.647204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:35.647204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:35.647204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:45:35.647204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:35.650384 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 398/793] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:45:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:35.655732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45c5fc-0bfb-47fc-95b9-ce725be756f4 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:35.677938 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:35.718314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc9931-0411-4c1e-87d5-b1e546cf23fd None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:35.761765 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f9c8a-0749-4b50-975d-dcbaac7ddf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:35.763161 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9c8a-0749-4b50-975d-dcbaac7ddf6f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:35.763596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9c8a-0749-4b50-975d-dcbaac7ddf6f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:35.764016 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9c8a-0749-4b50-975d-dcbaac7ddf6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:35.778651 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f9c8a-0749-4b50-975d-dcbaac7ddf6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:35.781009 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f9c8a-0749-4b50-975d-dcbaac7ddf6f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:35.789114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45c5fc-0bfb-47fc-95b9-ce725be756f4 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:35.802717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-f02f9c8a-0749-4b50-975d-dcbaac7ddf6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:35.802717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:35.802717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:35.802717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:35.802717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:35.802717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:35.802717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:35.802717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:35.802717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:35.802717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:35.802717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:35.802717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:35.802717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:35.802717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:35.802717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:35.803785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:35.803785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:35.803785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:35.803785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:35.803785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:35.803785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:35.803785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:35.803785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:35.803785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:35.803785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:35.803785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:35.803785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:35.803785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:35.803785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:35.803785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:35.803785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:35.803785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:35.804894 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:35.804894 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:35.804894 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:35.804894 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:35.807433 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 396/794] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:35.807433 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f9c8a-0749-4b50-975d-dcbaac7ddf6f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:35.834140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48b03f-228e-4ced-b382-5ff11643edd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:35.834999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48b03f-228e-4ced-b382-5ff11643edd6 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:35.835468 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48b03f-228e-4ced-b382-5ff11643edd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:35.835747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48b03f-228e-4ced-b382-5ff11643edd6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:35.836480 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48b03f-228e-4ced-b382-5ff11643edd6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:35.838029 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48b03f-228e-4ced-b382-5ff11643edd6 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:35.848049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-8d48b03f-228e-4ced-b382-5ff11643edd6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:45:35.848049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:35.848049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:35.848049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:35.848049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:35.848049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:35.848049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:35.848049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:35.848049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:45:35.848049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:35.848049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:35.848049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:35.848049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:35.848049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:35.848049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:35.848049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:35.849247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:35.849247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:35.849247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:35.849247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:35.849247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:35.849247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:35.849247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:35.849247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:35.849247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:35.849247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:35.849247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:35.849247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:35.849247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:35.849247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:35.849247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:35.849247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:35.850259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:35.850259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:35.850259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:35.850259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:35.850259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:35.850259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:35.850259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:35.850259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:35.850259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:35.850259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:35.850259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:35.850259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:35.850259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:35.850259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:45:35.850259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:35.852259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 399/795] 10.222.0.75 () {56 vars in 1129 bytes} [Thu Jul 28 17:45:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:35.857600 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48b03f-228e-4ced-b382-5ff11643edd6 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:35.910834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:35.935337 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f9c8a-0749-4b50-975d-dcbaac7ddf6f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:35.950153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:35.967431 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48b03f-228e-4ced-b382-5ff11643edd6 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:35.971954 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d22f8-cbb5-4f19-b898-50e54acde25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:35.972738 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d22f8-cbb5-4f19-b898-50e54acde25d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:35.973153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d22f8-cbb5-4f19-b898-50e54acde25d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:35.973559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d22f8-cbb5-4f19-b898-50e54acde25d None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:35.974463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d22f8-cbb5-4f19-b898-50e54acde25d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:35.974874 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d22f8-cbb5-4f19-b898-50e54acde25d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:35.976845 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d22f8-cbb5-4f19-b898-50e54acde25d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:35.996238 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 397/796] 10.222.0.75 () {56 vars in 1135 bytes} [Thu Jul 28 17:45:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:35.997321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d22f8-cbb5-4f19-b898-50e54acde25d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:36.009243 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97608973-c0f2-4463-aa7f-60c014e23517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:36.010292 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97608973-c0f2-4463-aa7f-60c014e23517 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:36.010786 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97608973-c0f2-4463-aa7f-60c014e23517 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:36.011371 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97608973-c0f2-4463-aa7f-60c014e23517 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:36.012401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97608973-c0f2-4463-aa7f-60c014e23517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:36.012966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97608973-c0f2-4463-aa7f-60c014e23517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:36.014644 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97608973-c0f2-4463-aa7f-60c014e23517 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:36.036788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 400/797] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:36.039173 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97608973-c0f2-4463-aa7f-60c014e23517 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:36.109046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d22f8-cbb5-4f19-b898-50e54acde25d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:36.145956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbf08a-049b-4e5d-9243-35bb3eb6058c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:36.146583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbf08a-049b-4e5d-9243-35bb3eb6058c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:36.146869 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbf08a-049b-4e5d-9243-35bb3eb6058c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:36.147145 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbf08a-049b-4e5d-9243-35bb3eb6058c None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:36.147830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbf08a-049b-4e5d-9243-35bb3eb6058c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:36.148137 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbf08a-049b-4e5d-9243-35bb3eb6058c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:36.149383 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97608973-c0f2-4463-aa7f-60c014e23517 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:36.149811 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbf08a-049b-4e5d-9243-35bb3eb6058c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:36.158168 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:36.160109 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 398/798] 10.222.0.75 () {56 vars in 1124 bytes} [Thu Jul 28 17:45:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:36.160967 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbf08a-049b-4e5d-9243-35bb3eb6058c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:36.187304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298dffe-9505-4658-88e8-ae85835718b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:36.188388 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298dffe-9505-4658-88e8-ae85835718b3 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:36.188961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298dffe-9505-4658-88e8-ae85835718b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:36.189440 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298dffe-9505-4658-88e8-ae85835718b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:36.197798 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:36.200021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298dffe-9505-4658-88e8-ae85835718b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:36.201726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298dffe-9505-4658-88e8-ae85835718b3 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:36.219991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-6298dffe-9505-4658-88e8-ae85835718b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:36.219991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:36.219991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:36.219991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:36.219991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:36.219991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:36.219991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:36.219991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:36.219991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:36.219991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:36.219991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:36.219991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:36.219991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:36.219991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:36.219991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:36.221104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:36.221104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:36.221104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:36.221104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:36.221104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:36.221104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:36.221104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:36.221104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:36.221104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:36.221104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:36.221104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:36.221104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:36.221104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:36.221104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:36.221104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:36.221104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:36.221104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:36.221987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:36.221987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:36.221987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:36.221987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:36.222281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 401/799] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:36.223371 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298dffe-9505-4658-88e8-ae85835718b3 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:36.274231 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbf08a-049b-4e5d-9243-35bb3eb6058c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:36.312488 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317779e-54ab-4f9f-a3f0-fb0683cbda45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:36.313615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317779e-54ab-4f9f-a3f0-fb0683cbda45 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:36.314212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317779e-54ab-4f9f-a3f0-fb0683cbda45 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:36.314685 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317779e-54ab-4f9f-a3f0-fb0683cbda45 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:36.323107 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317779e-54ab-4f9f-a3f0-fb0683cbda45 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:36.325104 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317779e-54ab-4f9f-a3f0-fb0683cbda45 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:36.337923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298dffe-9505-4658-88e8-ae85835718b3 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:36.339147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-b317779e-54ab-4f9f-a3f0-fb0683cbda45 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:45:36.339147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:36.339147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:36.339147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:36.339147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:36.339147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:36.339147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:36.339147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:36.339147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:36.339147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:36.339147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:36.339147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:36.339147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:36.339147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:36.339147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:36.339147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:36.340059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:36.340059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:36.340059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:36.340059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:36.340059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:36.340059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:36.340059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:36.340059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:36.340059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:36.340059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:36.340059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:36.340059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:36.340059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:36.340059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:36.340059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:36.340059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:36.340059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:36.340059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:36.341008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:36.341008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:36.341008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:36.341008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:36.341008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:36.341008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:36.341008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:36.341008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:36.341008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:45:36.341008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:36.343643 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 399/800] 10.222.0.75 () {56 vars in 1093 bytes} [Thu Jul 28 17:45:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:36.345429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317779e-54ab-4f9f-a3f0-fb0683cbda45 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:36.381485 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b290a2-1779-45ea-90f6-ceeeee8a0c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:36.382125 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b290a2-1779-45ea-90f6-ceeeee8a0c5c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:36.382405 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b290a2-1779-45ea-90f6-ceeeee8a0c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:36.382678 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b290a2-1779-45ea-90f6-ceeeee8a0c5c None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:36.383375 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b290a2-1779-45ea-90f6-ceeeee8a0c5c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:36.383691 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b290a2-1779-45ea-90f6-ceeeee8a0c5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:36.385119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b290a2-1779-45ea-90f6-ceeeee8a0c5c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:36.395598 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 402/801] 10.222.0.75 () {56 vars in 1124 bytes} [Thu Jul 28 17:45:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:36.395598 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b290a2-1779-45ea-90f6-ceeeee8a0c5c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:36.418122 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:36.470478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:36.476962 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317779e-54ab-4f9f-a3f0-fb0683cbda45 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:36.493619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b290a2-1779-45ea-90f6-ceeeee8a0c5c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:36.512362 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6dbdfd-73fd-4ef1-9583-81d21fa9c9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:36.513264 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dbdfd-73fd-4ef1-9583-81d21fa9c9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:36.513805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dbdfd-73fd-4ef1-9583-81d21fa9c9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:36.514274 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dbdfd-73fd-4ef1-9583-81d21fa9c9d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:36.515114 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6dbdfd-73fd-4ef1-9583-81d21fa9c9d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:36.516075 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6dbdfd-73fd-4ef1-9583-81d21fa9c9d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:36.517867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6dbdfd-73fd-4ef1-9583-81d21fa9c9d7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:36.528128 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6ca42-3f7d-4487-8abe-60745a7a737d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:36.528698 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6ca42-3f7d-4487-8abe-60745a7a737d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:36.529017 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6ca42-3f7d-4487-8abe-60745a7a737d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:36.529299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6ca42-3f7d-4487-8abe-60745a7a737d None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:36.530157 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6ca42-3f7d-4487-8abe-60745a7a737d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:36.531955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6ca42-3f7d-4487-8abe-60745a7a737d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:36.532485 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 400/802] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:36.532592 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6ca42-3f7d-4487-8abe-60745a7a737d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:36.533528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6dbdfd-73fd-4ef1-9583-81d21fa9c9d7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:36.553523 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 403/803] 10.222.0.75 () {56 vars in 1133 bytes} [Thu Jul 28 17:45:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:36.554862 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea1fb4-73ff-4dfa-abe0-d0e16e7ae4c2 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:36.555256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea1fb4-73ff-4dfa-abe0-d0e16e7ae4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:36.555538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea1fb4-73ff-4dfa-abe0-d0e16e7ae4c2 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:36.556875 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 404/804] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:36.561390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea1fb4-73ff-4dfa-abe0-d0e16e7ae4c2 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:36.648685 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:36.650161 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6dbdfd-73fd-4ef1-9583-81d21fa9c9d7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:36.669040 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea1fb4-73ff-4dfa-abe0-d0e16e7ae4c2 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:36.686742 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c626b51-cb34-4f6a-800d-1206ef6685c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:36.688153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c626b51-cb34-4f6a-800d-1206ef6685c7 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:36.688583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c626b51-cb34-4f6a-800d-1206ef6685c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:36.689106 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c626b51-cb34-4f6a-800d-1206ef6685c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:36.689963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c626b51-cb34-4f6a-800d-1206ef6685c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:36.691776 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c626b51-cb34-4f6a-800d-1206ef6685c7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:36.704374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e38414-9d91-4541-a693-a00b75a064b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:36.705055 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e38414-9d91-4541-a693-a00b75a064b8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:36.705344 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e38414-9d91-4541-a693-a00b75a064b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:36.705620 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e38414-9d91-4541-a693-a00b75a064b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:36.712582 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e38414-9d91-4541-a693-a00b75a064b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:36.714077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e38414-9d91-4541-a693-a00b75a064b8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:36.725467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-71e38414-9d91-4541-a693-a00b75a064b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:36.725467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:36.725467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:36.725467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:36.725467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:36.725467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:36.725467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:36.725467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:36.725467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:36.725467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:36.725467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:36.725467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:36.725467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:36.725467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:36.725467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:36.726417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:36.726417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:36.726417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:36.726417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:36.726417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:36.726417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:36.726417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:36.726417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:36.726417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:36.726417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:36.726417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:36.726417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:36.726417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:36.726417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:36.726417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:36.726417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:36.726417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:36.727316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:36.727316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:36.727316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:36.727316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:36.727316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:36.727316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:36.727316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:36.727316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:36.727316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 405/805] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:36.727791 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e38414-9d91-4541-a693-a00b75a064b8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:36.830110 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e38414-9d91-4541-a693-a00b75a064b8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:36.831414 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 401/806] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 17:45:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:45:36.832907 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52b405-13a2-43c2-89c2-bf6c27945160 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:36.833260 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52b405-13a2-43c2-89c2-bf6c27945160 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:36.833598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52b405-13a2-43c2-89c2-bf6c27945160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:36.860268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ba52b405-13a2-43c2-89c2-bf6c27945160 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:36.861700 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ba52b405-13a2-43c2-89c2-bf6c27945160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:36.871614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:36.900208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfaadf-8219-4129-b168-002079f2bef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:36.901361 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfaadf-8219-4129-b168-002079f2bef7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:36.901876 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfaadf-8219-4129-b168-002079f2bef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:36.902334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfaadf-8219-4129-b168-002079f2bef7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:36.907896 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:36.948348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 402/807] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:36.948348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52b405-13a2-43c2-89c2-bf6c27945160 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:36.987991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfaadf-8219-4129-b168-002079f2bef7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:36.989543 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfaadf-8219-4129-b168-002079f2bef7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:37.073263 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52b405-13a2-43c2-89c2-bf6c27945160 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:37.104029 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 406/808] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:45:37.105667 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064deb-8204-4fef-b204-cd18f29581f4 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:37.106315 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064deb-8204-4fef-b204-cd18f29581f4 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:37.106789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064deb-8204-4fef-b204-cd18f29581f4 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:37.108480 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 407/809] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:37.110120 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66064deb-8204-4fef-b204-cd18f29581f4 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:37.119432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675d160-9cf1-4868-a666-4960681426d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:37.120094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675d160-9cf1-4868-a666-4960681426d3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:37.120379 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675d160-9cf1-4868-a666-4960681426d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:37.120657 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675d160-9cf1-4868-a666-4960681426d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:37.121465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675d160-9cf1-4868-a666-4960681426d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:37.121778 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675d160-9cf1-4868-a666-4960681426d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:37.123226 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675d160-9cf1-4868-a666-4960681426d3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:37.136545 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 403/810] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:37.142083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675d160-9cf1-4868-a666-4960681426d3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:37.144893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:37.149420 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:37.215362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66064deb-8204-4fef-b204-cd18f29581f4 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:37.248614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675d160-9cf1-4868-a666-4960681426d3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:37.253665 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3f415-1b82-445b-ae46-9d7f62021fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:37.254319 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3f415-1b82-445b-ae46-9d7f62021fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:37.254604 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3f415-1b82-445b-ae46-9d7f62021fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:37.254883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3f415-1b82-445b-ae46-9d7f62021fb0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:37.255518 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3f415-1b82-445b-ae46-9d7f62021fb0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:37.256953 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3f415-1b82-445b-ae46-9d7f62021fb0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:37.267969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-0fc3f415-1b82-445b-ae46-9d7f62021fb0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:45:37.267969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:37.267969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:37.267969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:37.267969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:37.267969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:37.267969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:37.267969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:37.267969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:45:37.267969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:37.267969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:37.267969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:37.267969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:37.267969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:37.267969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:37.267969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:37.267969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:37.268989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:37.268989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:37.268989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:37.268989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:37.268989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:37.268989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:37.268989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:37.268989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:37.268989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:37.268989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:37.268989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:37.268989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:37.268989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:37.268989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:37.268989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:37.268989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:37.270853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:37.270853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:37.270853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:37.270853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:37.270853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:37.270853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:37.270853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:37.270853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:37.270853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:37.270853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:37.270853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:37.270853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:37.270853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:45:37.270853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:37.270853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 408/811] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:37 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:37.271739 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eede040-ff52-4492-a944-f07c4b036945 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:37.271739 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eede040-ff52-4492-a944-f07c4b036945 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:37.271739 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eede040-ff52-4492-a944-f07c4b036945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:37.289681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899b822-05e4-4f50-a7e1-5b21fba15845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:37.290031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0eede040-ff52-4492-a944-f07c4b036945 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:37.290341 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899b822-05e4-4f50-a7e1-5b21fba15845 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:37.290625 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899b822-05e4-4f50-a7e1-5b21fba15845 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:37.290901 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899b822-05e4-4f50-a7e1-5b21fba15845 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:37.291203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0eede040-ff52-4492-a944-f07c4b036945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:37.303784 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899b822-05e4-4f50-a7e1-5b21fba15845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:37.305391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899b822-05e4-4f50-a7e1-5b21fba15845 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:37.320538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-8899b822-05e4-4f50-a7e1-5b21fba15845 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:37.320538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:37.320538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:37.320538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:37.320538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:37.320538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:37.320538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:37.320538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:37.320538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:37.320538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:37.320538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:37.320538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:37.320538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:37.320538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:37.320538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:37.321572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:37.321572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:37.321572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:37.321572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:37.321572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:37.321572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:37.321572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:37.321572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:37.321572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:37.321572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:37.321572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:37.321572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:37.321572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:37.321572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:37.321572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:37.321572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:37.321572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:37.322460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:37.322460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:37.322460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:37.322460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:37.326039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 404/812] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:37.326874 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899b822-05e4-4f50-a7e1-5b21fba15845 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:37.372211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 409/813] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:37.373323 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eede040-ff52-4492-a944-f07c4b036945 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:37.402737 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:37.406957 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:37.448809 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899b822-05e4-4f50-a7e1-5b21fba15845 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:37.477779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eede040-ff52-4492-a944-f07c4b036945 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:37.482400 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b404f-6099-4199-9df2-6477225eb0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:37.483073 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b404f-6099-4199-9df2-6477225eb0e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:37.483353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b404f-6099-4199-9df2-6477225eb0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:37.483627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b404f-6099-4199-9df2-6477225eb0e4 None admin] PATH_INFO: `/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/d77b4fcb974d48a0bda4852c8d304511/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:37.486246 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b404f-6099-4199-9df2-6477225eb0e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=883ec0c5aa374fbfbfc08eda6c626cfc, user_id=d77b4fcb974d48a0bda4852c8d304511, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:37.487635 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b404f-6099-4199-9df2-6477225eb0e4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:37.513324 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bc332-cd1f-46cc-9a89-fd9d299aaec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:37.513947 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bc332-cd1f-46cc-9a89-fd9d299aaec9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:37.514228 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bc332-cd1f-46cc-9a89-fd9d299aaec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:37.514502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bc332-cd1f-46cc-9a89-fd9d299aaec9 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:37.515181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bc332-cd1f-46cc-9a89-fd9d299aaec9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:37.515487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bc332-cd1f-46cc-9a89-fd9d299aaec9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:37.516918 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bc332-cd1f-46cc-9a89-fd9d299aaec9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:37.521308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 410/814] 10.222.0.75 () {56 vars in 1112 bytes} [Thu Jul 28 17:45:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:37.522085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bc332-cd1f-46cc-9a89-fd9d299aaec9 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:37.567740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 405/815] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:45:37 2022] PUT /identity/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/d77b4fcb974d48a0bda4852c8d304511/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:45:37.569021 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b404f-6099-4199-9df2-6477225eb0e4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:37.629913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:37.632092 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bc332-cd1f-46cc-9a89-fd9d299aaec9 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:37.671642 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ff010-4b62-442b-a5a1-f844a116a52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:37.673112 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ff010-4b62-442b-a5a1-f844a116a52a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:37.673454 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ff010-4b62-442b-a5a1-f844a116a52a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:37.673832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ff010-4b62-442b-a5a1-f844a116a52a None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:37.674660 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ff010-4b62-442b-a5a1-f844a116a52a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:37.675075 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ff010-4b62-442b-a5a1-f844a116a52a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:37.676724 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ff010-4b62-442b-a5a1-f844a116a52a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:37.694661 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 411/816] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:37.694661 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ff010-4b62-442b-a5a1-f844a116a52a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:37.733387 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b404f-6099-4199-9df2-6477225eb0e4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:37.755507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:37.788812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a2c34-01dc-407b-92c0-feff44a39e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:37.789836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a2c34-01dc-407b-92c0-feff44a39e10 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:37.790323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a2c34-01dc-407b-92c0-feff44a39e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:37.790838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a2c34-01dc-407b-92c0-feff44a39e10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:37.806108 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a2c34-01dc-407b-92c0-feff44a39e10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:37.809599 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ff010-4b62-442b-a5a1-f844a116a52a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:37.813426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-556a2c34-01dc-407b-92c0-feff44a39e10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:37.813426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:37.813426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:37.813426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:37.813426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:37.813426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:37.813426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:37.813426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:37.813426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:37.813426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:37.813426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:37.813426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:37.813426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:37.813426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:37.813426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:37.813426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:37.814537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:37.814537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:37.814537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:37.814537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:37.814537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:37.814537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:37.814537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:37.814537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:37.814537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:37.814537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:37.814537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:37.814537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:37.814537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:37.814537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:37.814537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:37.814537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:37.815373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:37.815373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:37.815373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:37.815373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:37.815373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:37.815373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:37.815373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:37.815373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:37.815373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:37.815373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:37.815373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:37.815373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:37.817879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 406/817] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:37.818896 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a2c34-01dc-407b-92c0-feff44a39e10 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:37.861591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ead352-3e9c-4583-a438-6f8fa415481c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:37.862236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ead352-3e9c-4583-a438-6f8fa415481c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:37.862515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ead352-3e9c-4583-a438-6f8fa415481c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:37.862789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ead352-3e9c-4583-a438-6f8fa415481c None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:37.863473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ead352-3e9c-4583-a438-6f8fa415481c None admin] RBAC: Adding query filter params (type=network) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:37.863776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ead352-3e9c-4583-a438-6f8fa415481c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:37.865202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ead352-3e9c-4583-a438-6f8fa415481c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:37.871714 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 412/818] 10.222.0.75 () {56 vars in 1112 bytes} [Thu Jul 28 17:45:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:37.877593 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ead352-3e9c-4583-a438-6f8fa415481c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:37.897980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:37.935695 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a2c34-01dc-407b-92c0-feff44a39e10 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:37.974402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d91382-a840-4771-a6ff-167245a586d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:37.975251 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d91382-a840-4771-a6ff-167245a586d9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:37.975762 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d91382-a840-4771-a6ff-167245a586d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:37.976172 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d91382-a840-4771-a6ff-167245a586d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:37.982571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ead352-3e9c-4583-a438-6f8fa415481c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:37.985675 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d91382-a840-4771-a6ff-167245a586d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:37.987434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d91382-a840-4771-a6ff-167245a586d9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:38.001827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-f0d91382-a840-4771-a6ff-167245a586d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:38.001827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:38.001827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:38.001827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:38.001827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:38.001827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:38.001827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:38.001827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:38.001827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:38.001827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:38.001827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:38.001827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:38.001827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:38.001827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:38.001827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:38.003149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:38.003149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:38.003149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:38.003149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:38.003149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:38.003149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:38.003149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:38.003149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:38.003149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:38.003149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:38.003149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:38.003149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:38.003149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:38.003149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:38.003149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:38.003149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:38.003149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:38.004008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:38.004008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:38.004008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:38.004008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:38.004008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:38.004008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:38.004008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:38.004008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:38.004434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 407/819] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:38.005915 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d91382-a840-4771-a6ff-167245a586d9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:38.034051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac1283-aef8-4306-8e53-bdc7c3a449d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:38.035034 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac1283-aef8-4306-8e53-bdc7c3a449d3 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:38.035488 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac1283-aef8-4306-8e53-bdc7c3a449d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:38.035931 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac1283-aef8-4306-8e53-bdc7c3a449d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:38.036848 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac1283-aef8-4306-8e53-bdc7c3a449d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:38.037314 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac1283-aef8-4306-8e53-bdc7c3a449d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:38.039095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac1283-aef8-4306-8e53-bdc7c3a449d3 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:38.049347 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 413/820] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:38.050416 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac1283-aef8-4306-8e53-bdc7c3a449d3 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:38.055489 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:38.135532 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:38.137223 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d91382-a840-4771-a6ff-167245a586d9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:38.155456 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac1283-aef8-4306-8e53-bdc7c3a449d3 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:38.175295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c0fe1-2540-4c83-874c-462a8440fb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:38.176144 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0fe1-2540-4c83-874c-462a8440fb46 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:38.176574 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0fe1-2540-4c83-874c-462a8440fb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:38.177120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0fe1-2540-4c83-874c-462a8440fb46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:38.177997 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c0fe1-2540-4c83-874c-462a8440fb46 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:38.179517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c0fe1-2540-4c83-874c-462a8440fb46 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:38.191789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777fd9b-f48a-40e8-bb81-eb48e124f1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:38.192541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777fd9b-f48a-40e8-bb81-eb48e124f1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:38.192927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777fd9b-f48a-40e8-bb81-eb48e124f1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:38.193309 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777fd9b-f48a-40e8-bb81-eb48e124f1f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:38.194241 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777fd9b-f48a-40e8-bb81-eb48e124f1f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:38.194548 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777fd9b-f48a-40e8-bb81-eb48e124f1f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:38.196006 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777fd9b-f48a-40e8-bb81-eb48e124f1f8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:38.208512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 414/821] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:38.209164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777fd9b-f48a-40e8-bb81-eb48e124f1f8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:38.277146 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 408/822] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 17:45:38 2022] POST /identity/v3/endpoints => generated 327 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:45:38.278584 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c0fe1-2540-4c83-874c-462a8440fb46 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:38.337146 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777fd9b-f48a-40e8-bb81-eb48e124f1f8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:38.388381 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba165996-a204-47b2-a16c-3dad007c7a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:38.389066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba165996-a204-47b2-a16c-3dad007c7a21 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:38.389348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba165996-a204-47b2-a16c-3dad007c7a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:38.389620 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba165996-a204-47b2-a16c-3dad007c7a21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:38.394150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:38.414541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba165996-a204-47b2-a16c-3dad007c7a21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:38.419571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba165996-a204-47b2-a16c-3dad007c7a21 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:38.440066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-ba165996-a204-47b2-a16c-3dad007c7a21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:38.440066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:38.440066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:38.440066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:38.440066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:38.440066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:38.440066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:38.440066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:38.440066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:38.440066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:38.440066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:38.440066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:38.440066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:38.440066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:38.440066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:38.441251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:38.441251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:38.441251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:38.441251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:38.441251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:38.441251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:38.441251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:38.441251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:38.441251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:38.441251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:38.441251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:38.441251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:38.441251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:38.441251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:38.441251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:38.441251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:38.441251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:38.442364 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:38.442364 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:38.442364 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:38.442364 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:38.444496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 415/823] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:38.450631 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba165996-a204-47b2-a16c-3dad007c7a21 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:38.493625 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:38.503703 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c0fe1-2540-4c83-874c-462a8440fb46 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:38.544278 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634491ea-71b0-419b-b1a3-9679f3fc60ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:38.544946 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634491ea-71b0-419b-b1a3-9679f3fc60ec None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:38.545223 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634491ea-71b0-419b-b1a3-9679f3fc60ec None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:38.545523 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634491ea-71b0-419b-b1a3-9679f3fc60ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:38.546472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634491ea-71b0-419b-b1a3-9679f3fc60ec None admin] RBAC: Adding query filter params (role.id=d371062e071845ffa4570a76d40dff88, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=c456a787159844feb7eabfd1e527e46e) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:38.547120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634491ea-71b0-419b-b1a3-9679f3fc60ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:38.548376 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634491ea-71b0-419b-b1a3-9679f3fc60ec None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:38.560916 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 409/824] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:38 2022] GET /identity/v3/role_assignments?user.id=c456a787159844feb7eabfd1e527e46e&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=d371062e071845ffa4570a76d40dff88 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:38.567093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba165996-a204-47b2-a16c-3dad007c7a21 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:38.609013 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ebc8e-000f-4d5c-9925-f80323e152ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:38.610012 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ebc8e-000f-4d5c-9925-f80323e152ae None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:38.610469 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ebc8e-000f-4d5c-9925-f80323e152ae None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:38.610935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ebc8e-000f-4d5c-9925-f80323e152ae None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:38.611824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ebc8e-000f-4d5c-9925-f80323e152ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:38.612283 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ebc8e-000f-4d5c-9925-f80323e152ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:38.613901 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ebc8e-000f-4d5c-9925-f80323e152ae None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:38.631399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 416/825] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:38.642104 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634491ea-71b0-419b-b1a3-9679f3fc60ec None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:38.775966 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634491ea-71b0-419b-b1a3-9679f3fc60ec None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:38.815574 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae9319-36d2-49a6-90f3-4ad8c738ef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:38.816387 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae9319-36d2-49a6-90f3-4ad8c738ef3a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:38.816824 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae9319-36d2-49a6-90f3-4ad8c738ef3a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:38.817201 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae9319-36d2-49a6-90f3-4ad8c738ef3a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:38.825673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae9319-36d2-49a6-90f3-4ad8c738ef3a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:38.827302 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae9319-36d2-49a6-90f3-4ad8c738ef3a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:38.840462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-9eae9319-36d2-49a6-90f3-4ad8c738ef3a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:45:38.840462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:38.840462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:38.840462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:38.840462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:38.840462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:38.840462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:38.840462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:38.840462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:38.840462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:38.840462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:38.840462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:38.840462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:38.840462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:38.840462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:38.840462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:38.841725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:38.841725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:38.841725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:38.841725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:38.841725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:38.841725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:38.841725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:38.841725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:38.841725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:38.841725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:38.841725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:38.841725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:38.841725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:38.841725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:38.841725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:38.841725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:38.841725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:38.841725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:38.842875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:38.842875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:38.842875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:38.842875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:38.842875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:38.842875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:38.842875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:38.842875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:38.842875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:45:38.842875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:38.845959 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 410/826] 10.222.0.75 () {56 vars in 1117 bytes} [Thu Jul 28 17:45:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:38.850606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ebc8e-000f-4d5c-9925-f80323e152ae None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:38.904386 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:38.951640 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4d601-f777-43d1-90f9-d80691c2dc0c None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:38.952016 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4d601-f777-43d1-90f9-d80691c2dc0c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:38.952366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4d601-f777-43d1-90f9-d80691c2dc0c None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:38.954657 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 411/827] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:45:38.959366 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ebc8e-000f-4d5c-9925-f80323e152ae None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:38.964188 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0c9e3-30c5-4c9b-a0a7-657bdbe86b44 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:38.964481 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0c9e3-30c5-4c9b-a0a7-657bdbe86b44 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:38.964850 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0c9e3-30c5-4c9b-a0a7-657bdbe86b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:38.992778 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0fa0c9e3-30c5-4c9b-a0a7-657bdbe86b44 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:38.992778 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0fa0c9e3-30c5-4c9b-a0a7-657bdbe86b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:38.999365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:39.000230 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29461d-0c21-4ee7-a34a-4356c96366ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:39.000898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29461d-0c21-4ee7-a34a-4356c96366ea None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:39.001185 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29461d-0c21-4ee7-a34a-4356c96366ea None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:39.001462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29461d-0c21-4ee7-a34a-4356c96366ea None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:39.002264 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29461d-0c21-4ee7-a34a-4356c96366ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:39.002575 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29461d-0c21-4ee7-a34a-4356c96366ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:39.004025 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29461d-0c21-4ee7-a34a-4356c96366ea None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:39.021830 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 417/828] 10.222.0.75 () {56 vars in 1149 bytes} [Thu Jul 28 17:45:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:39.028893 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29461d-0c21-4ee7-a34a-4356c96366ea None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:39.074649 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 412/829] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:45:39.101609 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0c9e3-30c5-4c9b-a0a7-657bdbe86b44 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:39.152264 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29461d-0c21-4ee7-a34a-4356c96366ea None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:39.161122 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:39.190726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6a7a6-58bc-40d3-aca8-f307e636064c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:39.191385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6a7a6-58bc-40d3-aca8-f307e636064c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:39.191666 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6a7a6-58bc-40d3-aca8-f307e636064c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:39.191942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6a7a6-58bc-40d3-aca8-f307e636064c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:39.206097 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0c9e3-30c5-4c9b-a0a7-657bdbe86b44 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:39.207203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6a7a6-58bc-40d3-aca8-f307e636064c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:39.209969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6a7a6-58bc-40d3-aca8-f307e636064c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:39.229380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-53e6a7a6-58bc-40d3-aca8-f307e636064c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:39.229380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:39.229380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:39.229380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:39.229380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:39.229380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:39.229380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:39.229380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:39.229380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:39.229380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:39.229380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:39.229380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:39.229380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:39.229380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:39.229380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:39.230322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:39.230322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:39.230322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:39.230322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:39.230322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:39.230322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:39.230322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:39.230322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:39.230322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:39.230322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:39.230322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:39.230322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:39.230322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:39.230322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:39.230322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:39.230322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:39.230322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:39.231191 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:39.231191 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:39.231191 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:39.231191 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:39.235179 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 418/830] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:39.236431 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6a7a6-58bc-40d3-aca8-f307e636064c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:39.249954 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615d814-4133-4cdc-87cf-c59b89b4f6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:39.250888 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615d814-4133-4cdc-87cf-c59b89b4f6dc None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:39.251175 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615d814-4133-4cdc-87cf-c59b89b4f6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:39.251453 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615d814-4133-4cdc-87cf-c59b89b4f6dc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:39.252354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615d814-4133-4cdc-87cf-c59b89b4f6dc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:39.254530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615d814-4133-4cdc-87cf-c59b89b4f6dc None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:39.267786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-7615d814-4133-4cdc-87cf-c59b89b4f6dc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:45:39.267786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:39.267786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:39.267786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:39.267786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:39.267786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:39.267786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:39.267786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:39.267786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:45:39.267786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:39.267786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:39.267786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:39.267786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:39.267786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:39.267786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:39.267786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:39.267786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:39.269026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:39.269026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:39.269026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:39.269026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:39.269026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:39.269026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:39.269026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:39.269026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:39.269026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:39.269026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:39.269026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:39.269026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:39.269026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:39.269026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:39.269026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:39.269026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:39.270166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:39.270166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:39.270166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:39.270166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:39.270166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:39.270166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:39.270166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:39.270166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:39.270166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:39.270166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:39.270166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:39.270166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:39.270166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:45:39.270166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:39.272849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 413/831] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:45:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:39.277830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615d814-4133-4cdc-87cf-c59b89b4f6dc None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:39.293566 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:39.359961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6a7a6-58bc-40d3-aca8-f307e636064c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:39.408317 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615d814-4133-4cdc-87cf-c59b89b4f6dc None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:39.413172 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd477f6d-cf3e-448e-9e37-60dcb6a3c2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:39.414119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd477f6d-cf3e-448e-9e37-60dcb6a3c2eb None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:39.414611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd477f6d-cf3e-448e-9e37-60dcb6a3c2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:39.415085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd477f6d-cf3e-448e-9e37-60dcb6a3c2eb None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:39.416591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd477f6d-cf3e-448e-9e37-60dcb6a3c2eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:39.417143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd477f6d-cf3e-448e-9e37-60dcb6a3c2eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:39.419300 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd477f6d-cf3e-448e-9e37-60dcb6a3c2eb None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:39.438093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 419/832] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:39.443747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd477f6d-cf3e-448e-9e37-60dcb6a3c2eb None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:39.454047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f8f5e-0a87-400a-a876-2a56b7a23cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:39.455241 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f8f5e-0a87-400a-a876-2a56b7a23cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:39.455538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f8f5e-0a87-400a-a876-2a56b7a23cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:39.455814 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f8f5e-0a87-400a-a876-2a56b7a23cd9 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:39.456512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f8f5e-0a87-400a-a876-2a56b7a23cd9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:39.456850 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f8f5e-0a87-400a-a876-2a56b7a23cd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:39.458691 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f8f5e-0a87-400a-a876-2a56b7a23cd9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:39.469286 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 414/833] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:45:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:39.471910 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f8f5e-0a87-400a-a876-2a56b7a23cd9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:39.473436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:39.548720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:39.581993 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f8f5e-0a87-400a-a876-2a56b7a23cd9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:39.586627 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd477f6d-cf3e-448e-9e37-60dcb6a3c2eb None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:39.621878 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b5a93-1c54-4edc-ad76-cdc7eb9e47d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:39.622525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b5a93-1c54-4edc-ad76-cdc7eb9e47d7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:39.622805 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b5a93-1c54-4edc-ad76-cdc7eb9e47d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:39.623074 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b5a93-1c54-4edc-ad76-cdc7eb9e47d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:39.626006 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d24ea-5c60-467f-b371-558604008540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:39.627171 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d24ea-5c60-467f-b371-558604008540 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:39.627656 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d24ea-5c60-467f-b371-558604008540 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:39.628128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d24ea-5c60-467f-b371-558604008540 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:39.629054 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d24ea-5c60-467f-b371-558604008540 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:39.629572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d24ea-5c60-467f-b371-558604008540 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:39.630793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b5a93-1c54-4edc-ad76-cdc7eb9e47d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:39.631604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d24ea-5c60-467f-b371-558604008540 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:39.632456 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b5a93-1c54-4edc-ad76-cdc7eb9e47d7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:39.644814 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 415/834] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:45:39 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:39.651636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-5a8b5a93-1c54-4edc-ad76-cdc7eb9e47d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:39.651636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:39.651636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:39.651636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:39.651636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:39.651636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:39.651636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:39.651636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:39.651636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:39.651636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:39.651636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:39.651636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:39.651636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:39.651636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:39.651636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:39.652588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:39.652588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:39.652588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:39.652588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:39.652588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:39.652588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:39.652588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:39.652588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:39.652588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:39.652588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:39.652588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:39.652588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:39.652588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:39.652588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:39.652588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:39.652588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:39.652588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:39.653511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:39.653511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:39.653511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:39.653511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:39.653511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:39.653511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:39.653511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:39.653511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:39.657984 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 420/835] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:39.659563 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d24ea-5c60-467f-b371-558604008540 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:39.772430 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d24ea-5c60-467f-b371-558604008540 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:39.796312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22326821-c88a-478a-bd19-c560b4a8ee3c None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:39.796662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22326821-c88a-478a-bd19-c560b4a8ee3c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:39.796946 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22326821-c88a-478a-bd19-c560b4a8ee3c None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:39.798633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 421/836] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:39.804104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9f42a-74d0-42e9-8017-f44e552564d2 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:39.804364 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9f42a-74d0-42e9-8017-f44e552564d2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:39.804589 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9f42a-74d0-42e9-8017-f44e552564d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:39.814695 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e991cc-c5da-4a02-8e75-a675ee152539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:39.815374 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e991cc-c5da-4a02-8e75-a675ee152539 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:39.815606 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e991cc-c5da-4a02-8e75-a675ee152539 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:39.815880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e991cc-c5da-4a02-8e75-a675ee152539 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:39.816648 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e991cc-c5da-4a02-8e75-a675ee152539 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:39.816984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e991cc-c5da-4a02-8e75-a675ee152539 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:39.818433 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e991cc-c5da-4a02-8e75-a675ee152539 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:39.821947 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:39.833391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-dde9f42a-74d0-42e9-8017-f44e552564d2 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:39.834432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 416/837] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:39.834644 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-dde9f42a-74d0-42e9-8017-f44e552564d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:39.841516 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e991cc-c5da-4a02-8e75-a675ee152539 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:39.919066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 422/838] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:45:39.943043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9f42a-74d0-42e9-8017-f44e552564d2 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:39.953337 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:39.969483 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e991cc-c5da-4a02-8e75-a675ee152539 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:40.012665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b57f6-03bc-4419-836e-ecbb677c90cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:40.013930 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b57f6-03bc-4419-836e-ecbb677c90cd None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:40.014403 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b57f6-03bc-4419-836e-ecbb677c90cd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:40.015038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b57f6-03bc-4419-836e-ecbb677c90cd None admin] PATH_INFO: `/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/1cbbfdda843a4ab98ff9cf0742513f44/roles/6f10ff8509da43688fba83e6a4fd5c5f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:40.031888 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b57f6-03bc-4419-836e-ecbb677c90cd None admin] RBAC: Authorizing `identity:create_grant(project_id=883ec0c5aa374fbfbfc08eda6c626cfc, user_id=1cbbfdda843a4ab98ff9cf0742513f44, role_id=6f10ff8509da43688fba83e6a4fd5c5f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:40.033497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b57f6-03bc-4419-836e-ecbb677c90cd None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:40.052332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9f42a-74d0-42e9-8017-f44e552564d2 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:40.089004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03165b3-2031-4874-b4e2-43b4b3b32cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:40.089577 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03165b3-2031-4874-b4e2-43b4b3b32cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:40.089855 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03165b3-2031-4874-b4e2-43b4b3b32cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:40.090127 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03165b3-2031-4874-b4e2-43b4b3b32cc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:40.100775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03165b3-2031-4874-b4e2-43b4b3b32cc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:40.105641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-e03165b3-2031-4874-b4e2-43b4b3b32cc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:45:40.105641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:40.105641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:40.105641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:40.105641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:40.105641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:40.105641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:40.105641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:40.105641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:40.105641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:40.105641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:40.105641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:40.105641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:40.105641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:40.105641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:40.105641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:40.106779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:40.106779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:40.106779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:40.106779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:40.106779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:40.106779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:40.106779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:40.106779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:40.106779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:40.106779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:40.106779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:40.106779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:40.106779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:40.106779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:40.106779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:40.106779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:40.107663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:40.107663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:40.107663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:40.107663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:40.107663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:40.107663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:40.107663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:40.107663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:40.107663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:40.107663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:40.107663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:45:40.107663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:40.107663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 423/839] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:45:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:40.115619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03165b3-2031-4874-b4e2-43b4b3b32cc8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:40.140617 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 417/840] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:45:39 2022] PUT /identity/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/1cbbfdda843a4ab98ff9cf0742513f44/roles/6f10ff8509da43688fba83e6a4fd5c5f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:45:40.203923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:40.242393 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03165b3-2031-4874-b4e2-43b4b3b32cc8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:40.283746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ab5bc-9403-4e10-96c9-b0fb45ee9da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:40.284378 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ab5bc-9403-4e10-96c9-b0fb45ee9da8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:40.284658 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ab5bc-9403-4e10-96c9-b0fb45ee9da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:40.284956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ab5bc-9403-4e10-96c9-b0fb45ee9da8 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:40.285687 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ab5bc-9403-4e10-96c9-b0fb45ee9da8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:40.285994 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ab5bc-9403-4e10-96c9-b0fb45ee9da8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:40.287403 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ab5bc-9403-4e10-96c9-b0fb45ee9da8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:40.298015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 424/841] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:45:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:40.303221 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b57f6-03bc-4419-836e-ecbb677c90cd None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:40.357712 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:40.414626 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b57f6-03bc-4419-836e-ecbb677c90cd None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:40.450116 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae8947-5d18-46ab-a877-b33194e265f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:40.450870 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae8947-5d18-46ab-a877-b33194e265f2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:40.451374 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae8947-5d18-46ab-a877-b33194e265f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:40.451825 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae8947-5d18-46ab-a877-b33194e265f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:40.462477 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae8947-5d18-46ab-a877-b33194e265f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:40.464059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae8947-5d18-46ab-a877-b33194e265f2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:40.479623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-e6ae8947-5d18-46ab-a877-b33194e265f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:40.479623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:40.479623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:40.479623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:40.479623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:40.479623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:40.479623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:40.479623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:40.479623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:40.479623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:40.479623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:40.479623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:40.479623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:40.479623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:40.479623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:40.480720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:40.480720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:40.480720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:40.480720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:40.480720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:40.480720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:40.480720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:40.480720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:40.480720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:40.480720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:40.480720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:40.480720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:40.480720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:40.480720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:40.480720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:40.480720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:40.480720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:40.481936 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:40.481936 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:40.481936 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:40.481936 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:40.484778 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 418/842] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:40.488301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ab5bc-9403-4e10-96c9-b0fb45ee9da8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:40.598983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ab5bc-9403-4e10-96c9-b0fb45ee9da8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:40.628813 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:40.634740 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124f989-95a9-4f31-8176-9916690b15bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:40.635369 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124f989-95a9-4f31-8176-9916690b15bf None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:40.635649 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124f989-95a9-4f31-8176-9916690b15bf None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:40.640098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124f989-95a9-4f31-8176-9916690b15bf None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:40.640098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124f989-95a9-4f31-8176-9916690b15bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:40.640098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124f989-95a9-4f31-8176-9916690b15bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:40.640098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124f989-95a9-4f31-8176-9916690b15bf None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:40.651784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 425/843] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:40.658130 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae8947-5d18-46ab-a877-b33194e265f2 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:40.762336 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:40.766603 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae8947-5d18-46ab-a877-b33194e265f2 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:40.787850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f469a3-f754-4526-91cb-586f9d079d78 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:40.788136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f469a3-f754-4526-91cb-586f9d079d78 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:40.788412 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f469a3-f754-4526-91cb-586f9d079d78 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:40.790067 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 426/844] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:40.794975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f3e5a-a537-45f0-9683-e47532f1aa3f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:40.795321 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f3e5a-a537-45f0-9683-e47532f1aa3f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:40.795604 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f3e5a-a537-45f0-9683-e47532f1aa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:40.803562 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb41bf-04fe-4c09-bc59-9c52bcf9b938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:40.804393 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb41bf-04fe-4c09-bc59-9c52bcf9b938 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:40.804742 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb41bf-04fe-4c09-bc59-9c52bcf9b938 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:40.805098 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb41bf-04fe-4c09-bc59-9c52bcf9b938 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:40.814546 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-502f3e5a-a537-45f0-9683-e47532f1aa3f None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:40.815139 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb41bf-04fe-4c09-bc59-9c52bcf9b938 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:40.815753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-502f3e5a-a537-45f0-9683-e47532f1aa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:40.817237 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb41bf-04fe-4c09-bc59-9c52bcf9b938 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:40.833402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-64cb41bf-04fe-4c09-bc59-9c52bcf9b938 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:45:40.833402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:40.833402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:40.833402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:40.833402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:40.833402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:40.833402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:40.833402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:40.833402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:40.833402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:40.833402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:40.833402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:40.833402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:40.833402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:40.833402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:40.833402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:40.834577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:40.834577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:40.834577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:40.834577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:40.834577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:40.834577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:40.834577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:40.834577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:40.834577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:40.834577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:40.834577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:40.834577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:40.834577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:40.834577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:40.834577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:40.834577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:40.834577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:40.834577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:40.836122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:40.836122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:40.836122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:40.836122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:40.836122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:40.836122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:40.836122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:40.836122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:40.836122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:45:40.836122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:40.836829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 419/845] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:45:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:40.842680 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb41bf-04fe-4c09-bc59-9c52bcf9b938 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:40.903552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 427/846] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:40.925113 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f3e5a-a537-45f0-9683-e47532f1aa3f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:40.982927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb41bf-04fe-4c09-bc59-9c52bcf9b938 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:41.027814 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bfd0c-c6a6-4a3a-9e2a-bf7bce984927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:41.028048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f3e5a-a537-45f0-9683-e47532f1aa3f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:41.028985 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bfd0c-c6a6-4a3a-9e2a-bf7bce984927 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:41.029640 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bfd0c-c6a6-4a3a-9e2a-bf7bce984927 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:41.030115 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bfd0c-c6a6-4a3a-9e2a-bf7bce984927 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:41.032368 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bfd0c-c6a6-4a3a-9e2a-bf7bce984927 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:41.032906 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bfd0c-c6a6-4a3a-9e2a-bf7bce984927 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:41.034509 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bfd0c-c6a6-4a3a-9e2a-bf7bce984927 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:41.051650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:41.057506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 420/847] 10.222.0.75 () {56 vars in 1135 bytes} [Thu Jul 28 17:45:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:41.063027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bfd0c-c6a6-4a3a-9e2a-bf7bce984927 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:41.077660 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611a600-bd2d-48df-8321-5fab0fc56f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:41.078742 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611a600-bd2d-48df-8321-5fab0fc56f6e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:41.079176 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611a600-bd2d-48df-8321-5fab0fc56f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:41.079553 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611a600-bd2d-48df-8321-5fab0fc56f6e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:41.080345 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611a600-bd2d-48df-8321-5fab0fc56f6e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:41.082610 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611a600-bd2d-48df-8321-5fab0fc56f6e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:41.084883 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:41.095726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-4611a600-bd2d-48df-8321-5fab0fc56f6e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:45:41.095726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:41.095726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:41.095726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:41.095726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:41.095726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:41.095726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:41.095726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:41.095726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:45:41.095726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:41.095726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:41.095726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:41.095726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:41.095726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:41.095726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:41.095726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:41.096934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:41.096934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:41.096934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:41.096934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:41.096934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:41.096934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:41.096934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:41.096934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:41.096934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:41.096934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:41.096934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:41.096934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:41.096934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:41.096934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:41.096934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:41.096934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:41.097913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:41.097913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:41.097913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:41.097913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:41.097913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:41.097913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:41.097913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:41.097913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:41.097913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:41.097913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:41.097913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:41.097913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:41.097913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:41.097913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:45:41.097913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:41.100827 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 428/848] 10.222.0.75 () {56 vars in 1132 bytes} [Thu Jul 28 17:45:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:41.104382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611a600-bd2d-48df-8321-5fab0fc56f6e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:41.197802 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bfd0c-c6a6-4a3a-9e2a-bf7bce984927 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:41.222884 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611a600-bd2d-48df-8321-5fab0fc56f6e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:41.237039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e26f63-77eb-4de4-b044-a9bacc680428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:41.238078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e26f63-77eb-4de4-b044-a9bacc680428 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:41.238608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e26f63-77eb-4de4-b044-a9bacc680428 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:41.239083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e26f63-77eb-4de4-b044-a9bacc680428 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:41.258989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bfaee-051e-4a23-8e4c-fc41deddbff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:41.259624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bfaee-051e-4a23-8e4c-fc41deddbff6 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:41.259903 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bfaee-051e-4a23-8e4c-fc41deddbff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:41.260173 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bfaee-051e-4a23-8e4c-fc41deddbff6 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:41.260891 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bfaee-051e-4a23-8e4c-fc41deddbff6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:41.261202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bfaee-051e-4a23-8e4c-fc41deddbff6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:41.262591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bfaee-051e-4a23-8e4c-fc41deddbff6 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:41.272148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 429/849] 10.222.0.75 () {56 vars in 1126 bytes} [Thu Jul 28 17:45:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:41.274907 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bfaee-051e-4a23-8e4c-fc41deddbff6 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:41.330701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e26f63-77eb-4de4-b044-a9bacc680428 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:41.332832 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e26f63-77eb-4de4-b044-a9bacc680428 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:41.348741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:41.363853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:41.417978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bfaee-051e-4a23-8e4c-fc41deddbff6 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:41.465137 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6df32-10f6-465f-bb17-cf2368e1b2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:41.465985 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6df32-10f6-465f-bb17-cf2368e1b2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:41.466398 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6df32-10f6-465f-bb17-cf2368e1b2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:41.466823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6df32-10f6-465f-bb17-cf2368e1b2f9 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:41.467632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6df32-10f6-465f-bb17-cf2368e1b2f9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:41.468079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6df32-10f6-465f-bb17-cf2368e1b2f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:41.470205 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6df32-10f6-465f-bb17-cf2368e1b2f9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:41.470730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 421/850] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:41 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:45:41.471712 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e26f63-77eb-4de4-b044-a9bacc680428 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:41.477275 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 430/851] 10.222.0.75 () {56 vars in 1126 bytes} [Thu Jul 28 17:45:41 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:41.593471 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e26f63-77eb-4de4-b044-a9bacc680428 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:41.613390 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:41.633785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecff95-538d-48cd-b97e-2914de9b7199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:41.634708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecff95-538d-48cd-b97e-2914de9b7199 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:41.635167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecff95-538d-48cd-b97e-2914de9b7199 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:41.635601 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecff95-538d-48cd-b97e-2914de9b7199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:41.648038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecff95-538d-48cd-b97e-2914de9b7199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:41.650098 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecff95-538d-48cd-b97e-2914de9b7199 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:41.667329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-17ecff95-538d-48cd-b97e-2914de9b7199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:41.667329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:41.667329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:41.667329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:41.667329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:41.667329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:41.667329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:41.667329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:41.667329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:41.667329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:41.667329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:41.667329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:41.667329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:41.667329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:41.667329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:41.668439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:41.668439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:41.668439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:41.668439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:41.668439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:41.668439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:41.668439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:41.668439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:41.668439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:41.668439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:41.668439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:41.668439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:41.668439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:41.668439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:41.668439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:41.668439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:41.668439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:41.669630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:41.669630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:41.669630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:41.669630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:41.671454 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 422/852] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:41.677505 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6df32-10f6-465f-bb17-cf2368e1b2f9 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:41.782523 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b553c-d2b1-4012-8166-89ccd84405a1 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:41.782739 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b553c-d2b1-4012-8166-89ccd84405a1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:41.782934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b553c-d2b1-4012-8166-89ccd84405a1 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:41.787954 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 423/853] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:45:41.788386 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6df32-10f6-465f-bb17-cf2368e1b2f9 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:41.789619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b9c27-6624-4550-ad3d-24c8a2a1b8ae None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:41.789905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b9c27-6624-4550-ad3d-24c8a2a1b8ae None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:41.790179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b9c27-6624-4550-ad3d-24c8a2a1b8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:41.804836 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:41.809518 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f27b9c27-6624-4550-ad3d-24c8a2a1b8ae None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:41.810738 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f27b9c27-6624-4550-ad3d-24c8a2a1b8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:41.834403 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e00ae-5037-40e0-962b-6f9d4efb624d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:41.835654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e00ae-5037-40e0-962b-6f9d4efb624d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:41.836345 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e00ae-5037-40e0-962b-6f9d4efb624d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:41.836788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e00ae-5037-40e0-962b-6f9d4efb624d None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:41.838352 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e00ae-5037-40e0-962b-6f9d4efb624d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:41.838835 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e00ae-5037-40e0-962b-6f9d4efb624d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:41.841329 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e00ae-5037-40e0-962b-6f9d4efb624d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:41.858466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 431/854] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:41.863857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e00ae-5037-40e0-962b-6f9d4efb624d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:41.890350 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 424/855] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:41.912738 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b9c27-6624-4550-ad3d-24c8a2a1b8ae None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:41.982555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e00ae-5037-40e0-962b-6f9d4efb624d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:42.031105 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58932af8-248a-4420-b553-30d831cb73bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:42.031770 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58932af8-248a-4420-b553-30d831cb73bf None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:42.032360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58932af8-248a-4420-b553-30d831cb73bf None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:42.032700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58932af8-248a-4420-b553-30d831cb73bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:42.039014 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:42.042989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b9c27-6624-4550-ad3d-24c8a2a1b8ae None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:42.043443 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58932af8-248a-4420-b553-30d831cb73bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:42.045271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58932af8-248a-4420-b553-30d831cb73bf None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:42.061312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-58932af8-248a-4420-b553-30d831cb73bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:42.061312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:42.061312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:42.061312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:42.061312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:42.061312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:42.061312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:42.061312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:42.061312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:42.061312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:42.061312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:42.061312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:42.061312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:42.061312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:42.061312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:42.063279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:42.063279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:42.063279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:42.063279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:42.063279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:42.063279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:42.063279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:42.063279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:42.063279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:42.063279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:42.063279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:42.063279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:42.063279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:42.063279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:42.063279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:42.063279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:42.063279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:42.064669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:42.064669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:42.064669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:42.064669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:42.064669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:42.064669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:42.064669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:42.064669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:42.066800 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 432/856] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:42.072740 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58932af8-248a-4420-b553-30d831cb73bf None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:42.084613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e6beb-a1ef-4478-8dd7-506cea821a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:42.085361 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e6beb-a1ef-4478-8dd7-506cea821a39 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:42.085713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e6beb-a1ef-4478-8dd7-506cea821a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:42.086097 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e6beb-a1ef-4478-8dd7-506cea821a39 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:42.086877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e6beb-a1ef-4478-8dd7-506cea821a39 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:42.088402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e6beb-a1ef-4478-8dd7-506cea821a39 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:42.110689 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:42.172867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 425/857] 10.222.0.75 () {60 vars in 1141 bytes} [Thu Jul 28 17:45:41 2022] POST /identity/v3/services => generated 251 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:45:42.199220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58932af8-248a-4420-b553-30d831cb73bf None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:42.202100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6280aa-c41a-4a6d-9355-d8646fc1eb43 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:42.202432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6280aa-c41a-4a6d-9355-d8646fc1eb43 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:42.202905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6280aa-c41a-4a6d-9355-d8646fc1eb43 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:42.208615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 426/858] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:45:42.210053 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933094ba-55a4-4241-a392-ce566184ef0f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:42.210344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933094ba-55a4-4241-a392-ce566184ef0f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:42.210673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933094ba-55a4-4241-a392-ce566184ef0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:42.229512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-933094ba-55a4-4241-a392-ce566184ef0f None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:42.230746 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-933094ba-55a4-4241-a392-ce566184ef0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:42.259417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92306017-68d7-401a-ab88-20ef85df694c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:42.260482 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92306017-68d7-401a-ab88-20ef85df694c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:42.261088 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92306017-68d7-401a-ab88-20ef85df694c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:42.261898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92306017-68d7-401a-ab88-20ef85df694c None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:42.263155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92306017-68d7-401a-ab88-20ef85df694c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:42.263620 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92306017-68d7-401a-ab88-20ef85df694c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:42.266279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92306017-68d7-401a-ab88-20ef85df694c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:42.288309 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 433/859] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:42.290973 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92306017-68d7-401a-ab88-20ef85df694c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:42.320694 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 427/860] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:42 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:42.343952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933094ba-55a4-4241-a392-ce566184ef0f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:42.405196 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:42.422995 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92306017-68d7-401a-ab88-20ef85df694c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:42.454137 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:42.468698 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933094ba-55a4-4241-a392-ce566184ef0f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:42.472034 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419e928-8c3e-469c-b8ef-14d33de4eeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:42.472908 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419e928-8c3e-469c-b8ef-14d33de4eeb4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:42.473358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419e928-8c3e-469c-b8ef-14d33de4eeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:42.473781 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419e928-8c3e-469c-b8ef-14d33de4eeb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:42.474722 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419e928-8c3e-469c-b8ef-14d33de4eeb4 None admin] RBAC: Adding query filter params (role.id=d371062e071845ffa4570a76d40dff88, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=d77b4fcb974d48a0bda4852c8d304511) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:42.475182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419e928-8c3e-469c-b8ef-14d33de4eeb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:42.476860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419e928-8c3e-469c-b8ef-14d33de4eeb4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:42.492782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 434/861] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:42 2022] GET /identity/v3/role_assignments?user.id=d77b4fcb974d48a0bda4852c8d304511&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=d371062e071845ffa4570a76d40dff88 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:42.519416 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02059474-6cfe-4de7-a135-d5e78d3ee49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:42.520078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02059474-6cfe-4de7-a135-d5e78d3ee49a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:42.520358 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02059474-6cfe-4de7-a135-d5e78d3ee49a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:42.520701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02059474-6cfe-4de7-a135-d5e78d3ee49a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:42.533952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02059474-6cfe-4de7-a135-d5e78d3ee49a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:42.539136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-02059474-6cfe-4de7-a135-d5e78d3ee49a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:42.539136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:42.539136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:42.539136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:42.539136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:42.539136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:42.539136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:42.539136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:42.539136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:42.539136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:42.539136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:42.539136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:42.539136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:42.539136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:42.539136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:42.539136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:42.540261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:42.540261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:42.540261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:42.540261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:42.540261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:42.540261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:42.540261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:42.540261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:42.540261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:42.540261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:42.540261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:42.540261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:42.540261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:42.540261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:42.540261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:42.540261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:42.541131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:42.541131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:42.541131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:42.541131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:42.541131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:42.541131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:42.541131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:42.541131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:42.541131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:42.541131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:42.541131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:42.541131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:42.541131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 428/862] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:42.547541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419e928-8c3e-469c-b8ef-14d33de4eeb4 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:42.661482 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419e928-8c3e-469c-b8ef-14d33de4eeb4 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:42.700454 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cd8d3-3d91-4d63-b66a-be9bb9fc4535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:42.701156 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cd8d3-3d91-4d63-b66a-be9bb9fc4535 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:42.701435 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cd8d3-3d91-4d63-b66a-be9bb9fc4535 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:42.701707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cd8d3-3d91-4d63-b66a-be9bb9fc4535 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:42.702539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299cd8d3-3d91-4d63-b66a-be9bb9fc4535 None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:42.702934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299cd8d3-3d91-4d63-b66a-be9bb9fc4535 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:42.704442 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299cd8d3-3d91-4d63-b66a-be9bb9fc4535 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:42.713915 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 435/863] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:42.720950 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02059474-6cfe-4de7-a135-d5e78d3ee49a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:42.836929 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02059474-6cfe-4de7-a135-d5e78d3ee49a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:42.873307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994673f-6a95-4518-b9b6-48f093f6a2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:42.873950 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994673f-6a95-4518-b9b6-48f093f6a2fe None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:42.874288 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994673f-6a95-4518-b9b6-48f093f6a2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:42.874611 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994673f-6a95-4518-b9b6-48f093f6a2fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:42.886314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994673f-6a95-4518-b9b6-48f093f6a2fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:42.887769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994673f-6a95-4518-b9b6-48f093f6a2fe None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:42.896875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:42.904215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-d994673f-6a95-4518-b9b6-48f093f6a2fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:42.904215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:42.904215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:42.904215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:42.904215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:42.904215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:42.904215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:42.904215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:42.904215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:42.904215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:42.904215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:42.904215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:42.904215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:42.904215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:42.904215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:42.910450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:42.910450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:42.910450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:42.910450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:42.910450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:42.910450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:42.910450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:42.910450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:42.910450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:42.910450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:42.910450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:42.910450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:42.910450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:42.910450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:42.910450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:42.910450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:42.910450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:42.911316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:42.911316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:42.911316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:42.911316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:42.911316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 429/864] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:42.914476 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cd8d3-3d91-4d63-b66a-be9bb9fc4535 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:42.932352 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:43.023925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cd8d3-3d91-4d63-b66a-be9bb9fc4535 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:43.062663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32f34a-6893-447a-9b8c-7a1b5a0bcfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:43.063285 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32f34a-6893-447a-9b8c-7a1b5a0bcfab None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:43.063564 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32f34a-6893-447a-9b8c-7a1b5a0bcfab None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:43.063833 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32f34a-6893-447a-9b8c-7a1b5a0bcfab None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:43.064526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32f34a-6893-447a-9b8c-7a1b5a0bcfab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:43.064852 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32f34a-6893-447a-9b8c-7a1b5a0bcfab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:43.066297 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32f34a-6893-447a-9b8c-7a1b5a0bcfab None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:43.081160 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 436/865] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:43.089964 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994673f-6a95-4518-b9b6-48f093f6a2fe None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:43.201833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994673f-6a95-4518-b9b6-48f093f6a2fe None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:43.237560 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2fb29-a319-4a93-b5c4-4c27a3b197e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:43.238207 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2fb29-a319-4a93-b5c4-4c27a3b197e1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:43.238485 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2fb29-a319-4a93-b5c4-4c27a3b197e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:43.238756 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2fb29-a319-4a93-b5c4-4c27a3b197e1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:43.246865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2fb29-a319-4a93-b5c4-4c27a3b197e1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:43.248311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2fb29-a319-4a93-b5c4-4c27a3b197e1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:43.260439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-3af2fb29-a319-4a93-b5c4-4c27a3b197e1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:45:43.260439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:43.260439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:43.260439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:43.260439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:43.260439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:43.260439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:43.260439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:43.260439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:43.260439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:43.260439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:43.260439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:43.260439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:43.260439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:43.260439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:43.260439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:43.261429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:43.261429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:43.261429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:43.261429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:43.261429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:43.261429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:43.261429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:43.261429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:43.261429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:43.261429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:43.261429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:43.261429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:43.261429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:43.261429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:43.261429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:43.261429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:43.261429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:43.261429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:43.262372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:43.262372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:43.262372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:43.262372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:43.262372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:43.262372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:43.262372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:43.262372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:43.262372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:45:43.262372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:43.262372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 430/866] 10.222.0.75 () {56 vars in 1117 bytes} [Thu Jul 28 17:45:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:43.269893 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32f34a-6893-447a-9b8c-7a1b5a0bcfab None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:43.357268 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:43.386469 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32f34a-6893-447a-9b8c-7a1b5a0bcfab None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:43.424117 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe99c7-7a4d-462c-9e52-3bff0409479b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:43.425144 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe99c7-7a4d-462c-9e52-3bff0409479b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:43.425626 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe99c7-7a4d-462c-9e52-3bff0409479b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:43.426134 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe99c7-7a4d-462c-9e52-3bff0409479b None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:43.427119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe99c7-7a4d-462c-9e52-3bff0409479b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:43.427624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe99c7-7a4d-462c-9e52-3bff0409479b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:43.429367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe99c7-7a4d-462c-9e52-3bff0409479b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:43.447931 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 437/867] 10.222.0.75 () {56 vars in 1149 bytes} [Thu Jul 28 17:45:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:43.457825 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2fb29-a319-4a93-b5c4-4c27a3b197e1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:43.519841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:43.561163 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2fb29-a319-4a93-b5c4-4c27a3b197e1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:43.597139 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70357938-e477-404d-b1e5-bd808a9ba398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:43.597319 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b304ea-89c5-4318-a10b-c5457eaddd6b None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:43.597547 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b304ea-89c5-4318-a10b-c5457eaddd6b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:43.597702 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70357938-e477-404d-b1e5-bd808a9ba398 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:43.597794 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b304ea-89c5-4318-a10b-c5457eaddd6b None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:43.597953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70357938-e477-404d-b1e5-bd808a9ba398 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:43.598226 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70357938-e477-404d-b1e5-bd808a9ba398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:43.599494 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 438/868] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:45:43.604258 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9da2c-594e-47ce-be6e-3fe813b2c253 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:43.604544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9da2c-594e-47ce-be6e-3fe813b2c253 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:43.604927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9da2c-594e-47ce-be6e-3fe813b2c253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:43.623554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-19e9da2c-594e-47ce-be6e-3fe813b2c253 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:43.625462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-19e9da2c-594e-47ce-be6e-3fe813b2c253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:43.680093 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70357938-e477-404d-b1e5-bd808a9ba398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:43.682118 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70357938-e477-404d-b1e5-bd808a9ba398 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:43.716904 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 439/869] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:43 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:45:43.741793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9da2c-594e-47ce-be6e-3fe813b2c253 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:43.760995 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:43.810020 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 431/870] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:43 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:45:43.816643 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70357938-e477-404d-b1e5-bd808a9ba398 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:43.821761 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:43.868088 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9da2c-594e-47ce-be6e-3fe813b2c253 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:43.905105 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721f818-83c8-4861-9ce2-0471ce4f9b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:43.906635 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721f818-83c8-4861-9ce2-0471ce4f9b07 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:43.907290 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721f818-83c8-4861-9ce2-0471ce4f9b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:43.907768 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721f818-83c8-4861-9ce2-0471ce4f9b07 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:43.908668 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721f818-83c8-4861-9ce2-0471ce4f9b07 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:43.910285 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721f818-83c8-4861-9ce2-0471ce4f9b07 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:43.940174 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70357938-e477-404d-b1e5-bd808a9ba398 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:43.974739 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e1452-e87d-47bd-ac40-727a989039f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:43.975382 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e1452-e87d-47bd-ac40-727a989039f9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:43.975666 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e1452-e87d-47bd-ac40-727a989039f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:43.975994 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e1452-e87d-47bd-ac40-727a989039f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:43.986796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e1452-e87d-47bd-ac40-727a989039f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:43.988253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e1452-e87d-47bd-ac40-727a989039f9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:44.003469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-723e1452-e87d-47bd-ac40-727a989039f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:44.003469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:44.003469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:44.003469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:44.003469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:44.003469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:44.003469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:44.003469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:44.003469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:44.003469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:44.003469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:44.003469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:44.003469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:44.003469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:44.003469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:44.004397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:44.004397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:44.004397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:44.004397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:44.004397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:44.004397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:44.004397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:44.004397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:44.004397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:44.004397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:44.004397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:44.004397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:44.004397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:44.004397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:44.004397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:44.004397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:44.004397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:44.005333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:44.005333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:44.005333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:44.005333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:44.005333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 432/871] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:44.010826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 440/872] 10.222.0.75 () {60 vars in 1141 bytes} [Thu Jul 28 17:45:43 2022] POST /identity/v3/services => generated 269 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:45:44.012181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e1452-e87d-47bd-ac40-727a989039f9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:44.036080 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:44.137717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e1452-e87d-47bd-ac40-727a989039f9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:44.193513 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4185afa-ca51-4212-abe2-83032346884e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:44.194141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4185afa-ca51-4212-abe2-83032346884e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:44.194504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4185afa-ca51-4212-abe2-83032346884e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:44.194694 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4185afa-ca51-4212-abe2-83032346884e None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:44.195392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4185afa-ca51-4212-abe2-83032346884e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:44.195697 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4185afa-ca51-4212-abe2-83032346884e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:44.197106 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4185afa-ca51-4212-abe2-83032346884e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:44.211213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 433/873] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:44.216870 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721f818-83c8-4861-9ce2-0471ce4f9b07 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:44.285108 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae380a-da82-456a-ba29-96d2ca940df1 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:44.285385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae380a-da82-456a-ba29-96d2ca940df1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:44.285849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae380a-da82-456a-ba29-96d2ca940df1 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:44.288252 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 434/874] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:45:44.293168 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dc586-7f1d-4e16-a828-c450c69d1b21 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:44.294023 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dc586-7f1d-4e16-a828-c450c69d1b21 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:44.294023 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dc586-7f1d-4e16-a828-c450c69d1b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:44.313795 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f30dc586-7f1d-4e16-a828-c450c69d1b21 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:44.315517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f30dc586-7f1d-4e16-a828-c450c69d1b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:44.350077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721f818-83c8-4861-9ce2-0471ce4f9b07 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:44.381765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:44.397789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27468f87-feff-4629-8c56-0cea4d5d9b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:44.397789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27468f87-feff-4629-8c56-0cea4d5d9b2b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:44.397789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27468f87-feff-4629-8c56-0cea4d5d9b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:44.397789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27468f87-feff-4629-8c56-0cea4d5d9b2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:44.401480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:44.403023 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27468f87-feff-4629-8c56-0cea4d5d9b2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:44.404507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27468f87-feff-4629-8c56-0cea4d5d9b2b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:44.409891 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 435/875] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:45:44.418669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-27468f87-feff-4629-8c56-0cea4d5d9b2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:44.418669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:44.418669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:44.418669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:44.418669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:44.418669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:44.418669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:44.418669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:44.418669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:44.418669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:44.418669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:44.418669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:44.418669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:44.418669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:44.418669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:44.419557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:44.419557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:44.419557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:44.419557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:44.419557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:44.419557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:44.419557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:44.419557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:44.419557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:44.419557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:44.419557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:44.419557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:44.419557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:44.419557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:44.419557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:44.419557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:44.419557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:44.420467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:44.420467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:44.420467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:44.420467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:44.420467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:44.420467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:44.420467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:44.420467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:44.422970 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 441/876] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:44.430859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30dc586-7f1d-4e16-a828-c450c69d1b21 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:44.434887 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27468f87-feff-4629-8c56-0cea4d5d9b2b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:44.539940 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30dc586-7f1d-4e16-a828-c450c69d1b21 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:44.567685 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27468f87-feff-4629-8c56-0cea4d5d9b2b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:44.579056 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410eaa54-df4e-4bc2-88c3-5c840455e4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:44.579690 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410eaa54-df4e-4bc2-88c3-5c840455e4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:44.579975 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410eaa54-df4e-4bc2-88c3-5c840455e4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:44.584794 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410eaa54-df4e-4bc2-88c3-5c840455e4b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:44.584794 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410eaa54-df4e-4bc2-88c3-5c840455e4b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:44.584794 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410eaa54-df4e-4bc2-88c3-5c840455e4b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:44.584794 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410eaa54-df4e-4bc2-88c3-5c840455e4b9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:44.597160 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 436/877] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:44.604556 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410eaa54-df4e-4bc2-88c3-5c840455e4b9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:44.615507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7923b84-9f29-4b55-be1c-a69f12246246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:44.616389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7923b84-9f29-4b55-be1c-a69f12246246 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:44.617044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7923b84-9f29-4b55-be1c-a69f12246246 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:44.617548 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7923b84-9f29-4b55-be1c-a69f12246246 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:44.618454 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7923b84-9f29-4b55-be1c-a69f12246246 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:44.620099 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7923b84-9f29-4b55-be1c-a69f12246246 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:44.629948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-a7923b84-9f29-4b55-be1c-a69f12246246 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:45:44.629948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:44.629948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:44.629948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:44.629948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:44.629948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:44.629948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:44.629948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:44.629948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:45:44.629948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:44.629948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:44.629948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:44.629948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:44.629948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:44.629948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:44.629948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:44.629948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:44.630944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:44.630944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:44.630944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:44.630944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:44.630944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:44.630944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:44.630944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:44.630944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:44.630944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:44.630944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:44.630944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:44.630944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:44.630944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:44.630944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:44.630944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:44.630944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:44.631773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:44.631773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:44.631773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:44.631773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:44.631773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:44.631773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:44.631773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:44.631773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:44.631773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:44.631773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:44.631773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:44.631773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:44.631773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:45:44.631773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:44.638998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 442/878] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:45:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:44.641228 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7923b84-9f29-4b55-be1c-a69f12246246 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:44.679820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:44.691810 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:44.732074 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410eaa54-df4e-4bc2-88c3-5c840455e4b9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:44.745972 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7923b84-9f29-4b55-be1c-a69f12246246 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:44.768607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68666509-63b9-46ec-bfae-d6a401c4daff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:44.769261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68666509-63b9-46ec-bfae-d6a401c4daff None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:44.769541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68666509-63b9-46ec-bfae-d6a401c4daff None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:44.769816 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68666509-63b9-46ec-bfae-d6a401c4daff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:44.770967 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68666509-63b9-46ec-bfae-d6a401c4daff None admin] RBAC: Adding query filter params (role.id=6f10ff8509da43688fba83e6a4fd5c5f, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=1cbbfdda843a4ab98ff9cf0742513f44) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:44.771103 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68666509-63b9-46ec-bfae-d6a401c4daff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:44.772451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68666509-63b9-46ec-bfae-d6a401c4daff None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:44.778739 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 437/879] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:44 2022] GET /identity/v3/role_assignments?user.id=1cbbfdda843a4ab98ff9cf0742513f44&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=6f10ff8509da43688fba83e6a4fd5c5f => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:44.779938 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24cb97-487e-476c-9f0c-b48ed68c204a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:44.780228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24cb97-487e-476c-9f0c-b48ed68c204a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:44.780507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24cb97-487e-476c-9f0c-b48ed68c204a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:44.782652 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 438/880] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:44.788010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604caf95-ca91-41ef-a836-5ad0b39b7d11 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:44.788272 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604caf95-ca91-41ef-a836-5ad0b39b7d11 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:44.788524 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604caf95-ca91-41ef-a836-5ad0b39b7d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:44.791669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60e84b-0158-4005-bf9a-2ffbddc9335d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:44.792624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60e84b-0158-4005-bf9a-2ffbddc9335d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:44.793143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60e84b-0158-4005-bf9a-2ffbddc9335d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:44.793677 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60e84b-0158-4005-bf9a-2ffbddc9335d None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:44.794662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60e84b-0158-4005-bf9a-2ffbddc9335d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:44.795206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60e84b-0158-4005-bf9a-2ffbddc9335d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:44.797537 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60e84b-0158-4005-bf9a-2ffbddc9335d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:44.803926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 443/881] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:45:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:44.809333 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60e84b-0158-4005-bf9a-2ffbddc9335d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:44.809821 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-604caf95-ca91-41ef-a836-5ad0b39b7d11 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:44.811151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-604caf95-ca91-41ef-a836-5ad0b39b7d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:44.891900 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 439/882] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:45:44.918977 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604caf95-ca91-41ef-a836-5ad0b39b7d11 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:44.945743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60e84b-0158-4005-bf9a-2ffbddc9335d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:44.960922 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:44.988012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:44.999393 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323d260-b784-443b-ad04-e803bd1a226c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:45.000033 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323d260-b784-443b-ad04-e803bd1a226c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:45.000316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323d260-b784-443b-ad04-e803bd1a226c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:45.000590 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323d260-b784-443b-ad04-e803bd1a226c None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:45.001316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323d260-b784-443b-ad04-e803bd1a226c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:45.001623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323d260-b784-443b-ad04-e803bd1a226c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:45.003086 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323d260-b784-443b-ad04-e803bd1a226c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:45.010782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 444/883] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:45:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:45.017617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323d260-b784-443b-ad04-e803bd1a226c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:45.052690 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604caf95-ca91-41ef-a836-5ad0b39b7d11 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:45.095713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ea551-dc5f-48c3-b362-531f48e610d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:45.096398 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ea551-dc5f-48c3-b362-531f48e610d7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:45.096683 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ea551-dc5f-48c3-b362-531f48e610d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:45.097047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ea551-dc5f-48c3-b362-531f48e610d7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:45.097938 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ea551-dc5f-48c3-b362-531f48e610d7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:45.100019 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ea551-dc5f-48c3-b362-531f48e610d7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:45.112404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-6f0ea551-dc5f-48c3-b362-531f48e610d7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:45:45.112404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:45.112404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:45.112404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:45.112404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:45.112404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:45.112404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:45.112404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:45.112404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:45:45.112404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:45.112404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:45.112404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:45.112404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:45.112404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:45.112404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:45.112404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:45.112404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:45.113630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:45.113630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:45.113630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:45.113630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:45.113630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:45.113630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:45.113630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:45.113630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:45.113630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:45.113630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:45.113630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:45.113630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:45.113630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:45.113630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:45.113630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:45.113630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:45.114726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:45.114726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:45.114726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:45.114726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:45.114726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:45.114726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:45.114726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:45.114726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:45.114726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:45.114726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:45.114726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:45.114726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:45.114726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:45:45.114726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:45.114726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 440/884] 10.222.0.75 () {56 vars in 1126 bytes} [Thu Jul 28 17:45:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:45.122051 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ea551-dc5f-48c3-b362-531f48e610d7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:45.138055 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323d260-b784-443b-ad04-e803bd1a226c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:45.185328 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c5384-deec-47b5-8783-0540d9289b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:45.185650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c5384-deec-47b5-8783-0540d9289b30 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:45.186031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c5384-deec-47b5-8783-0540d9289b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:45.186404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c5384-deec-47b5-8783-0540d9289b30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:45.187328 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c5384-deec-47b5-8783-0540d9289b30 None admin] RBAC: Adding query filter params (interface=public, service_id=722a11f5ea504865a7489fec1a74b7f7, region_id=RegionOne) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:45.187731 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c5384-deec-47b5-8783-0540d9289b30 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:45.189841 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c5384-deec-47b5-8783-0540d9289b30 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:45.198340 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 445/885] 10.222.0.75 () {56 vars in 1251 bytes} [Thu Jul 28 17:45:45 2022] GET /identity/v3/endpoints?service_id=722a11f5ea504865a7489fec1a74b7f7&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:45.205444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c5384-deec-47b5-8783-0540d9289b30 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:45.253312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:45.263507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ea551-dc5f-48c3-b362-531f48e610d7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:45.282266 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:45.301163 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79b6f2-98e4-4a59-830d-39347861e2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:45.301967 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79b6f2-98e4-4a59-830d-39347861e2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:45.302349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79b6f2-98e4-4a59-830d-39347861e2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:45.302727 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79b6f2-98e4-4a59-830d-39347861e2f8 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:45.303521 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79b6f2-98e4-4a59-830d-39347861e2f8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:45.304129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79b6f2-98e4-4a59-830d-39347861e2f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:45.305452 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79b6f2-98e4-4a59-830d-39347861e2f8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:45.315203 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 441/886] 10.222.0.75 () {56 vars in 1122 bytes} [Thu Jul 28 17:45:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:45.317113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79b6f2-98e4-4a59-830d-39347861e2f8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:45.328995 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c5384-deec-47b5-8783-0540d9289b30 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:45.370664 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f1c6c-d9f7-42dc-904c-3ec3389959de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:45.371512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f1c6c-d9f7-42dc-904c-3ec3389959de None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:45.371963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f1c6c-d9f7-42dc-904c-3ec3389959de None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:45.372273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f1c6c-d9f7-42dc-904c-3ec3389959de None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:45.373090 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f1c6c-d9f7-42dc-904c-3ec3389959de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:45.374689 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f1c6c-d9f7-42dc-904c-3ec3389959de None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:45.384123 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 446/887] 10.222.0.75 () {56 vars in 1087 bytes} [Thu Jul 28 17:45:45 2022] GET /identity/v3/services => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:45:45.451668 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79b6f2-98e4-4a59-830d-39347861e2f8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:45.491310 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260700b-5d86-4555-961a-c5ba751a330e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:45.491948 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260700b-5d86-4555-961a-c5ba751a330e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:45.492302 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260700b-5d86-4555-961a-c5ba751a330e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:45.492585 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260700b-5d86-4555-961a-c5ba751a330e None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:45.493315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260700b-5d86-4555-961a-c5ba751a330e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:45.493620 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260700b-5d86-4555-961a-c5ba751a330e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:45.495002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260700b-5d86-4555-961a-c5ba751a330e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:45.500710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 442/888] 10.222.0.75 () {56 vars in 1122 bytes} [Thu Jul 28 17:45:45 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:46.181332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d7b78-99a8-45b0-8e73-87395a9773c0 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:46.181860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d7b78-99a8-45b0-8e73-87395a9773c0 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:46.182258 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d7b78-99a8-45b0-8e73-87395a9773c0 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:46.183985 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 447/889] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:46.190031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfca75-2a7e-425b-9bbb-a38049a2769d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:46.190519 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfca75-2a7e-425b-9bbb-a38049a2769d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:46.190604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfca75-2a7e-425b-9bbb-a38049a2769d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:46.209463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-cadfca75-2a7e-425b-9bbb-a38049a2769d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:46.210667 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cadfca75-2a7e-425b-9bbb-a38049a2769d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:46.253666 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:46.281586 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 443/890] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:46.304417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d7b78-99a8-45b0-8e73-87395a9773c0 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:46.424888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d7b78-99a8-45b0-8e73-87395a9773c0 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:46.426450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:46.459215 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bb699-c907-45ac-8158-7e5819345fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:46.459853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bb699-c907-45ac-8158-7e5819345fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:46.460143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bb699-c907-45ac-8158-7e5819345fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:46.460414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bb699-c907-45ac-8158-7e5819345fe2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:46.461114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bb699-c907-45ac-8158-7e5819345fe2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:46.462570 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bb699-c907-45ac-8158-7e5819345fe2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:46.472585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-959bb699-c907-45ac-8158-7e5819345fe2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:45:46.472585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:46.472585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:46.472585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:46.472585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:46.472585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:46.472585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:46.472585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:46.472585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:45:46.472585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:46.472585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:46.472585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:46.472585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:46.472585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:46.472585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:46.472585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:46.473614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:46.473614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:46.473614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:46.473614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:46.473614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:46.473614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:46.473614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:46.473614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:46.473614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:46.473614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:46.473614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:46.473614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:46.473614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:46.473614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:46.473614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:46.473614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:46.474529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:46.474529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:46.474529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:46.474529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:46.474529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:46.474529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:46.474529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:46.474529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:46.474529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:46.474529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:46.474529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:46.474529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:46.474529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:46.474529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:45:46.474529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:46.475370 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 448/891] 10.222.0.75 () {56 vars in 1132 bytes} [Thu Jul 28 17:45:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:46.481735 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfca75-2a7e-425b-9bbb-a38049a2769d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:46.589070 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfca75-2a7e-425b-9bbb-a38049a2769d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:46.626540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4133d-480c-45b0-93ec-a269f321bc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:46.627545 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4133d-480c-45b0-93ec-a269f321bc25 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:46.628044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4133d-480c-45b0-93ec-a269f321bc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:46.628531 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4133d-480c-45b0-93ec-a269f321bc25 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:46.629475 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4133d-480c-45b0-93ec-a269f321bc25 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:46.630000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4133d-480c-45b0-93ec-a269f321bc25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:46.631636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4133d-480c-45b0-93ec-a269f321bc25 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:46.639464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 444/892] 10.222.0.75 () {56 vars in 1126 bytes} [Thu Jul 28 17:45:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:46.649907 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bb699-c907-45ac-8158-7e5819345fe2 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:46.752236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bb699-c907-45ac-8158-7e5819345fe2 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:46.787239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388beb5d-5f0b-4a85-9e8a-7a74246d80fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:46.787910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388beb5d-5f0b-4a85-9e8a-7a74246d80fa None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:46.788219 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388beb5d-5f0b-4a85-9e8a-7a74246d80fa None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:46.788490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388beb5d-5f0b-4a85-9e8a-7a74246d80fa None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:46.789207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388beb5d-5f0b-4a85-9e8a-7a74246d80fa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:46.789514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388beb5d-5f0b-4a85-9e8a-7a74246d80fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:46.790899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388beb5d-5f0b-4a85-9e8a-7a74246d80fa None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:46.796208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 449/893] 10.222.0.75 () {56 vars in 1126 bytes} [Thu Jul 28 17:45:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:46.802000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4133d-480c-45b0-93ec-a269f321bc25 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:46.844648 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:46.908013 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4133d-480c-45b0-93ec-a269f321bc25 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:46.945759 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e511650-31e1-4f77-8202-949bc22a9b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:46.946768 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e511650-31e1-4f77-8202-949bc22a9b93 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:46.947271 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e511650-31e1-4f77-8202-949bc22a9b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:46.947745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e511650-31e1-4f77-8202-949bc22a9b93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:46.948713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e511650-31e1-4f77-8202-949bc22a9b93 None admin] RBAC: Adding query filter params (interface=public, service_id=f8dd5daa7d2e418f8742d13c0fc65180, region_id=RegionOne) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:46.949291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e511650-31e1-4f77-8202-949bc22a9b93 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:46.950858 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e511650-31e1-4f77-8202-949bc22a9b93 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:46.956772 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 445/894] 10.222.0.75 () {56 vars in 1251 bytes} [Thu Jul 28 17:45:46 2022] GET /identity/v3/endpoints?service_id=f8dd5daa7d2e418f8742d13c0fc65180&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:46.962687 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388beb5d-5f0b-4a85-9e8a-7a74246d80fa None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:46.997599 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:47.026179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bae1a-48cb-4ec9-9e3c-6032af5f2abf None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:47.026495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bae1a-48cb-4ec9-9e3c-6032af5f2abf None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:47.026674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bae1a-48cb-4ec9-9e3c-6032af5f2abf None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:47.028184 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 446/895] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:45:47.035280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9134b2e-239e-4435-b18d-a98d8e838497 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:47.035569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9134b2e-239e-4435-b18d-a98d8e838497 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:47.035848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9134b2e-239e-4435-b18d-a98d8e838497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:47.056632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f9134b2e-239e-4435-b18d-a98d8e838497 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:47.057886 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f9134b2e-239e-4435-b18d-a98d8e838497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:47.079332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388beb5d-5f0b-4a85-9e8a-7a74246d80fa None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:47.116036 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d93226-9ae0-4eac-9c45-48dfbbc62448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:47.117110 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d93226-9ae0-4eac-9c45-48dfbbc62448 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:47.117620 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d93226-9ae0-4eac-9c45-48dfbbc62448 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:47.118103 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d93226-9ae0-4eac-9c45-48dfbbc62448 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:47.118966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d93226-9ae0-4eac-9c45-48dfbbc62448 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:47.120564 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d93226-9ae0-4eac-9c45-48dfbbc62448 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:47.127211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 450/896] 10.222.0.75 () {56 vars in 1087 bytes} [Thu Jul 28 17:45:46 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:45:47.142903 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 447/897] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:47.168057 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d93226-9ae0-4eac-9c45-48dfbbc62448 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:47.278107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:47.286363 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d93226-9ae0-4eac-9c45-48dfbbc62448 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:47.324040 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40aaec-6f4c-4bd5-8123-d94c3f5f6d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:47.324670 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40aaec-6f4c-4bd5-8123-d94c3f5f6d05 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:47.325014 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40aaec-6f4c-4bd5-8123-d94c3f5f6d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:47.325248 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40aaec-6f4c-4bd5-8123-d94c3f5f6d05 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:47.337384 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40aaec-6f4c-4bd5-8123-d94c3f5f6d05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:47.342831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-4a40aaec-6f4c-4bd5-8123-d94c3f5f6d05 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:45:47.342831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:47.342831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:47.342831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:47.342831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:47.342831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:47.342831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:47.342831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:47.342831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:47.342831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:47.342831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:47.342831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:47.342831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:47.342831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:47.342831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:47.342831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:47.344334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:47.344334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:47.344334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:47.344334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:47.344334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:47.344334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:47.344334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:47.344334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:47.344334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:47.344334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:47.344334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:47.344334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:47.344334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:47.344334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:47.344334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:47.344334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:47.345214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:47.345214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:47.345214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:47.345214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:47.345214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:47.345214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:47.345214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:47.345214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:47.345214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:47.345214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:47.345214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:45:47.345214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:47.345214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 451/898] 10.222.0.75 () {56 vars in 1120 bytes} [Thu Jul 28 17:45:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:47.350783 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9134b2e-239e-4435-b18d-a98d8e838497 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:47.393596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:47.467882 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9134b2e-239e-4435-b18d-a98d8e838497 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:47.504574 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66381aa8-bfe9-4859-95f0-832758ad4df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:47.505231 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66381aa8-bfe9-4859-95f0-832758ad4df1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:47.505513 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66381aa8-bfe9-4859-95f0-832758ad4df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:47.505785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66381aa8-bfe9-4859-95f0-832758ad4df1 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:47.506601 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66381aa8-bfe9-4859-95f0-832758ad4df1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:47.506907 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66381aa8-bfe9-4859-95f0-832758ad4df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:47.508354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66381aa8-bfe9-4859-95f0-832758ad4df1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:47.517651 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 448/899] 10.222.0.75 () {56 vars in 1115 bytes} [Thu Jul 28 17:45:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:47.523566 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40aaec-6f4c-4bd5-8123-d94c3f5f6d05 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:47.526341 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a643550-b810-407c-b864-ff16fd2b764b None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:47.526627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a643550-b810-407c-b864-ff16fd2b764b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:47.526903 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a643550-b810-407c-b864-ff16fd2b764b None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:47.528288 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 449/900] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:45:47.534068 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68ab78-3c4a-45dd-9708-318392b13ade None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:47.534295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68ab78-3c4a-45dd-9708-318392b13ade None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:47.534548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68ab78-3c4a-45dd-9708-318392b13ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:47.553339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4d68ab78-3c4a-45dd-9708-318392b13ade None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:47.554527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4d68ab78-3c4a-45dd-9708-318392b13ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:47.639556 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40aaec-6f4c-4bd5-8123-d94c3f5f6d05 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:47.644806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 450/901] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:45:47.664225 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337e755-4de7-4c9c-925a-0355a4ca842a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:47.664651 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337e755-4de7-4c9c-925a-0355a4ca842a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:47.665025 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337e755-4de7-4c9c-925a-0355a4ca842a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:47.666763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 451/902] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:45:47.667710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337e755-4de7-4c9c-925a-0355a4ca842a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:47.685977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a584d75-b840-4880-8003-44b8d1ddb16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:47.686630 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a584d75-b840-4880-8003-44b8d1ddb16e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:47.687471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a584d75-b840-4880-8003-44b8d1ddb16e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:47.687756 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a584d75-b840-4880-8003-44b8d1ddb16e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:47.697953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:47.698486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a584d75-b840-4880-8003-44b8d1ddb16e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:47.699955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a584d75-b840-4880-8003-44b8d1ddb16e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:47.714522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-1a584d75-b840-4880-8003-44b8d1ddb16e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:47.714522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:47.714522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:47.714522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:47.714522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:47.714522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:47.714522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:47.714522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:47.714522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:47.714522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:47.714522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:47.714522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:47.714522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:47.714522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:47.714522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:47.715495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:47.715495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:47.715495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:47.715495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:47.715495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:47.715495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:47.715495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:47.715495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:47.715495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:47.715495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:47.715495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:47.715495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:47.715495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:47.715495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:47.715495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:47.715495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:47.715495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:47.716428 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:47.716428 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:47.716428 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:47.716428 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:47.716428 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 452/903] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:47.717672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7e973-f409-492e-a6bb-237a1147bea8 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:47.717672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7e973-f409-492e-a6bb-237a1147bea8 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:47.717865 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7e973-f409-492e-a6bb-237a1147bea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:47.730761 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:47.736701 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-8dd7e973-f409-492e-a6bb-237a1147bea8 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:47.738001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8dd7e973-f409-492e-a6bb-237a1147bea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:47.784849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337e755-4de7-4c9c-925a-0355a4ca842a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:47.808768 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 453/904] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:47.809586 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7e973-f409-492e-a6bb-237a1147bea8 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:47.819887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85d49d-f4d7-4ad0-8310-08eb0b449dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:47.820537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85d49d-f4d7-4ad0-8310-08eb0b449dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:47.820845 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85d49d-f4d7-4ad0-8310-08eb0b449dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:47.821119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85d49d-f4d7-4ad0-8310-08eb0b449dd6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:47.821753 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85d49d-f4d7-4ad0-8310-08eb0b449dd6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:47.823294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85d49d-f4d7-4ad0-8310-08eb0b449dd6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:47.833449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-1c85d49d-f4d7-4ad0-8310-08eb0b449dd6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:45:47.833449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:47.833449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:47.833449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:47.833449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:47.833449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:47.833449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:47.833449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:47.833449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:45:47.833449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:47.833449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:47.833449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:47.833449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:47.833449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:47.833449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:47.833449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:47.833449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:47.834665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:47.834665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:47.834665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:47.834665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:47.834665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:47.834665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:47.834665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:47.834665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:47.834665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:47.834665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:47.834665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:47.834665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:47.834665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:47.834665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:47.834665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:47.834665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:47.837327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:47.837327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:47.837327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:47.837327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:47.837327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:47.837327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:47.837327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:47.837327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:47.837327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:47.837327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:47.837327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:47.837327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:47.837327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:45:47.837327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:47.837327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 452/905] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:45:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:47.838122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85d49d-f4d7-4ad0-8310-08eb0b449dd6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:47.925971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7e973-f409-492e-a6bb-237a1147bea8 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:47.933311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:47.945056 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85d49d-f4d7-4ad0-8310-08eb0b449dd6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:47.964838 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6b8a1-75c8-4e4b-a7bb-3c7701b9e481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:47.965528 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6b8a1-75c8-4e4b-a7bb-3c7701b9e481 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:47.965803 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6b8a1-75c8-4e4b-a7bb-3c7701b9e481 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:47.966154 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6b8a1-75c8-4e4b-a7bb-3c7701b9e481 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:47.966852 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6b8a1-75c8-4e4b-a7bb-3c7701b9e481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:47.967157 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6b8a1-75c8-4e4b-a7bb-3c7701b9e481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:47.969107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6b8a1-75c8-4e4b-a7bb-3c7701b9e481 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:47.971500 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:47.980830 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 454/906] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:47.981705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6b8a1-75c8-4e4b-a7bb-3c7701b9e481 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:47.987983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd23d8a-c41d-4444-9b42-f6ff16a6d104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:47.988881 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd23d8a-c41d-4444-9b42-f6ff16a6d104 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:47.989164 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd23d8a-c41d-4444-9b42-f6ff16a6d104 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:47.989438 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd23d8a-c41d-4444-9b42-f6ff16a6d104 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:47.990196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd23d8a-c41d-4444-9b42-f6ff16a6d104 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:47.991683 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd23d8a-c41d-4444-9b42-f6ff16a6d104 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:48.084042 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 453/907] 10.222.0.75 () {60 vars in 1141 bytes} [Thu Jul 28 17:45:47 2022] POST /identity/v3/services => generated 241 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:45:48.084399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6b8a1-75c8-4e4b-a7bb-3c7701b9e481 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:48.084896 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd23d8a-c41d-4444-9b42-f6ff16a6d104 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:48.140933 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2824fd-5def-45f7-928c-df70b7f70bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:48.142175 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2824fd-5def-45f7-928c-df70b7f70bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:48.142707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2824fd-5def-45f7-928c-df70b7f70bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:48.143283 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2824fd-5def-45f7-928c-df70b7f70bc6 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:48.144287 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2824fd-5def-45f7-928c-df70b7f70bc6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:48.144860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2824fd-5def-45f7-928c-df70b7f70bc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:48.146788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2824fd-5def-45f7-928c-df70b7f70bc6 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:48.158322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 455/908] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:45:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:48.160477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2824fd-5def-45f7-928c-df70b7f70bc6 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:48.206640 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd23d8a-c41d-4444-9b42-f6ff16a6d104 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:48.239550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:48.247075 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba050f-ad0e-42b5-8751-688bff4dfebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:48.247712 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba050f-ad0e-42b5-8751-688bff4dfebf None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:48.247996 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba050f-ad0e-42b5-8751-688bff4dfebf None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:48.253580 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba050f-ad0e-42b5-8751-688bff4dfebf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:48.257060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba050f-ad0e-42b5-8751-688bff4dfebf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:48.258526 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba050f-ad0e-42b5-8751-688bff4dfebf None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:48.271321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-03ba050f-ad0e-42b5-8751-688bff4dfebf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:45:48.271321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:48.271321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:48.271321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:48.271321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:48.271321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:48.271321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:48.271321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:48.271321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:48.271321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:48.271321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:48.271321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:48.271321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:48.271321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:48.271321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:48.271321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:48.272319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:48.272319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:48.272319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:48.272319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:48.272319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:48.272319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:48.272319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:48.272319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:48.272319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:48.272319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:48.272319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:48.272319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:48.272319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:48.272319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:48.272319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:48.272319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:48.272319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:48.272319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:48.273593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:48.273593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:48.273593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:48.273593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:48.273593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:48.273593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:48.273593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:48.273593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:48.273593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:45:48.273593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:48.273593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 454/909] 10.222.0.75 () {56 vars in 1117 bytes} [Thu Jul 28 17:45:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:48.278656 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba050f-ad0e-42b5-8751-688bff4dfebf None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:48.291751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:48.299085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2824fd-5def-45f7-928c-df70b7f70bc6 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:48.352423 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90792419-e800-4bc7-bb7d-5de5a9f3b59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:48.353088 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90792419-e800-4bc7-bb7d-5de5a9f3b59b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:48.353363 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90792419-e800-4bc7-bb7d-5de5a9f3b59b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:48.353631 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90792419-e800-4bc7-bb7d-5de5a9f3b59b None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:48.354315 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90792419-e800-4bc7-bb7d-5de5a9f3b59b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:48.354616 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90792419-e800-4bc7-bb7d-5de5a9f3b59b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:48.355991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90792419-e800-4bc7-bb7d-5de5a9f3b59b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:48.361740 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 456/910] 10.222.0.75 () {56 vars in 1114 bytes} [Thu Jul 28 17:45:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:48.367254 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90792419-e800-4bc7-bb7d-5de5a9f3b59b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:48.401540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba050f-ad0e-42b5-8751-688bff4dfebf None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:48.438660 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09fa98-a9c3-4dcf-a82d-6a81769ba45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:48.439713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09fa98-a9c3-4dcf-a82d-6a81769ba45c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:48.440196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09fa98-a9c3-4dcf-a82d-6a81769ba45c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:48.440683 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09fa98-a9c3-4dcf-a82d-6a81769ba45c None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:48.441994 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09fa98-a9c3-4dcf-a82d-6a81769ba45c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:48.442507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09fa98-a9c3-4dcf-a82d-6a81769ba45c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:48.444187 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09fa98-a9c3-4dcf-a82d-6a81769ba45c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:48.469625 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 455/911] 10.222.0.75 () {56 vars in 1149 bytes} [Thu Jul 28 17:45:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:48.471058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09fa98-a9c3-4dcf-a82d-6a81769ba45c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:48.508501 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90792419-e800-4bc7-bb7d-5de5a9f3b59b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:48.532372 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:48.547806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883123c-7f8b-4977-85d3-f9c84a872467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:48.548438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883123c-7f8b-4977-85d3-f9c84a872467 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:48.548718 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883123c-7f8b-4977-85d3-f9c84a872467 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:48.549035 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883123c-7f8b-4977-85d3-f9c84a872467 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:48.549750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883123c-7f8b-4977-85d3-f9c84a872467 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:48.551132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883123c-7f8b-4977-85d3-f9c84a872467 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:48.557177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:48.580295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09fa98-a9c3-4dcf-a82d-6a81769ba45c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:48.614158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8459a-a8fc-4039-bc78-1e5548e4dbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:48.614707 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8459a-a8fc-4039-bc78-1e5548e4dbae None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:48.614990 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8459a-a8fc-4039-bc78-1e5548e4dbae None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:48.615266 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8459a-a8fc-4039-bc78-1e5548e4dbae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:48.690319 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 457/912] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 17:45:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:45:48.691751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8459a-a8fc-4039-bc78-1e5548e4dbae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:48.696871 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8459a-a8fc-4039-bc78-1e5548e4dbae None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:48.774240 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:48.816549 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 456/913] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:48 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 17:45:48.826026 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883123c-7f8b-4977-85d3-f9c84a872467 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:48.952144 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883123c-7f8b-4977-85d3-f9c84a872467 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:48.988315 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75ea8e-ccb9-4796-b5eb-9e0dac97160e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:48.989005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75ea8e-ccb9-4796-b5eb-9e0dac97160e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:48.989292 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75ea8e-ccb9-4796-b5eb-9e0dac97160e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:48.989572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75ea8e-ccb9-4796-b5eb-9e0dac97160e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:49.001430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75ea8e-ccb9-4796-b5eb-9e0dac97160e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:49.002914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75ea8e-ccb9-4796-b5eb-9e0dac97160e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:49.017913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-4f75ea8e-ccb9-4796-b5eb-9e0dac97160e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:49.017913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:49.017913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:49.017913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:49.017913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:49.017913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:49.017913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:49.017913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:49.017913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:49.017913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:49.017913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:49.017913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:49.017913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:49.017913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:49.017913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:49.018816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:49.018816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:49.018816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:49.018816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:49.018816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:49.018816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:49.018816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:49.018816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:49.018816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:49.018816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:49.018816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:49.018816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:49.018816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:49.018816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:49.018816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:49.018816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:49.018816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:49.019693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:49.019693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:49.019693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:49.019693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:49.019693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 458/914] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:49.025071 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8459a-a8fc-4039-bc78-1e5548e4dbae None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:49.127674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8459a-a8fc-4039-bc78-1e5548e4dbae None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:49.163101 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3de7a9-34ee-4c93-9144-04cd0cc5444f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:49.164108 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3de7a9-34ee-4c93-9144-04cd0cc5444f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:49.164604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3de7a9-34ee-4c93-9144-04cd0cc5444f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:49.165117 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3de7a9-34ee-4c93-9144-04cd0cc5444f None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:49.166032 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3de7a9-34ee-4c93-9144-04cd0cc5444f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:49.166554 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3de7a9-34ee-4c93-9144-04cd0cc5444f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:49.168141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3de7a9-34ee-4c93-9144-04cd0cc5444f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:49.181237 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 457/915] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:49.192856 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75ea8e-ccb9-4796-b5eb-9e0dac97160e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:49.214583 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:49.294544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75ea8e-ccb9-4796-b5eb-9e0dac97160e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:49.325320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbe1ff-6c33-489c-a294-c0febc188f8f None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:49.325971 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbe1ff-6c33-489c-a294-c0febc188f8f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:49.326449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbe1ff-6c33-489c-a294-c0febc188f8f None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:49.328301 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 458/916] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:49.333350 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3994b2f-7fe8-458a-8084-0ebfdb6216d4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:49.333863 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3994b2f-7fe8-458a-8084-0ebfdb6216d4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:49.334367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3994b2f-7fe8-458a-8084-0ebfdb6216d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:49.335744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783ef9b-ad22-45dc-91ce-74cc590f8d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:49.336401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783ef9b-ad22-45dc-91ce-74cc590f8d52 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:49.336684 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783ef9b-ad22-45dc-91ce-74cc590f8d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:49.336995 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783ef9b-ad22-45dc-91ce-74cc590f8d52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:49.345014 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783ef9b-ad22-45dc-91ce-74cc590f8d52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:49.346498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783ef9b-ad22-45dc-91ce-74cc590f8d52 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:49.355410 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b3994b2f-7fe8-458a-8084-0ebfdb6216d4 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:49.356990 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b3994b2f-7fe8-458a-8084-0ebfdb6216d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:49.358534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-0783ef9b-ad22-45dc-91ce-74cc590f8d52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:49.358534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:49.358534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:49.358534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:49.358534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:49.358534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:49.358534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:49.358534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:49.358534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:49.358534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:49.358534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:49.358534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:49.358534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:49.358534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:49.358534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:49.360249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:49.360249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:49.360249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:49.360249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:49.360249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:49.360249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:49.360249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:49.360249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:49.360249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:49.360249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:49.360249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:49.360249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:49.360249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:49.360249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:49.360249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:49.360249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:49.360249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:49.361206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:49.361206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:49.361206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:49.361206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:49.361206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:49.361206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:49.361206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:49.361206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:49.361206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 459/917] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:49.369882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783ef9b-ad22-45dc-91ce-74cc590f8d52 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:49.384023 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:49.441969 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 459/918] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:45:49.459781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3994b2f-7fe8-458a-8084-0ebfdb6216d4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:49.479445 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:49.501140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783ef9b-ad22-45dc-91ce-74cc590f8d52 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:49.541816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8068e-3925-4c24-a8c5-6bfd7eb839bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:49.542548 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8068e-3925-4c24-a8c5-6bfd7eb839bc None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:49.543538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8068e-3925-4c24-a8c5-6bfd7eb839bc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:49.543955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8068e-3925-4c24-a8c5-6bfd7eb839bc None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:49.544972 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8068e-3925-4c24-a8c5-6bfd7eb839bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:49.545459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8068e-3925-4c24-a8c5-6bfd7eb839bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:49.548240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8068e-3925-4c24-a8c5-6bfd7eb839bc None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:49.568824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 460/919] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:49.571307 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8068e-3925-4c24-a8c5-6bfd7eb839bc None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:49.585001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3994b2f-7fe8-458a-8084-0ebfdb6216d4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:49.634193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b11d3-6b3a-4374-aae1-772bfd64df6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:49.635133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b11d3-6b3a-4374-aae1-772bfd64df6a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:49.635415 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b11d3-6b3a-4374-aae1-772bfd64df6a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:49.636204 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b11d3-6b3a-4374-aae1-772bfd64df6a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:49.637078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b11d3-6b3a-4374-aae1-772bfd64df6a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:49.638998 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b11d3-6b3a-4374-aae1-772bfd64df6a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:49.652600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-c31b11d3-6b3a-4374-aae1-772bfd64df6a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:45:49.652600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:49.652600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:49.652600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:49.652600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:49.652600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:49.652600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:49.652600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:49.652600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:45:49.652600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:49.652600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:49.652600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:49.652600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:49.652600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:49.652600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:49.652600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:49.653815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:49.653815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:49.653815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:49.653815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:49.653815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:49.653815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:49.653815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:49.653815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:49.653815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:49.653815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:49.653815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:49.653815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:49.653815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:49.653815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:49.653815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:49.653815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:49.654853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:49.654853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:49.654853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:49.654853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:49.654853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:49.654853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:49.654853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:49.654853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:49.654853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:49.654853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:49.654853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:49.654853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:49.654853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:49.654853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:45:49.654853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:49.658907 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 460/920] 10.222.0.75 () {56 vars in 1132 bytes} [Thu Jul 28 17:45:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:49.659963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b11d3-6b3a-4374-aae1-772bfd64df6a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:49.692114 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:49.711046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8068e-3925-4c24-a8c5-6bfd7eb839bc None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:49.757032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebde31-a9d2-4f12-9c79-2e01e4a59889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:49.757686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebde31-a9d2-4f12-9c79-2e01e4a59889 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:49.757977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebde31-a9d2-4f12-9c79-2e01e4a59889 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:49.758254 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebde31-a9d2-4f12-9c79-2e01e4a59889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:49.759108 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebde31-a9d2-4f12-9c79-2e01e4a59889 None admin] RBAC: Adding query filter params (role.id=4a747c3694f44616b8ca0dae0fea435f, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=1cbbfdda843a4ab98ff9cf0742513f44) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:49.759424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebde31-a9d2-4f12-9c79-2e01e4a59889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:49.760903 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebde31-a9d2-4f12-9c79-2e01e4a59889 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:49.769681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 461/921] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:49 2022] GET /identity/v3/role_assignments?user.id=1cbbfdda843a4ab98ff9cf0742513f44&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=4a747c3694f44616b8ca0dae0fea435f => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:49.798242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b11d3-6b3a-4374-aae1-772bfd64df6a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:49.838641 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ada3e5-70f9-4130-85ab-e85d6aa57e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:49.839581 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ada3e5-70f9-4130-85ab-e85d6aa57e94 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:49.840012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ada3e5-70f9-4130-85ab-e85d6aa57e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:49.840446 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ada3e5-70f9-4130-85ab-e85d6aa57e94 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:49.841339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ada3e5-70f9-4130-85ab-e85d6aa57e94 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:49.841815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ada3e5-70f9-4130-85ab-e85d6aa57e94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:49.843422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ada3e5-70f9-4130-85ab-e85d6aa57e94 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:49.849746 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 461/922] 10.222.0.75 () {56 vars in 1126 bytes} [Thu Jul 28 17:45:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:49.855858 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebde31-a9d2-4f12-9c79-2e01e4a59889 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:49.882423 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:49.972166 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebde31-a9d2-4f12-9c79-2e01e4a59889 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:50.008256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060840e-351e-49c1-9747-027badf95a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:50.008896 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060840e-351e-49c1-9747-027badf95a92 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:50.009181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060840e-351e-49c1-9747-027badf95a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:50.009458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060840e-351e-49c1-9747-027badf95a92 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:50.010142 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060840e-351e-49c1-9747-027badf95a92 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:50.010449 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060840e-351e-49c1-9747-027badf95a92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:50.011836 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060840e-351e-49c1-9747-027badf95a92 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:50.017186 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 462/923] 10.222.0.75 () {56 vars in 1126 bytes} [Thu Jul 28 17:45:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:50.023201 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ada3e5-70f9-4130-85ab-e85d6aa57e94 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:50.117896 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:50.129521 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ada3e5-70f9-4130-85ab-e85d6aa57e94 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:50.165309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04d6c6-8c0c-446f-a5e2-141e986f3871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:50.165936 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04d6c6-8c0c-446f-a5e2-141e986f3871 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:50.166217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04d6c6-8c0c-446f-a5e2-141e986f3871 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:50.166492 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04d6c6-8c0c-446f-a5e2-141e986f3871 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:50.167222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04d6c6-8c0c-446f-a5e2-141e986f3871 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:50.168589 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04d6c6-8c0c-446f-a5e2-141e986f3871 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:50.261327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 462/924] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 17:45:50 2022] POST /identity/v3/endpoints => generated 347 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:45:50.278815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237964ea-cf2e-484b-a881-a6709832083f None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:50.279180 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237964ea-cf2e-484b-a881-a6709832083f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:50.279360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237964ea-cf2e-484b-a881-a6709832083f None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:50.281700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 463/925] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:50.287604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29420d-228b-4060-8182-b07b7dcb07a0 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:50.287911 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29420d-228b-4060-8182-b07b7dcb07a0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:50.288171 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29420d-228b-4060-8182-b07b7dcb07a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:50.310770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-de29420d-228b-4060-8182-b07b7dcb07a0 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:50.312036 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-de29420d-228b-4060-8182-b07b7dcb07a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:50.395461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 463/926] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:50.419539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237964ea-cf2e-484b-a881-a6709832083f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:50.497603 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:50.536264 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237964ea-cf2e-484b-a881-a6709832083f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:50.571960 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e40a6a-5d85-4053-89d8-5949e991a622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:50.572616 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e40a6a-5d85-4053-89d8-5949e991a622 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:50.572932 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e40a6a-5d85-4053-89d8-5949e991a622 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:50.573214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e40a6a-5d85-4053-89d8-5949e991a622 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:50.573908 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e40a6a-5d85-4053-89d8-5949e991a622 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:50.575348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e40a6a-5d85-4053-89d8-5949e991a622 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:50.585911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-58e40a6a-5d85-4053-89d8-5949e991a622 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:45:50.585911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:50.585911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:50.585911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:50.585911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:50.585911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:50.585911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:50.585911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:50.585911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:45:50.585911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:50.585911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:50.585911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:50.585911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:50.585911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:50.585911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:50.585911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:50.585911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:50.586944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:50.586944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:50.586944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:50.586944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:50.586944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:50.586944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:50.586944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:50.586944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:50.586944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:50.586944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:50.586944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:50.586944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:50.586944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:50.586944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:50.586944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:50.586944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:50.588782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:50.588782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:50.588782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:50.588782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:50.588782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:50.588782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:50.588782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:50.588782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:50.588782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:50.588782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:50.588782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:50.588782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:50.588782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:45:50.588782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:50.588782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 464/927] 10.222.0.75 () {56 vars in 1126 bytes} [Thu Jul 28 17:45:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:50.594115 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29420d-228b-4060-8182-b07b7dcb07a0 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:50.672247 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:50.711853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29420d-228b-4060-8182-b07b7dcb07a0 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:50.747160 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523aa65-ad67-4c8a-9b7b-8ab96d0c0ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:50.747911 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523aa65-ad67-4c8a-9b7b-8ab96d0c0ada None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:50.748198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523aa65-ad67-4c8a-9b7b-8ab96d0c0ada None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:50.748473 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523aa65-ad67-4c8a-9b7b-8ab96d0c0ada None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:50.749220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523aa65-ad67-4c8a-9b7b-8ab96d0c0ada None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:50.749529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523aa65-ad67-4c8a-9b7b-8ab96d0c0ada None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:50.750906 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523aa65-ad67-4c8a-9b7b-8ab96d0c0ada None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:50.756789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 464/928] 10.222.0.75 () {56 vars in 1122 bytes} [Thu Jul 28 17:45:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:50.762597 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e40a6a-5d85-4053-89d8-5949e991a622 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:50.871906 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e40a6a-5d85-4053-89d8-5949e991a622 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:50.877981 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2d081-47de-4960-a5b7-3fa8b5f60a88 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:50.878522 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2d081-47de-4960-a5b7-3fa8b5f60a88 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:50.879008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2d081-47de-4960-a5b7-3fa8b5f60a88 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:50.884422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 465/929] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:50.886336 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447eede-aa21-49a3-8047-c0f5a119976a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:50.886825 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447eede-aa21-49a3-8047-c0f5a119976a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:50.887316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447eede-aa21-49a3-8047-c0f5a119976a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:50.908907 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ec9ea-40a6-43fc-90ef-f469a758866e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:50.909981 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ec9ea-40a6-43fc-90ef-f469a758866e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:50.910292 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-5447eede-aa21-49a3-8047-c0f5a119976a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:50.910669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ec9ea-40a6-43fc-90ef-f469a758866e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:50.911150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ec9ea-40a6-43fc-90ef-f469a758866e None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:50.911596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5447eede-aa21-49a3-8047-c0f5a119976a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:50.912300 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ec9ea-40a6-43fc-90ef-f469a758866e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:50.912962 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ec9ea-40a6-43fc-90ef-f469a758866e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:50.914635 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ec9ea-40a6-43fc-90ef-f469a758866e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:50.917296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:50.921174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 465/930] 10.222.0.75 () {56 vars in 1122 bytes} [Thu Jul 28 17:45:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:50.927544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ec9ea-40a6-43fc-90ef-f469a758866e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:51.008776 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 466/931] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:45:51.026016 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447eede-aa21-49a3-8047-c0f5a119976a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:51.045167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ec9ea-40a6-43fc-90ef-f469a758866e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:51.090392 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30070695-0e05-4b0a-ae13-1ccec8e30938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:51.091026 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30070695-0e05-4b0a-ae13-1ccec8e30938 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:51.091304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30070695-0e05-4b0a-ae13-1ccec8e30938 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:51.091828 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30070695-0e05-4b0a-ae13-1ccec8e30938 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:51.093033 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30070695-0e05-4b0a-ae13-1ccec8e30938 None admin] RBAC: Adding query filter params (interface=public, service_id=95fca7f7293e4206950a75864ac23413, region_id=RegionOne) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:51.093348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30070695-0e05-4b0a-ae13-1ccec8e30938 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:51.094736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30070695-0e05-4b0a-ae13-1ccec8e30938 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:51.102297 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 466/932] 10.222.0.75 () {56 vars in 1251 bytes} [Thu Jul 28 17:45:50 2022] GET /identity/v3/endpoints?service_id=95fca7f7293e4206950a75864ac23413&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:51.105781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:51.108197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30070695-0e05-4b0a-ae13-1ccec8e30938 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:51.150336 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447eede-aa21-49a3-8047-c0f5a119976a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:51.176592 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:51.188131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28d827-24ae-4e78-a077-d87bdb890678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:51.188773 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28d827-24ae-4e78-a077-d87bdb890678 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:51.189056 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28d827-24ae-4e78-a077-d87bdb890678 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:51.189327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28d827-24ae-4e78-a077-d87bdb890678 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:51.190012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28d827-24ae-4e78-a077-d87bdb890678 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:51.191627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28d827-24ae-4e78-a077-d87bdb890678 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:51.194329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: WARNING keystone.server.flask.common [None req-8d28d827-24ae-4e78-a077-d87bdb890678 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 17:45:51.218272 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30070695-0e05-4b0a-ae13-1ccec8e30938 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:51.251820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.sql.core [None req-8d28d827-24ae-4e78-a077-d87bdb890678 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 17:45:51.251820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 17:45:51.251820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [parameters: {'id': '753965d8fd1a4ae7ba6f85042e9bb567', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 17:45:51.251820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80420) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 17:45:51.254956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591c013-4204-4fbf-ae40-ddad2002e292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:51.255711 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591c013-4204-4fbf-ae40-ddad2002e292 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:51.256069 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591c013-4204-4fbf-ae40-ddad2002e292 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:51.256416 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591c013-4204-4fbf-ae40-ddad2002e292 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:51.257176 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591c013-4204-4fbf-ae40-ddad2002e292 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:51.258782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591c013-4204-4fbf-ae40-ddad2002e292 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:51.263528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-8d28d827-24ae-4e78-a077-d87bdb890678 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 753965d8fd1a4ae7ba6f85042e9bb567.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 753965d8fd1a4ae7ba6f85042e9bb567. Jul 28 17:45:51.263528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:51.263528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 17:45:51.263528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 17:45:51.263528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 17:45:51.263528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 17:45:51.263528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 17:45:51.263528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 17:45:51.263528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 17:45:51.263528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application conn.query(q) Jul 28 17:45:51.263528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 17:45:51.263528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 17:45:51.263528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 17:45:51.264497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result.read() Jul 28 17:45:51.264497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 17:45:51.264497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 17:45:51.264497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 17:45:51.264497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 17:45:51.264497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 17:45:51.264497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 17:45:51.264497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 17:45:51.264497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 17:45:51.264497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 17:45:51.264497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:51.264497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 17:45:51.264497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:51.264497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:51.264497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 17:45:51.264497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 17:45:51.264497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 28 17:45:51.264497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 28 17:45:51.265747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 17:45:51.265747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application next(self.gen) Jul 28 17:45:51.265747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 17:45:51.265747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application yield resource Jul 28 17:45:51.265747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 17:45:51.265747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application next(self.gen) Jul 28 17:45:51.265747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 17:45:51.265747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 17:45:51.265747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 17:45:51.265747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 17:45:51.265747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 17:45:51.265747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise self.value Jul 28 17:45:51.265747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 17:45:51.265747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 17:45:51.265747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 17:45:51.265747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application session.commit() Jul 28 17:45:51.265747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 17:45:51.266854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 17:45:51.266854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 17:45:51.266854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 17:45:51.266854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 17:45:51.266854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.session.flush() Jul 28 17:45:51.266854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 17:45:51.266854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 17:45:51.266854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 17:45:51.266854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 17:45:51.266854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 17:45:51.266854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application compat.raise_( Jul 28 17:45:51.266854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 17:45:51.266854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception Jul 28 17:45:51.266854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 17:45:51.266854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 17:45:51.266854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 17:45:51.266854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 17:45:51.267944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 17:45:51.267944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 17:45:51.267944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 17:45:51.267944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 17:45:51.267944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 17:45:51.267944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 17:45:51.267944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 17:45:51.267944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 17:45:51.267944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 17:45:51.267944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 17:45:51.267944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 17:45:51.267944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 17:45:51.267944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 17:45:51.267944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 17:45:51.267944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 17:45:51.268937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 17:45:51.268937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 17:45:51.268937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception Jul 28 17:45:51.268937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 17:45:51.268937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 17:45:51.268937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 17:45:51.268937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 17:45:51.268937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 17:45:51.268937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 17:45:51.268937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 17:45:51.268937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application conn.query(q) Jul 28 17:45:51.268937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 17:45:51.268937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 17:45:51.268937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 17:45:51.268937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result.read() Jul 28 17:45:51.268937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 17:45:51.268937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 17:45:51.270279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 17:45:51.270279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 17:45:51.270279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 17:45:51.270279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 17:45:51.270279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 17:45:51.270279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 17:45:51.270279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 17:45:51.270279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 17:45:51.270279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [parameters: {'id': '753965d8fd1a4ae7ba6f85042e9bb567', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 17:45:51.270279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 17:45:51.270279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:51.270279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:51.270279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:51.270279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:51.270279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 28 17:45:51.272010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 28 17:45:51.272010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 17:45:51.272010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 17:45:51.272010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 28 17:45:51.272010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:51.272010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:51.272010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:51.272010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:51.272010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:51.272010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:51.272010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:51.272010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:51.272010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:51.272010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:51.272010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:51.272010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:51.272010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:51.275781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:51.275781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 28 17:45:51.275781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 28 17:45:51.275781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:51.275781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:51.275781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 28 17:45:51.275781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 28 17:45:51.275781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 753965d8fd1a4ae7ba6f85042e9bb567. Jul 28 17:45:51.275781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:51.277145 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 467/934] 10.222.0.75 () {60 vars in 1140 bytes} [Thu Jul 28 17:45:51 2022] POST /identity/v3/projects => generated 262 bytes in 251 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:51.277364 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 467/934] 10.222.0.75 () {56 vars in 1087 bytes} [Thu Jul 28 17:45:51 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:45:51.282367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28d827-24ae-4e78-a077-d87bdb890678 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:51.404681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28d827-24ae-4e78-a077-d87bdb890678 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:51.425296 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:51.445348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43be855-552a-4a29-ab35-19c7c2ac08eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:51.446335 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43be855-552a-4a29-ab35-19c7c2ac08eb None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:51.446801 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43be855-552a-4a29-ab35-19c7c2ac08eb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:51.447075 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43be855-552a-4a29-ab35-19c7c2ac08eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:51.454093 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43be855-552a-4a29-ab35-19c7c2ac08eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:51.455739 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43be855-552a-4a29-ab35-19c7c2ac08eb None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:51.468730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-d43be855-552a-4a29-ab35-19c7c2ac08eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:51.468730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:51.468730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:51.468730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:51.468730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:51.468730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:51.468730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:51.468730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:51.468730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:51.468730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:51.468730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:51.468730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:51.468730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:51.468730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:51.468730 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:51.469674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:51.469674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:51.469674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:51.469674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:51.469674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:51.469674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:51.469674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:51.469674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:51.469674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:51.469674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:51.469674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:51.469674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:51.469674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:51.469674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:51.469674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:51.469674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:51.469674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:51.470552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:51.470552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:51.470552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:51.470552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:51.470552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:51.470552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:51.470552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:51.470552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:51.470552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 468/935] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:51.479256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591c013-4204-4fbf-ae40-ddad2002e292 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:51.595124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591c013-4204-4fbf-ae40-ddad2002e292 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:51.623173 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:51.631642 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabcb02-c45f-4503-87fc-ed837401a608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:51.632272 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabcb02-c45f-4503-87fc-ed837401a608 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:51.632550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabcb02-c45f-4503-87fc-ed837401a608 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:51.632855 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabcb02-c45f-4503-87fc-ed837401a608 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:51.633574 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabcb02-c45f-4503-87fc-ed837401a608 None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:51.633876 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabcb02-c45f-4503-87fc-ed837401a608 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:51.635324 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabcb02-c45f-4503-87fc-ed837401a608 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:51.653334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 468/936] 10.222.0.75 () {56 vars in 1112 bytes} [Thu Jul 28 17:45:51 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:51.820606 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167045d8-e830-4806-b692-97129f30eb83 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:51.821152 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167045d8-e830-4806-b692-97129f30eb83 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:51.821230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167045d8-e830-4806-b692-97129f30eb83 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:51.825333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 469/937] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:51.830755 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa9f33-44ea-4b50-abf4-c719c02537b3 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:51.831044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa9f33-44ea-4b50-abf4-c719c02537b3 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:51.831321 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa9f33-44ea-4b50-abf4-c719c02537b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:51.851104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e4aa9f33-44ea-4b50-abf4-c719c02537b3 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:51.852301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e4aa9f33-44ea-4b50-abf4-c719c02537b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:51.924129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 469/938] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:51.945928 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167045d8-e830-4806-b692-97129f30eb83 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:52.060492 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167045d8-e830-4806-b692-97129f30eb83 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:52.097934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a81912-fe37-41a3-b93a-c83e17a92931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:52.098922 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a81912-fe37-41a3-b93a-c83e17a92931 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:52.099410 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a81912-fe37-41a3-b93a-c83e17a92931 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:52.099983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a81912-fe37-41a3-b93a-c83e17a92931 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:52.111636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a81912-fe37-41a3-b93a-c83e17a92931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:52.116837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-e0a81912-fe37-41a3-b93a-c83e17a92931 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:45:52.116837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:52.116837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:52.116837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:52.116837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:52.116837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:52.116837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:52.116837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:52.116837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:52.116837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:52.116837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:52.116837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:52.116837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:52.116837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:52.116837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:52.116837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:52.117770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:52.117770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:52.117770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:52.117770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:52.117770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:52.117770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:52.117770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:52.117770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:52.117770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:52.117770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:52.117770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:52.117770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:52.117770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:52.117770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:52.117770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:52.117770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:52.118605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:52.118605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:52.118605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:52.118605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:52.118605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:52.118605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:52.118605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:52.118605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:52.118605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:52.118605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:52.118605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:45:52.118605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:52.121372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 470/939] 10.222.0.75 () {56 vars in 1120 bytes} [Thu Jul 28 17:45:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:52.128807 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa9f33-44ea-4b50-abf4-c719c02537b3 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:52.231119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa9f33-44ea-4b50-abf4-c719c02537b3 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:52.248845 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:52.266908 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3f4c6-c619-4ad3-bc59-6bbbae36131a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:52.267545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3f4c6-c619-4ad3-bc59-6bbbae36131a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:52.267883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3f4c6-c619-4ad3-bc59-6bbbae36131a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:52.268156 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3f4c6-c619-4ad3-bc59-6bbbae36131a None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:52.268904 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3f4c6-c619-4ad3-bc59-6bbbae36131a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:52.269214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3f4c6-c619-4ad3-bc59-6bbbae36131a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:52.270606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3f4c6-c619-4ad3-bc59-6bbbae36131a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:52.284949 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 470/940] 10.222.0.75 () {56 vars in 1115 bytes} [Thu Jul 28 17:45:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:52.286166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a81912-fe37-41a3-b93a-c83e17a92931 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:52.325087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:52.410144 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a81912-fe37-41a3-b93a-c83e17a92931 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:52.451349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7f668-a6de-4c81-85a0-364548f5c77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:52.452625 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7f668-a6de-4c81-85a0-364548f5c77e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:52.452974 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7f668-a6de-4c81-85a0-364548f5c77e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:52.453251 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7f668-a6de-4c81-85a0-364548f5c77e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:52.464069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7f668-a6de-4c81-85a0-364548f5c77e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:52.465592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7f668-a6de-4c81-85a0-364548f5c77e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:52.481150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-98f7f668-a6de-4c81-85a0-364548f5c77e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:52.481150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:52.481150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:52.481150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:52.481150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:52.481150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:52.481150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:52.481150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:52.481150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:52.481150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:52.481150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:52.481150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:52.481150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:52.481150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:52.481150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:52.482085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:52.482085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:52.482085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:52.482085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:52.482085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:52.482085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:52.482085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:52.482085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:52.482085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:52.482085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:52.482085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:52.482085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:52.482085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:52.482085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:52.482085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:52.482085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:52.482085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:52.482969 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:52.482969 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:52.482969 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:52.482969 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:52.482969 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 471/941] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:52.488677 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3f4c6-c619-4ad3-bc59-6bbbae36131a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:52.542371 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d06d5-653f-49e8-8db1-e838e0c9fe92 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:52.542715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d06d5-653f-49e8-8db1-e838e0c9fe92 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:52.542926 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d06d5-653f-49e8-8db1-e838e0c9fe92 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:52.544581 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 472/942] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:45:52.549793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e02a7a-8fa3-4089-8563-63dea21d76a5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:52.550182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e02a7a-8fa3-4089-8563-63dea21d76a5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:52.550569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e02a7a-8fa3-4089-8563-63dea21d76a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:52.570289 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-16e02a7a-8fa3-4089-8563-63dea21d76a5 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:52.571979 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-16e02a7a-8fa3-4089-8563-63dea21d76a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:52.596182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3f4c6-c619-4ad3-bc59-6bbbae36131a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:52.631728 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280067f6-e6ea-48d6-a317-fb9d57805167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:52.632641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280067f6-e6ea-48d6-a317-fb9d57805167 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:52.633349 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280067f6-e6ea-48d6-a317-fb9d57805167 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:52.633775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280067f6-e6ea-48d6-a317-fb9d57805167 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:52.634619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280067f6-e6ea-48d6-a317-fb9d57805167 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:52.635129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280067f6-e6ea-48d6-a317-fb9d57805167 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:52.636711 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280067f6-e6ea-48d6-a317-fb9d57805167 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:52.650061 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 471/943] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:52.655205 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280067f6-e6ea-48d6-a317-fb9d57805167 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:52.661448 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 473/944] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:52.687302 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e02a7a-8fa3-4089-8563-63dea21d76a5 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:52.706658 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:52.725216 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:52.768072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280067f6-e6ea-48d6-a317-fb9d57805167 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:52.797143 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e02a7a-8fa3-4089-8563-63dea21d76a5 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:52.815032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d51719-75f1-45e1-aef7-575f2ac41133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:52.815941 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d51719-75f1-45e1-aef7-575f2ac41133 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:52.816229 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d51719-75f1-45e1-aef7-575f2ac41133 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:52.816510 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d51719-75f1-45e1-aef7-575f2ac41133 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:52.826487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d51719-75f1-45e1-aef7-575f2ac41133 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:52.828437 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d51719-75f1-45e1-aef7-575f2ac41133 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:52.837595 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912be37d-0b11-40a1-a592-8d46ff2b42d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:52.838937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912be37d-0b11-40a1-a592-8d46ff2b42d3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:52.839426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912be37d-0b11-40a1-a592-8d46ff2b42d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:52.839915 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912be37d-0b11-40a1-a592-8d46ff2b42d3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:52.840778 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912be37d-0b11-40a1-a592-8d46ff2b42d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:52.842371 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912be37d-0b11-40a1-a592-8d46ff2b42d3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:52.843497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-24d51719-75f1-45e1-aef7-575f2ac41133 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:45:52.843497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:52.843497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:52.843497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:52.843497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:52.843497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:52.843497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:52.843497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:52.843497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:52.843497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:52.843497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:52.843497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:52.843497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:52.843497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:52.843497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:52.843497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:52.844414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:52.844414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:52.844414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:52.844414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:52.844414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:52.844414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:52.844414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:52.844414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:52.844414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:52.844414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:52.844414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:52.844414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:52.844414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:52.844414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:52.844414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:52.844414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:52.844414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:52.844414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:52.845406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:52.845406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:52.845406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:52.845406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:52.845406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:52.845406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:52.845406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:52.845406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:52.845406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:45:52.845406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:52.848927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 472/945] 10.222.0.75 () {56 vars in 1117 bytes} [Thu Jul 28 17:45:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:52.850538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d51719-75f1-45e1-aef7-575f2ac41133 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:52.862219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-912be37d-0b11-40a1-a592-8d46ff2b42d3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:45:52.862219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:52.862219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:52.862219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:52.862219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:52.862219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:52.862219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:52.862219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:52.862219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:45:52.862219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:52.862219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:52.862219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:52.862219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:52.862219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:52.862219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:52.862219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:52.862219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:52.863280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:52.863280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:52.863280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:52.863280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:52.863280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:52.863280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:52.863280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:52.863280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:52.863280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:52.863280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:52.863280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:52.863280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:52.863280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:52.863280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:52.863280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:52.863280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:52.864129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:52.864129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:52.864129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:52.864129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:52.864129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:52.864129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:52.864129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:52.864129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:52.864129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:52.864129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:52.864129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:52.864129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:52.864129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:45:52.864129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:52.872089 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 474/946] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:52.872867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912be37d-0b11-40a1-a592-8d46ff2b42d3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:52.964396 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:52.967668 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:52.967966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d51719-75f1-45e1-aef7-575f2ac41133 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:52.987902 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912be37d-0b11-40a1-a592-8d46ff2b42d3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:53.004069 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fb663-b0ef-4654-be20-d10b7079cd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:53.005138 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fb663-b0ef-4654-be20-d10b7079cd20 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:53.005646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fb663-b0ef-4654-be20-d10b7079cd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:53.006143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fb663-b0ef-4654-be20-d10b7079cd20 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:53.007345 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fb663-b0ef-4654-be20-d10b7079cd20 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:53.007880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fb663-b0ef-4654-be20-d10b7079cd20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:53.009603 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fb663-b0ef-4654-be20-d10b7079cd20 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:53.026333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b19c9d-230c-4a2b-8382-f9c25aa10a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:53.027001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b19c9d-230c-4a2b-8382-f9c25aa10a43 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:53.027354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b19c9d-230c-4a2b-8382-f9c25aa10a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:53.027640 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b19c9d-230c-4a2b-8382-f9c25aa10a43 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:53.028371 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b19c9d-230c-4a2b-8382-f9c25aa10a43 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:53.028685 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b19c9d-230c-4a2b-8382-f9c25aa10a43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:53.030608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b19c9d-230c-4a2b-8382-f9c25aa10a43 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:53.036073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 473/947] 10.222.0.75 () {56 vars in 1149 bytes} [Thu Jul 28 17:45:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:53.037259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fb663-b0ef-4654-be20-d10b7079cd20 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:53.042141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 475/948] 10.222.0.75 () {56 vars in 1112 bytes} [Thu Jul 28 17:45:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:53.043115 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b19c9d-230c-4a2b-8382-f9c25aa10a43 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:53.141222 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fb663-b0ef-4654-be20-d10b7079cd20 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:53.156884 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b19c9d-230c-4a2b-8382-f9c25aa10a43 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:53.178426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfa730-7834-44ea-b8cc-b8cff18d5f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:53.179463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfa730-7834-44ea-b8cc-b8cff18d5f6e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:53.179982 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfa730-7834-44ea-b8cc-b8cff18d5f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:53.180458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfa730-7834-44ea-b8cc-b8cff18d5f6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:53.191556 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfa730-7834-44ea-b8cc-b8cff18d5f6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:53.193677 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfa730-7834-44ea-b8cc-b8cff18d5f6e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:53.195778 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffc7cb-dcc1-4c2e-ac1f-1bf9dec784f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:53.196338 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffc7cb-dcc1-4c2e-ac1f-1bf9dec784f5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:53.196626 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffc7cb-dcc1-4c2e-ac1f-1bf9dec784f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:53.196952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffc7cb-dcc1-4c2e-ac1f-1bf9dec784f5 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:53.197812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffc7cb-dcc1-4c2e-ac1f-1bf9dec784f5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:53.198121 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffc7cb-dcc1-4c2e-ac1f-1bf9dec784f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:53.199667 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffc7cb-dcc1-4c2e-ac1f-1bf9dec784f5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:53.209444 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 476/949] 10.222.0.75 () {56 vars in 1112 bytes} [Thu Jul 28 17:45:53 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:53.211554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-81bfa730-7834-44ea-b8cc-b8cff18d5f6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:53.211554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:53.211554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:53.211554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:53.211554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:53.211554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:53.211554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:53.211554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:53.211554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:53.211554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:53.211554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:53.211554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:53.211554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:53.211554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:53.211554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:53.212453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:53.212453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:53.212453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:53.212453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:53.212453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:53.212453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:53.212453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:53.212453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:53.212453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:53.212453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:53.212453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:53.212453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:53.212453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:53.212453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:53.212453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:53.212453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:53.212453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:53.213371 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:53.213371 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:53.213371 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:53.213371 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:53.220714 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 474/950] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:53.222680 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffc7cb-dcc1-4c2e-ac1f-1bf9dec784f5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:53.241586 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:53.340778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0b5a7-c459-4d2b-914f-b60eba28d5d0 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:53.340778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0b5a7-c459-4d2b-914f-b60eba28d5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:53.340778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0b5a7-c459-4d2b-914f-b60eba28d5d0 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:53.341716 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffc7cb-dcc1-4c2e-ac1f-1bf9dec784f5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:53.347262 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 475/951] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:53.351083 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da0559-f9e0-4a33-9596-40fe49a0e4bd None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:53.351373 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da0559-f9e0-4a33-9596-40fe49a0e4bd None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:53.351651 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da0559-f9e0-4a33-9596-40fe49a0e4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:53.376578 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e5da0559-f9e0-4a33-9596-40fe49a0e4bd None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:53.378153 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e5da0559-f9e0-4a33-9596-40fe49a0e4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:53.387028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:53.391217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc02bcc-dc15-415a-a3ec-9f53e544cd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:53.391865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc02bcc-dc15-415a-a3ec-9f53e544cd8d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:53.392147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc02bcc-dc15-415a-a3ec-9f53e544cd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:53.392422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc02bcc-dc15-415a-a3ec-9f53e544cd8d None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:53.393177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc02bcc-dc15-415a-a3ec-9f53e544cd8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:53.393484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc02bcc-dc15-415a-a3ec-9f53e544cd8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:53.394899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc02bcc-dc15-415a-a3ec-9f53e544cd8d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:53.410103 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 477/952] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:53.416954 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc02bcc-dc15-415a-a3ec-9f53e544cd8d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:53.473996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 476/953] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:53.494119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:53.496119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da0559-f9e0-4a33-9596-40fe49a0e4bd None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:53.526832 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc02bcc-dc15-415a-a3ec-9f53e544cd8d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:53.564289 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c701e2-8a72-48bc-ab1d-492f5dcb12a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:53.565022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c701e2-8a72-48bc-ab1d-492f5dcb12a5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:53.565306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c701e2-8a72-48bc-ab1d-492f5dcb12a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:53.565583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c701e2-8a72-48bc-ab1d-492f5dcb12a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:53.572989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c701e2-8a72-48bc-ab1d-492f5dcb12a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:53.574457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c701e2-8a72-48bc-ab1d-492f5dcb12a5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:53.587303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-79c701e2-8a72-48bc-ab1d-492f5dcb12a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:53.587303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:53.587303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:53.587303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:53.587303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:53.587303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:53.587303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:53.587303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:53.587303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:53.587303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:53.587303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:53.587303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:53.587303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:53.587303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:53.587303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:53.588295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:53.588295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:53.588295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:53.588295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:53.588295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:53.588295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:53.588295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:53.588295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:53.588295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:53.588295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:53.588295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:53.588295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:53.588295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:53.588295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:53.588295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:53.588295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:53.588295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:53.589310 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:53.589310 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:53.589310 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:53.589310 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:53.589310 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:53.589310 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:53.589310 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:53.589310 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:53.589310 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 478/954] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:53.594379 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c701e2-8a72-48bc-ab1d-492f5dcb12a5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:53.602644 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da0559-f9e0-4a33-9596-40fe49a0e4bd None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:53.642723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6500ff-af47-4cb3-9aa2-454983fc4807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:53.643390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6500ff-af47-4cb3-9aa2-454983fc4807 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:53.643778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6500ff-af47-4cb3-9aa2-454983fc4807 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:53.644060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6500ff-af47-4cb3-9aa2-454983fc4807 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:53.644704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6500ff-af47-4cb3-9aa2-454983fc4807 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:53.646129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6500ff-af47-4cb3-9aa2-454983fc4807 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:53.656453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-0e6500ff-af47-4cb3-9aa2-454983fc4807 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:45:53.656453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:53.656453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:53.656453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:53.656453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:53.656453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:53.656453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:53.656453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:53.656453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:45:53.656453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:53.656453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:53.656453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:53.656453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:53.656453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:53.656453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:53.656453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:53.656453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:53.658541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:53.658541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:53.658541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:53.658541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:53.658541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:53.658541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:53.658541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:53.658541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:53.658541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:53.658541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:53.658541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:53.658541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:53.658541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:53.658541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:53.658541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:53.658541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:53.661021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:53.661021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:53.661021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:53.661021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:53.661021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:53.661021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:53.661021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:53.661021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:53.661021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:53.661021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:53.661021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:53.661021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:53.661021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:45:53.661021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:53.661021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 477/955] 10.222.0.75 () {56 vars in 1126 bytes} [Thu Jul 28 17:45:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:53.669071 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6500ff-af47-4cb3-9aa2-454983fc4807 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:53.673446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:53.726092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c701e2-8a72-48bc-ab1d-492f5dcb12a5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:53.757082 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:53.763196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7f88f-44bd-4800-a7d6-e90414474b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:53.763900 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7f88f-44bd-4800-a7d6-e90414474b09 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:53.764251 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7f88f-44bd-4800-a7d6-e90414474b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:53.764606 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7f88f-44bd-4800-a7d6-e90414474b09 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:53.765513 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7f88f-44bd-4800-a7d6-e90414474b09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:53.775269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7f88f-44bd-4800-a7d6-e90414474b09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:53.775269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7f88f-44bd-4800-a7d6-e90414474b09 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:53.782470 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 479/956] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:53.788500 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7f88f-44bd-4800-a7d6-e90414474b09 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:53.805014 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6500ff-af47-4cb3-9aa2-454983fc4807 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:53.840450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4984a-ee8e-4546-a536-42448a024341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:53.841453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4984a-ee8e-4546-a536-42448a024341 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:53.841933 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4984a-ee8e-4546-a536-42448a024341 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:53.842212 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4984a-ee8e-4546-a536-42448a024341 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:53.843526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4984a-ee8e-4546-a536-42448a024341 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:53.843838 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4984a-ee8e-4546-a536-42448a024341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:53.845260 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4984a-ee8e-4546-a536-42448a024341 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:53.854597 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 478/957] 10.222.0.75 () {56 vars in 1122 bytes} [Thu Jul 28 17:45:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:53.854597 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439774ca-89f1-40df-9246-708678332106 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:53.854597 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439774ca-89f1-40df-9246-708678332106 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:53.854597 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439774ca-89f1-40df-9246-708678332106 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:53.857046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 479/958] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:53.857831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439774ca-89f1-40df-9246-708678332106 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:53.908568 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7f88f-44bd-4800-a7d6-e90414474b09 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:53.930927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:53.944861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7553db2-685d-46cc-ab69-cf2e0c995d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:53.946096 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7553db2-685d-46cc-ab69-cf2e0c995d95 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:53.946096 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7553db2-685d-46cc-ab69-cf2e0c995d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:53.946287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7553db2-685d-46cc-ab69-cf2e0c995d95 None admin] PATH_INFO: `/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/1cbbfdda843a4ab98ff9cf0742513f44/roles/4a747c3694f44616b8ca0dae0fea435f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:53.948366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7553db2-685d-46cc-ab69-cf2e0c995d95 None admin] RBAC: Authorizing `identity:create_grant(project_id=883ec0c5aa374fbfbfc08eda6c626cfc, user_id=1cbbfdda843a4ab98ff9cf0742513f44, role_id=4a747c3694f44616b8ca0dae0fea435f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:53.949848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7553db2-685d-46cc-ab69-cf2e0c995d95 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:53.968958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439774ca-89f1-40df-9246-708678332106 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:54.002673 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046832b-5fbf-421a-9143-67c4a155b978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:54.003221 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046832b-5fbf-421a-9143-67c4a155b978 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:54.003503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046832b-5fbf-421a-9143-67c4a155b978 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:54.003775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046832b-5fbf-421a-9143-67c4a155b978 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:54.004457 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046832b-5fbf-421a-9143-67c4a155b978 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:54.004776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046832b-5fbf-421a-9143-67c4a155b978 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:54.006164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046832b-5fbf-421a-9143-67c4a155b978 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:54.010936 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 480/959] 10.222.0.75 () {56 vars in 1122 bytes} [Thu Jul 28 17:45:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:54.017478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c597150-2bb5-4f2a-b471-f3b050e8baf9 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:54.017478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c597150-2bb5-4f2a-b471-f3b050e8baf9 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:54.017478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c597150-2bb5-4f2a-b471-f3b050e8baf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:54.030858 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0c597150-2bb5-4f2a-b471-f3b050e8baf9 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:54.032024 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0c597150-2bb5-4f2a-b471-f3b050e8baf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:54.057626 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 480/960] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:45:53 2022] PUT /identity/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/1cbbfdda843a4ab98ff9cf0742513f44/roles/4a747c3694f44616b8ca0dae0fea435f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:45:54.058722 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7553db2-685d-46cc-ab69-cf2e0c995d95 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:54.112039 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 481/961] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:54.128558 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:54.144635 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c597150-2bb5-4f2a-b471-f3b050e8baf9 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:54.199267 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7553db2-685d-46cc-ab69-cf2e0c995d95 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:54.214956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:54.246908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9bf90-f3c0-4120-a10f-2821e000c64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:54.247673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9bf90-f3c0-4120-a10f-2821e000c64b None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:54.248258 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9bf90-f3c0-4120-a10f-2821e000c64b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:54.248258 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9bf90-f3c0-4120-a10f-2821e000c64b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:54.249968 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9bf90-f3c0-4120-a10f-2821e000c64b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:54.251207 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9bf90-f3c0-4120-a10f-2821e000c64b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:54.260094 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c597150-2bb5-4f2a-b471-f3b050e8baf9 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:54.296539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f82b4-44e0-458f-9cd2-81d9129df665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:54.297636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f82b4-44e0-458f-9cd2-81d9129df665 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:54.298045 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f82b4-44e0-458f-9cd2-81d9129df665 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:54.298456 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f82b4-44e0-458f-9cd2-81d9129df665 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:54.299266 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f82b4-44e0-458f-9cd2-81d9129df665 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:54.300825 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f82b4-44e0-458f-9cd2-81d9129df665 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:54.303501 dv-cinder-837543-7-smb devstack@keystone.service[80421]: WARNING keystone.server.flask.common [None req-066f82b4-44e0-458f-9cd2-81d9129df665 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 17:45:54.354279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.sql.core [None req-066f82b4-44e0-458f-9cd2-81d9129df665 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 17:45:54.354279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 17:45:54.354279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [parameters: {'user_id': '89946c19dbcb4582a2f0f42234ca6c24', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 17:45:54.354279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80421) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 17:45:54.361876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 481/962] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 17:45:54 2022] POST /identity/v3/endpoints => generated 349 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:45:54.372632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-066f82b4-44e0-458f-9cd2-81d9129df665 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 17:45:54.372632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:54.372632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 17:45:54.372632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 17:45:54.372632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 17:45:54.372632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 17:45:54.372632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 17:45:54.372632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 17:45:54.372632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 17:45:54.372632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application conn.query(q) Jul 28 17:45:54.372632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 17:45:54.372632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 17:45:54.372632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 17:45:54.372632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application result.read() Jul 28 17:45:54.372632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 17:45:54.373958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 17:45:54.373958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 17:45:54.373958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 17:45:54.373958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 17:45:54.373958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 17:45:54.373958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 17:45:54.373958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 17:45:54.373958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 17:45:54.373958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:54.373958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 17:45:54.373958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:54.373958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:54.373958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 17:45:54.373958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 17:45:54.373958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 28 17:45:54.373958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 28 17:45:54.373958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 17:45:54.373958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application next(self.gen) Jul 28 17:45:54.375750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 17:45:54.375750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application yield resource Jul 28 17:45:54.375750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 17:45:54.375750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application next(self.gen) Jul 28 17:45:54.375750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 17:45:54.375750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 17:45:54.375750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 17:45:54.375750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 17:45:54.375750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 17:45:54.375750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise self.value Jul 28 17:45:54.375750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 17:45:54.375750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 17:45:54.375750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 17:45:54.375750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application session.commit() Jul 28 17:45:54.375750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 17:45:54.375750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 17:45:54.375750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 17:45:54.376976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 17:45:54.376976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 17:45:54.376976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self.session.flush() Jul 28 17:45:54.376976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 17:45:54.376976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 17:45:54.376976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 17:45:54.376976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 17:45:54.376976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 17:45:54.376976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application compat.raise_( Jul 28 17:45:54.376976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 17:45:54.376976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception Jul 28 17:45:54.376976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 17:45:54.376976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 17:45:54.376976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 17:45:54.376976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 17:45:54.376976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 17:45:54.376976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 17:45:54.378131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 17:45:54.378131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 17:45:54.378131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 17:45:54.378131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 28 17:45:54.378131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 17:45:54.378131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 17:45:54.378131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 17:45:54.378131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 17:45:54.378131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 17:45:54.378131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 17:45:54.378131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 17:45:54.378131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 17:45:54.378131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 17:45:54.378131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 17:45:54.378131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 17:45:54.378131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception Jul 28 17:45:54.379210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 17:45:54.379210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 17:45:54.379210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 17:45:54.379210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 17:45:54.379210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 17:45:54.379210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 17:45:54.379210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 17:45:54.379210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application conn.query(q) Jul 28 17:45:54.379210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 17:45:54.379210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 17:45:54.379210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 17:45:54.379210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application result.read() Jul 28 17:45:54.379210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 17:45:54.379210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 17:45:54.379210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 17:45:54.379210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 17:45:54.380286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 17:45:54.380286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 17:45:54.380286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 17:45:54.380286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 17:45:54.380286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 17:45:54.380286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 17:45:54.380286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [parameters: {'user_id': '89946c19dbcb4582a2f0f42234ca6c24', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 17:45:54.380286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 17:45:54.380286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:54.380286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:54.380286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:54.380286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:54.380286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:54.380286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:54.380286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:54.381404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:54.381404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:54.381404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:54.381404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:54.381404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:54.381404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:54.381404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:54.381404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 28 17:45:54.381404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 28 17:45:54.381404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:54.381404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:54.381404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:54.381404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:54.381404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:54.381404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:54.381404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 28 17:45:54.381404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 28 17:45:54.384362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 28 17:45:54.384362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 28 17:45:54.384362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 17:45:54.384362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 17:45:54.384362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 17:45:54.384362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:54.385310 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 482/963] 10.222.0.75 () {60 vars in 1131 bytes} [Thu Jul 28 17:45:54 2022] POST /identity/v3/users => generated 160 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:54.390044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9bf90-f3c0-4120-a10f-2821e000c64b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:54.530886 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9bf90-f3c0-4120-a10f-2821e000c64b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:54.532668 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:54.567545 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb93b8-4a59-46db-8655-c2fe350f4919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:54.568445 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb93b8-4a59-46db-8655-c2fe350f4919 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:54.568936 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb93b8-4a59-46db-8655-c2fe350f4919 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:54.569470 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb93b8-4a59-46db-8655-c2fe350f4919 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:54.578481 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb93b8-4a59-46db-8655-c2fe350f4919 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:54.580186 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb93b8-4a59-46db-8655-c2fe350f4919 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:54.593307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-0fcb93b8-4a59-46db-8655-c2fe350f4919 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:45:54.593307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:54.593307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:54.593307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:54.593307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:54.593307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:54.593307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:54.593307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:54.593307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:54.593307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:54.593307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:54.593307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:54.593307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:54.593307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:54.593307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:54.593307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:54.609394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:54.609394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:54.609394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:54.609394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:54.609394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:54.609394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:54.609394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:54.609394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:54.609394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:54.609394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:54.609394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:54.609394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:54.609394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:54.609394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:54.609394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:54.609394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:54.609394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:54.609394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:54.610720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:54.610720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:54.610720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:54.610720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:54.610720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:54.610720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:54.610720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:54.610720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:54.610720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:45:54.610720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:54.610720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 482/964] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:45:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:54.611472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f82b4-44e0-458f-9cd2-81d9129df665 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:54.714918 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f82b4-44e0-458f-9cd2-81d9129df665 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:54.740745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:54.752962 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a3d37-390e-4c27-a638-989614432c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:54.756860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a3d37-390e-4c27-a638-989614432c5a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:54.756860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a3d37-390e-4c27-a638-989614432c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:54.756860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a3d37-390e-4c27-a638-989614432c5a None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:54.756860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a3d37-390e-4c27-a638-989614432c5a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:54.756860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a3d37-390e-4c27-a638-989614432c5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:54.756860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a3d37-390e-4c27-a638-989614432c5a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:54.803800 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 483/965] 10.222.0.75 () {56 vars in 1101 bytes} [Thu Jul 28 17:45:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:55.291340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150dd6-67f9-4097-9814-cbe2ad5da1a9 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:55.291979 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150dd6-67f9-4097-9814-cbe2ad5da1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:55.291979 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150dd6-67f9-4097-9814-cbe2ad5da1a9 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:55.293476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 483/966] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:55.298642 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c1699-3fed-47a1-bb8e-1facd83f9207 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:55.298930 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c1699-3fed-47a1-bb8e-1facd83f9207 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:55.299211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c1699-3fed-47a1-bb8e-1facd83f9207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:55.322753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b07c1699-3fed-47a1-bb8e-1facd83f9207 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:55.324289 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b07c1699-3fed-47a1-bb8e-1facd83f9207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:55.400731 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 484/967] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:55.423918 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150dd6-67f9-4097-9814-cbe2ad5da1a9 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:55.534343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150dd6-67f9-4097-9814-cbe2ad5da1a9 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:55.571081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9b284-942d-44c5-8f89-78016db5d3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:55.571629 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9b284-942d-44c5-8f89-78016db5d3f3 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:55.571909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9b284-942d-44c5-8f89-78016db5d3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:55.572183 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9b284-942d-44c5-8f89-78016db5d3f3 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:55.572917 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9b284-942d-44c5-8f89-78016db5d3f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:55.574284 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9b284-942d-44c5-8f89-78016db5d3f3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:55.746791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 484/968] 10.222.0.75 () {60 vars in 1141 bytes} [Thu Jul 28 17:45:55 2022] POST /identity/v3/services => generated 242 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:45:56.162831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4bb08-9632-408d-a4ba-d542ca81ffac None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:56.162831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4bb08-9632-408d-a4ba-d542ca81ffac None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:56.163414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4bb08-9632-408d-a4ba-d542ca81ffac None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:56.164560 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 485/969] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:56.169738 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0f6c4-d3c1-48dd-b0c0-926d2337cb9b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:56.170039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0f6c4-d3c1-48dd-b0c0-926d2337cb9b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:56.171082 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0f6c4-d3c1-48dd-b0c0-926d2337cb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:56.188986 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-48f0f6c4-d3c1-48dd-b0c0-926d2337cb9b None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:56.190195 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-48f0f6c4-d3c1-48dd-b0c0-926d2337cb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:56.208286 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:56.266773 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 485/970] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:56.289878 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4bb08-9632-408d-a4ba-d542ca81ffac None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:56.409525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4bb08-9632-408d-a4ba-d542ca81ffac None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:56.423527 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:56.446328 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dad7dc-c830-4228-9994-90fa6ca85c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:56.446977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dad7dc-c830-4228-9994-90fa6ca85c7f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:56.447253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dad7dc-c830-4228-9994-90fa6ca85c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:56.447523 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dad7dc-c830-4228-9994-90fa6ca85c7f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:56.457846 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dad7dc-c830-4228-9994-90fa6ca85c7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:56.462736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-81dad7dc-c830-4228-9994-90fa6ca85c7f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:45:56.462736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:56.462736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:56.462736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:56.462736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:56.462736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:56.462736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:56.462736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:56.462736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:56.462736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:56.462736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:56.462736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:56.462736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:56.462736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:56.462736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:56.462736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:56.463680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:56.463680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:56.463680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:56.463680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:56.463680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:56.463680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:56.463680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:56.463680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:56.463680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:56.463680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:56.463680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:56.463680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:56.463680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:56.463680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:56.463680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:56.463680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:56.464552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:56.464552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:56.464552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:56.464552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:56.464552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:56.464552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:56.464552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:56.464552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:56.464552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:56.464552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:56.464552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:45:56.464552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:56.465257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c695f-3518-4578-acf2-44ddf207b492 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:56.465257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c695f-3518-4578-acf2-44ddf207b492 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:56.465257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c695f-3518-4578-acf2-44ddf207b492 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:56.466346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 486/971] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:45:56.466675 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 486/972] 10.222.0.75 () {56 vars in 1120 bytes} [Thu Jul 28 17:45:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:56.469599 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c695f-3518-4578-acf2-44ddf207b492 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:56.470780 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c64da-897c-4d21-8fe9-29545870942b None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:56.471448 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c64da-897c-4d21-8fe9-29545870942b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:56.472031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c64da-897c-4d21-8fe9-29545870942b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:56.490831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-8a8c64da-897c-4d21-8fe9-29545870942b None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:56.492019 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8a8c64da-897c-4d21-8fe9-29545870942b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:56.564513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 487/973] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:45:56.586965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c64da-897c-4d21-8fe9-29545870942b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:56.591979 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c695f-3518-4578-acf2-44ddf207b492 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:56.632344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946425f-ba53-4f28-b5a4-958847fc835c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:56.633229 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946425f-ba53-4f28-b5a4-958847fc835c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:56.633653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946425f-ba53-4f28-b5a4-958847fc835c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:56.634069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946425f-ba53-4f28-b5a4-958847fc835c None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:56.634963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946425f-ba53-4f28-b5a4-958847fc835c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:56.635269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946425f-ba53-4f28-b5a4-958847fc835c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:56.636622 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946425f-ba53-4f28-b5a4-958847fc835c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:56.648477 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 487/974] 10.222.0.75 () {56 vars in 1115 bytes} [Thu Jul 28 17:45:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:56.653799 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946425f-ba53-4f28-b5a4-958847fc835c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:56.668045 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:56.696713 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c64da-897c-4d21-8fe9-29545870942b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:56.698298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:56.732549 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7805b-0096-4f66-b3d7-270a8a40f6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:56.733923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7805b-0096-4f66-b3d7-270a8a40f6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:56.734308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7805b-0096-4f66-b3d7-270a8a40f6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:56.735084 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7805b-0096-4f66-b3d7-270a8a40f6e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:56.735831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7805b-0096-4f66-b3d7-270a8a40f6e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:56.737702 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7805b-0096-4f66-b3d7-270a8a40f6e1 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:56.750171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-7da7805b-0096-4f66-b3d7-270a8a40f6e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:45:56.750171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:56.750171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:56.750171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:56.750171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:56.750171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:56.750171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:56.750171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:56.750171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:45:56.750171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:56.750171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:56.750171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:56.750171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:56.750171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:56.750171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:56.750171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:56.750171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:56.751207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:56.751207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:56.751207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:56.751207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:56.751207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:56.751207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:56.751207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:56.751207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:56.751207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:56.751207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:56.751207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:56.751207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:56.751207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:56.751207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:56.751207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:56.751207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:56.752046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:56.752046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:56.752046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:56.752046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:56.752046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:56.752046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:56.752046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:56.752046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:56.752046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:56.752046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:56.752046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:56.752046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:56.752046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:45:56.752046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:56.753183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 488/975] 10.222.0.75 () {56 vars in 1126 bytes} [Thu Jul 28 17:45:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:56.757806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7805b-0096-4f66-b3d7-270a8a40f6e1 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:56.766228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946425f-ba53-4f28-b5a4-958847fc835c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:56.802195 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f9e66-1314-4803-acda-f48e35475e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:56.802865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f9e66-1314-4803-acda-f48e35475e38 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:56.803124 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f9e66-1314-4803-acda-f48e35475e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:56.803399 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f9e66-1314-4803-acda-f48e35475e38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:56.819236 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f9e66-1314-4803-acda-f48e35475e38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:56.821373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f9e66-1314-4803-acda-f48e35475e38 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:56.836602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-119f9e66-1314-4803-acda-f48e35475e38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:56.836602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:56.836602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:56.836602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:56.836602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:56.836602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:56.836602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:56.836602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:56.836602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:56.836602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:56.836602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:56.836602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:56.836602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:56.836602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:56.836602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:56.837529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:56.837529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:56.837529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:56.837529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:56.837529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:56.837529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:56.837529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:56.837529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:56.837529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:56.837529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:56.837529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:56.837529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:56.837529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:56.837529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:56.837529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:56.837529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:56.837529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:56.838525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:56.838525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:56.838525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:56.838525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:56.838525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 488/976] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:56.844007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f9e66-1314-4803-acda-f48e35475e38 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:56.878080 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7805b-0096-4f66-b3d7-270a8a40f6e1 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:56.911056 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:56.919396 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589552a5-66da-4705-8399-c9d44c487aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:56.921390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589552a5-66da-4705-8399-c9d44c487aef None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:56.921678 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589552a5-66da-4705-8399-c9d44c487aef None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:56.929015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589552a5-66da-4705-8399-c9d44c487aef None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:56.929015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589552a5-66da-4705-8399-c9d44c487aef None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:56.929015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589552a5-66da-4705-8399-c9d44c487aef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:56.929015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589552a5-66da-4705-8399-c9d44c487aef None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:56.931219 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 489/977] 10.222.0.75 () {56 vars in 1122 bytes} [Thu Jul 28 17:45:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:56.936854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589552a5-66da-4705-8399-c9d44c487aef None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:56.951295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f9e66-1314-4803-acda-f48e35475e38 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:56.969819 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:56.993988 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb12f2-4011-45e4-ac1f-3012d13caa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:56.994986 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb12f2-4011-45e4-ac1f-3012d13caa79 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:56.995439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb12f2-4011-45e4-ac1f-3012d13caa79 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:56.996065 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb12f2-4011-45e4-ac1f-3012d13caa79 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:56.996948 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb12f2-4011-45e4-ac1f-3012d13caa79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:56.997381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb12f2-4011-45e4-ac1f-3012d13caa79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:56.999179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb12f2-4011-45e4-ac1f-3012d13caa79 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:57.018556 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 489/978] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:57.019874 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb12f2-4011-45e4-ac1f-3012d13caa79 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:57.047752 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589552a5-66da-4705-8399-c9d44c487aef None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:57.082567 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ca678-6b1b-48a5-90a6-51d3cea0ede5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:57.083302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca678-6b1b-48a5-90a6-51d3cea0ede5 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:57.083704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca678-6b1b-48a5-90a6-51d3cea0ede5 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:57.083986 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca678-6b1b-48a5-90a6-51d3cea0ede5 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:57.084664 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ca678-6b1b-48a5-90a6-51d3cea0ede5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:57.084998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ca678-6b1b-48a5-90a6-51d3cea0ede5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:57.086379 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ca678-6b1b-48a5-90a6-51d3cea0ede5 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:57.092005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 490/979] 10.222.0.75 () {56 vars in 1122 bytes} [Thu Jul 28 17:45:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:57.098646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ca678-6b1b-48a5-90a6-51d3cea0ede5 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:57.123877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb12f2-4011-45e4-ac1f-3012d13caa79 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:57.150895 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:57.166416 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e6aa5-1c59-4798-91b5-274015a665ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:57.167170 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e6aa5-1c59-4798-91b5-274015a665ca None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:57.167568 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e6aa5-1c59-4798-91b5-274015a665ca None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:57.167981 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e6aa5-1c59-4798-91b5-274015a665ca None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:57.177083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e6aa5-1c59-4798-91b5-274015a665ca None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:57.179038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e6aa5-1c59-4798-91b5-274015a665ca None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:57.194279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-985e6aa5-1c59-4798-91b5-274015a665ca None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:45:57.194279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:57.194279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:57.194279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:57.194279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:57.194279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:57.194279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:57.194279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:57.194279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:57.194279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:57.194279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:57.194279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:57.194279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:57.194279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:57.194279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:57.194279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:57.195439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:57.195439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:57.195439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:57.195439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:57.195439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:57.195439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:57.195439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:57.195439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:57.195439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:57.195439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:57.195439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:57.195439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:57.195439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:57.195439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:57.195439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:57.195439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:57.195439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:57.195439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:57.196605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:57.196605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:57.196605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:57.196605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:57.196605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:57.196605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:57.196605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:57.196605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:57.196605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:45:57.196605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:57.202791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 490/980] 10.222.0.75 () {56 vars in 1117 bytes} [Thu Jul 28 17:45:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:57.204095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:57.204546 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e6aa5-1c59-4798-91b5-274015a665ca None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:57.210979 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ca678-6b1b-48a5-90a6-51d3cea0ede5 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:57.246316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502d7d1-a9c3-4b8f-b64d-ef2ad89b221e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:57.246953 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502d7d1-a9c3-4b8f-b64d-ef2ad89b221e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:57.247239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502d7d1-a9c3-4b8f-b64d-ef2ad89b221e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:57.247517 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502d7d1-a9c3-4b8f-b64d-ef2ad89b221e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:57.248342 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502d7d1-a9c3-4b8f-b64d-ef2ad89b221e None admin] RBAC: Adding query filter params (interface=admin, service_id=95fca7f7293e4206950a75864ac23413, region_id=RegionOne) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:57.248802 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502d7d1-a9c3-4b8f-b64d-ef2ad89b221e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:57.250204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502d7d1-a9c3-4b8f-b64d-ef2ad89b221e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:57.255674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 491/981] 10.222.0.75 () {56 vars in 1249 bytes} [Thu Jul 28 17:45:57 2022] GET /identity/v3/endpoints?service_id=95fca7f7293e4206950a75864ac23413&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:57.260966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502d7d1-a9c3-4b8f-b64d-ef2ad89b221e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:57.312999 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e6aa5-1c59-4798-91b5-274015a665ca None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:57.360659 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5c88f-16b8-4162-8590-29f45ff695b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:57.361346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5c88f-16b8-4162-8590-29f45ff695b1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:57.361632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5c88f-16b8-4162-8590-29f45ff695b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:57.361911 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5c88f-16b8-4162-8590-29f45ff695b1 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:57.362718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5c88f-16b8-4162-8590-29f45ff695b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:57.363028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5c88f-16b8-4162-8590-29f45ff695b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:57.364457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5c88f-16b8-4162-8590-29f45ff695b1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:57.383088 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 491/982] 10.222.0.75 () {56 vars in 1149 bytes} [Thu Jul 28 17:45:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:57.384180 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502d7d1-a9c3-4b8f-b64d-ef2ad89b221e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:57.388403 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5c88f-16b8-4162-8590-29f45ff695b1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:57.424381 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80678d7c-cbab-4fc6-ac2f-eee0ed5e1bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:57.425034 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80678d7c-cbab-4fc6-ac2f-eee0ed5e1bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:57.425316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80678d7c-cbab-4fc6-ac2f-eee0ed5e1bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:57.425589 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80678d7c-cbab-4fc6-ac2f-eee0ed5e1bd6 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:57.426236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80678d7c-cbab-4fc6-ac2f-eee0ed5e1bd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:57.427633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80678d7c-cbab-4fc6-ac2f-eee0ed5e1bd6 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:57.434097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 492/983] 10.222.0.75 () {56 vars in 1087 bytes} [Thu Jul 28 17:45:57 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:45:57.434924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:57.510429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5c88f-16b8-4162-8590-29f45ff695b1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:57.549712 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c258fc-b41f-4d63-ae2b-86710624a051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:57.550350 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c258fc-b41f-4d63-ae2b-86710624a051 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:57.550634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c258fc-b41f-4d63-ae2b-86710624a051 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:57.550908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c258fc-b41f-4d63-ae2b-86710624a051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:57.625049 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c258fc-b41f-4d63-ae2b-86710624a051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:57.626503 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c258fc-b41f-4d63-ae2b-86710624a051 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:57.667036 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:57.745613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 492/984] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:57 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 17:45:57.747947 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80678d7c-cbab-4fc6-ac2f-eee0ed5e1bd6 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:57.773422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730415e-8a5f-447b-a959-662bdc2a4438 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:57.773660 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730415e-8a5f-447b-a959-662bdc2a4438 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:57.773942 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730415e-8a5f-447b-a959-662bdc2a4438 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:57.775291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 493/985] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:57.778371 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:57.780780 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4df77e-7cef-46ae-b9ec-d4c039326739 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:57.781084 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4df77e-7cef-46ae-b9ec-d4c039326739 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:57.781360 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4df77e-7cef-46ae-b9ec-d4c039326739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:57.800279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-bf4df77e-7cef-46ae-b9ec-d4c039326739 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:57.801516 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bf4df77e-7cef-46ae-b9ec-d4c039326739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:57.875070 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80678d7c-cbab-4fc6-ac2f-eee0ed5e1bd6 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:57.896834 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 494/986] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:57.915844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4df77e-7cef-46ae-b9ec-d4c039326739 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:57.923973 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2a186-4701-4af6-b56c-ca8e26827023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:57.924637 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2a186-4701-4af6-b56c-ca8e26827023 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:57.924949 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2a186-4701-4af6-b56c-ca8e26827023 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:57.925745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2a186-4701-4af6-b56c-ca8e26827023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:57.936990 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2a186-4701-4af6-b56c-ca8e26827023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:57.938462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2a186-4701-4af6-b56c-ca8e26827023 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:57.953193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-b5c2a186-4701-4af6-b56c-ca8e26827023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:57.953193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:57.953193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:57.953193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:57.953193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:57.953193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:57.953193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:57.953193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:57.953193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:57.953193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:57.953193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:57.953193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:57.953193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:57.953193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:57.953193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:57.954424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:57.954424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:57.954424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:57.954424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:57.954424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:57.954424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:57.954424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:57.954424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:57.954424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:57.954424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:57.954424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:57.954424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:57.954424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:57.954424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:57.954424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:57.954424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:57.954424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:57.955318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:57.955318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:57.955318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:57.955318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:57.955318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 493/987] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:57.960091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2a186-4701-4af6-b56c-ca8e26827023 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:58.004707 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:58.041760 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4df77e-7cef-46ae-b9ec-d4c039326739 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:58.044454 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:58.071122 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2a186-4701-4af6-b56c-ca8e26827023 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:58.083709 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59024a-6588-495a-af15-b7295edda5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:58.084538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59024a-6588-495a-af15-b7295edda5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:58.084848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59024a-6588-495a-af15-b7295edda5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:58.085120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59024a-6588-495a-af15-b7295edda5d4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:58.085811 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59024a-6588-495a-af15-b7295edda5d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:58.087233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59024a-6588-495a-af15-b7295edda5d4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:58.096287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-ad59024a-6588-495a-af15-b7295edda5d4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:45:58.096287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:58.096287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:58.096287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:58.096287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:58.096287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:58.096287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:58.096287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:58.096287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:45:58.096287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:58.096287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:58.096287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:58.096287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:58.096287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:58.096287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:58.096287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:58.096287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:58.097476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:58.097476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:58.097476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:58.097476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:58.097476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:58.097476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:58.097476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:58.097476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:58.097476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:58.097476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:58.097476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:58.097476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:58.097476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:58.097476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:58.097476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:58.097476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:58.098316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:58.098316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:58.098316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:58.098316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:58.098316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:58.098316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:58.098316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:58.098316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:58.098316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:58.098316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:58.098316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:58.098316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:58.098316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:45:58.098316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:45:58.098316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 495/988] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:58.103415 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59024a-6588-495a-af15-b7295edda5d4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:58.109450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18460e-5a93-46b0-b3bc-ac2a68a52985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:58.110079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18460e-5a93-46b0-b3bc-ac2a68a52985 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:58.110356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18460e-5a93-46b0-b3bc-ac2a68a52985 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:58.110626 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18460e-5a93-46b0-b3bc-ac2a68a52985 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:58.111348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18460e-5a93-46b0-b3bc-ac2a68a52985 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:58.111652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18460e-5a93-46b0-b3bc-ac2a68a52985 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:58.113167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18460e-5a93-46b0-b3bc-ac2a68a52985 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:58.132121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 494/989] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:58.133644 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18460e-5a93-46b0-b3bc-ac2a68a52985 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:58.222540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59024a-6588-495a-af15-b7295edda5d4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:58.256568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18460e-5a93-46b0-b3bc-ac2a68a52985 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:58.262156 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a57f1-58fa-4de7-a966-bb66b6156379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:58.262779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a57f1-58fa-4de7-a966-bb66b6156379 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:58.263057 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a57f1-58fa-4de7-a966-bb66b6156379 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:58.263328 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a57f1-58fa-4de7-a966-bb66b6156379 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:58.264007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a57f1-58fa-4de7-a966-bb66b6156379 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:58.264379 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a57f1-58fa-4de7-a966-bb66b6156379 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:58.265830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a57f1-58fa-4de7-a966-bb66b6156379 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:58.267023 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:58.272719 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 496/990] 10.222.0.75 () {56 vars in 1112 bytes} [Thu Jul 28 17:45:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:58.278525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a57f1-58fa-4de7-a966-bb66b6156379 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:58.298198 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84839438-3d62-4f1e-a3c9-b393a7089704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:58.298775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84839438-3d62-4f1e-a3c9-b393a7089704 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:58.299143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84839438-3d62-4f1e-a3c9-b393a7089704 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:58.299420 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84839438-3d62-4f1e-a3c9-b393a7089704 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:58.301457 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:58.308662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84839438-3d62-4f1e-a3c9-b393a7089704 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:58.309862 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84839438-3d62-4f1e-a3c9-b393a7089704 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:58.321850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-84839438-3d62-4f1e-a3c9-b393a7089704 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:58.321850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:58.321850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:58.321850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:58.321850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:58.321850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:58.321850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:58.321850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:58.321850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:58.321850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:58.321850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:58.321850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:58.321850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:58.321850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:58.321850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:58.323027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:58.323027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:58.323027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:58.323027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:58.323027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:58.323027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:58.323027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:58.323027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:58.323027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:58.323027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:58.323027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:58.323027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:58.323027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:58.323027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:58.323027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:58.323027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:58.323027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:58.323923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:58.323923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:58.323923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:58.323923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:58.323923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:58.323923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:58.323923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:58.323923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:58.328036 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 495/991] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:58.330175 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84839438-3d62-4f1e-a3c9-b393a7089704 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:58.418026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a57f1-58fa-4de7-a966-bb66b6156379 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:58.449190 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84839438-3d62-4f1e-a3c9-b393a7089704 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:58.457262 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18636270-d8ad-4e53-9287-54f2f58b4276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:58.458063 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18636270-d8ad-4e53-9287-54f2f58b4276 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:58.458452 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18636270-d8ad-4e53-9287-54f2f58b4276 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:58.459187 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18636270-d8ad-4e53-9287-54f2f58b4276 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:58.459855 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18636270-d8ad-4e53-9287-54f2f58b4276 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:58.460490 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18636270-d8ad-4e53-9287-54f2f58b4276 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:58.461897 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18636270-d8ad-4e53-9287-54f2f58b4276 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:58.466877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 497/992] 10.222.0.75 () {56 vars in 1112 bytes} [Thu Jul 28 17:45:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:58.473913 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18636270-d8ad-4e53-9287-54f2f58b4276 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:58.485774 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14199f26-3174-4872-b166-f2d1e7ca6c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:58.486321 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14199f26-3174-4872-b166-f2d1e7ca6c88 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:58.486601 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14199f26-3174-4872-b166-f2d1e7ca6c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:58.486875 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14199f26-3174-4872-b166-f2d1e7ca6c88 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:58.487691 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14199f26-3174-4872-b166-f2d1e7ca6c88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:58.487928 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14199f26-3174-4872-b166-f2d1e7ca6c88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:58.489442 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14199f26-3174-4872-b166-f2d1e7ca6c88 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:58.506186 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 496/993] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:58.507775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14199f26-3174-4872-b166-f2d1e7ca6c88 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:58.544146 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:58.569523 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:58.589121 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18636270-d8ad-4e53-9287-54f2f58b4276 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:58.616324 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14199f26-3174-4872-b166-f2d1e7ca6c88 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:58.627218 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43587ef-9bcd-4885-b03a-2d1787c08891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:58.627846 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43587ef-9bcd-4885-b03a-2d1787c08891 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:58.628129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43587ef-9bcd-4885-b03a-2d1787c08891 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:58.628405 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43587ef-9bcd-4885-b03a-2d1787c08891 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:58.629211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43587ef-9bcd-4885-b03a-2d1787c08891 None admin] RBAC: Adding query filter params (interface=public, service_id=af53947dd0d54641bb3c03411a0024f6, region_id=RegionOne) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:58.629511 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43587ef-9bcd-4885-b03a-2d1787c08891 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:58.630916 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43587ef-9bcd-4885-b03a-2d1787c08891 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:58.636293 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 498/994] 10.222.0.75 () {56 vars in 1251 bytes} [Thu Jul 28 17:45:58 2022] GET /identity/v3/endpoints?service_id=af53947dd0d54641bb3c03411a0024f6&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:58.642088 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43587ef-9bcd-4885-b03a-2d1787c08891 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:58.654372 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234de51-39b8-4e22-993c-2ea7fafa212f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:58.655857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234de51-39b8-4e22-993c-2ea7fafa212f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:58.656300 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234de51-39b8-4e22-993c-2ea7fafa212f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:58.656582 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234de51-39b8-4e22-993c-2ea7fafa212f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:58.657406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234de51-39b8-4e22-993c-2ea7fafa212f None admin] RBAC: Adding query filter params (role.id=4a747c3694f44616b8ca0dae0fea435f, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=1cbbfdda843a4ab98ff9cf0742513f44) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:58.657723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234de51-39b8-4e22-993c-2ea7fafa212f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:58.659186 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234de51-39b8-4e22-993c-2ea7fafa212f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:58.666433 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 497/995] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:58 2022] GET /identity/v3/role_assignments?user.id=1cbbfdda843a4ab98ff9cf0742513f44&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=4a747c3694f44616b8ca0dae0fea435f => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:58.756580 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43587ef-9bcd-4885-b03a-2d1787c08891 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:58.786052 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:58.795973 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a85d50-b25a-4918-95e6-db992c267c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:58.797141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a85d50-b25a-4918-95e6-db992c267c21 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:58.797141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a85d50-b25a-4918-95e6-db992c267c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:58.797303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a85d50-b25a-4918-95e6-db992c267c21 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:58.797945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a85d50-b25a-4918-95e6-db992c267c21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:58.799332 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a85d50-b25a-4918-95e6-db992c267c21 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:58.806412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 499/996] 10.222.0.75 () {56 vars in 1087 bytes} [Thu Jul 28 17:45:58 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:45:59.493053 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becef77f-d6ee-43f2-b773-3c39435e7d34 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:59.493600 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becef77f-d6ee-43f2-b773-3c39435e7d34 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:59.493600 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becef77f-d6ee-43f2-b773-3c39435e7d34 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:59.496796 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 498/997] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:59.500466 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20694eb3-39c3-46b2-b07a-052c6c5775bf None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:59.500786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20694eb3-39c3-46b2-b07a-052c6c5775bf None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:59.501067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20694eb3-39c3-46b2-b07a-052c6c5775bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:59.519906 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-20694eb3-39c3-46b2-b07a-052c6c5775bf None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:59.521148 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-20694eb3-39c3-46b2-b07a-052c6c5775bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:59.596871 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 500/998] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:59.615261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becef77f-d6ee-43f2-b773-3c39435e7d34 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:59.718836 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becef77f-d6ee-43f2-b773-3c39435e7d34 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:59.738972 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:59.756598 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccdc33-945b-4281-957a-6ba54028e622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:59.757277 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccdc33-945b-4281-957a-6ba54028e622 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:59.757558 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccdc33-945b-4281-957a-6ba54028e622 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:59.757831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccdc33-945b-4281-957a-6ba54028e622 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:59.758450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccdc33-945b-4281-957a-6ba54028e622 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:59.759840 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccdc33-945b-4281-957a-6ba54028e622 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:59.769256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-62ccdc33-945b-4281-957a-6ba54028e622 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:45:59.769256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:59.769256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:59.769256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:59.769256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:59.769256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:59.769256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:59.769256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:59.769256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:45:59.769256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:59.769256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:59.769256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:59.769256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:59.769256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:59.769256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:59.769256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:59.769256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:59.770227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:59.770227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:59.770227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:59.770227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:59.770227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:59.770227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:59.770227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:59.770227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:59.770227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:59.770227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:59.770227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:59.770227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:59.770227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:59.770227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:59.770227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:59.770227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:59.771098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:59.771098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:59.771098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:59.771098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:59.771098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:59.771098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:59.771098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:59.771098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:59.771098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:59.771098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:59.771098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:59.771098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:59.771098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:45:59.771098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:45:59.773563 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 499/999] 10.222.0.75 () {56 vars in 1126 bytes} [Thu Jul 28 17:45:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:59.777008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20694eb3-39c3-46b2-b07a-052c6c5775bf None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:59.884165 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20694eb3-39c3-46b2-b07a-052c6c5775bf None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:59.905969 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:59.920125 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d9810-a6ab-4c10-bdfa-aee40cb9b97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:59.921440 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d9810-a6ab-4c10-bdfa-aee40cb9b97e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:59.921718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d9810-a6ab-4c10-bdfa-aee40cb9b97e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:59.921989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d9810-a6ab-4c10-bdfa-aee40cb9b97e None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:59.922698 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d9810-a6ab-4c10-bdfa-aee40cb9b97e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:59.923010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d9810-a6ab-4c10-bdfa-aee40cb9b97e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:59.924800 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d9810-a6ab-4c10-bdfa-aee40cb9b97e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:59.934753 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 501/1000] 10.222.0.75 () {56 vars in 1122 bytes} [Thu Jul 28 17:45:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:59.936163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccdc33-945b-4281-957a-6ba54028e622 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:00.037743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccdc33-945b-4281-957a-6ba54028e622 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:00.070822 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e0af1-5dc0-4194-8915-174338c4bd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:00.071443 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e0af1-5dc0-4194-8915-174338c4bd55 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:00.071720 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e0af1-5dc0-4194-8915-174338c4bd55 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:00.071994 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e0af1-5dc0-4194-8915-174338c4bd55 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:00.072675 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e0af1-5dc0-4194-8915-174338c4bd55 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:00.073009 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e0af1-5dc0-4194-8915-174338c4bd55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:00.074395 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e0af1-5dc0-4194-8915-174338c4bd55 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:00.079300 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 500/1001] 10.222.0.75 () {56 vars in 1122 bytes} [Thu Jul 28 17:45:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:00.084811 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d9810-a6ab-4c10-bdfa-aee40cb9b97e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:00.184436 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d9810-a6ab-4c10-bdfa-aee40cb9b97e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:00.218412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481c08c-30bd-450f-ac72-5d93024629c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:00.219036 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481c08c-30bd-450f-ac72-5d93024629c3 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:00.219315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481c08c-30bd-450f-ac72-5d93024629c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:00.219586 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481c08c-30bd-450f-ac72-5d93024629c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:00.220307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481c08c-30bd-450f-ac72-5d93024629c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:00.221690 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481c08c-30bd-450f-ac72-5d93024629c3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:00.306463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 502/1002] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 17:46:00 2022] POST /identity/v3/endpoints => generated 325 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:46:00.753308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a05b4b-9c44-4781-af5d-d7fa2cc22a6b None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:00.753836 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a05b4b-9c44-4781-af5d-d7fa2cc22a6b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:00.755628 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a05b4b-9c44-4781-af5d-d7fa2cc22a6b None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:00.757434 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 501/1003] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:00.763103 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac88989-ae68-432d-a94f-81f532281c1a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:00.763598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac88989-ae68-432d-a94f-81f532281c1a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:00.763680 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac88989-ae68-432d-a94f-81f532281c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:00.783315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7ac88989-ae68-432d-a94f-81f532281c1a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:00.784505 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7ac88989-ae68-432d-a94f-81f532281c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:00.825949 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:00.829590 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f6d1b-342a-4d87-a413-ebc513781069 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:00.829876 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f6d1b-342a-4d87-a413-ebc513781069 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:00.830149 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f6d1b-342a-4d87-a413-ebc513781069 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:00.831630 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 502/1004] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:00.836426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f375b-b1f4-4a31-959a-d8ffddd399ea None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:00.836713 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f375b-b1f4-4a31-959a-d8ffddd399ea None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:00.837132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f375b-b1f4-4a31-959a-d8ffddd399ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:00.855712 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-1c5f375b-b1f4-4a31-959a-d8ffddd399ea None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:00.857274 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1c5f375b-b1f4-4a31-959a-d8ffddd399ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:00.865946 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 503/1005] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:00 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:00.887942 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac88989-ae68-432d-a94f-81f532281c1a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:00.906777 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:00.936791 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 503/1006] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:00 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:46:00.956116 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f375b-b1f4-4a31-959a-d8ffddd399ea None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:00.992261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac88989-ae68-432d-a94f-81f532281c1a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:01.027413 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2342cb-4778-4526-8cf4-9420b344d89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:01.027981 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2342cb-4778-4526-8cf4-9420b344d89b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:01.028258 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2342cb-4778-4526-8cf4-9420b344d89b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:01.028533 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2342cb-4778-4526-8cf4-9420b344d89b None admin] PATH_INFO: `/v3/services/image` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:01.029190 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2342cb-4778-4526-8cf4-9420b344d89b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:01.031224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2342cb-4778-4526-8cf4-9420b344d89b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:01.040182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-cd2342cb-4778-4526-8cf4-9420b344d89b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:46:01.040182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:01.040182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:46:01.040182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:46:01.040182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:46:01.040182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:46:01.040182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:46:01.040182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:46:01.040182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:46:01.040182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:01.040182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:46:01.040182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:01.040182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:01.040182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:01.040182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:01.040182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:01.040182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:01.041276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:01.041276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:01.041276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:01.041276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:01.041276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:01.041276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:01.041276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:46:01.041276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:46:01.041276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:46:01.041276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:46:01.041276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:01.041276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:01.041276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:01.041276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:01.041276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:01.041276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:01.042129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:01.042129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:01.042129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:01.042129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:01.042129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:01.042129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:01.042129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:01.042129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:01.042129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:01.042129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:01.042129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:46:01.042129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:46:01.042129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:46:01.042129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:01.042129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 504/1007] 10.222.0.75 () {56 vars in 1105 bytes} [Thu Jul 28 17:46:00 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:46:01.047769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2342cb-4778-4526-8cf4-9420b344d89b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:01.068999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f375b-b1f4-4a31-959a-d8ffddd399ea None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:01.093468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:01.107264 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a64127-2348-489e-a931-eb9e899f9987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:01.107974 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a64127-2348-489e-a931-eb9e899f9987 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:01.108251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a64127-2348-489e-a931-eb9e899f9987 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:01.108531 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a64127-2348-489e-a931-eb9e899f9987 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:01.109176 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a64127-2348-489e-a931-eb9e899f9987 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:01.116458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a64127-2348-489e-a931-eb9e899f9987 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:01.126296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-77a64127-2348-489e-a931-eb9e899f9987 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:46:01.126296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:01.126296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:46:01.126296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:46:01.126296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:46:01.126296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:46:01.126296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:46:01.126296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:46:01.126296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:46:01.126296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:46:01.126296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:46:01.126296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:46:01.126296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:01.126296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:01.126296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:01.126296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:01.126296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:01.127391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:01.127391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:01.127391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:01.127391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:01.127391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:01.127391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:01.127391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:46:01.127391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:46:01.127391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:46:01.127391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:46:01.127391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:01.127391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:01.127391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:01.127391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:01.127391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:01.127391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:01.128261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:01.128261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:01.128261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:01.128261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:01.128261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:01.128261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:01.128261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:01.128261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:01.128261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:01.128261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:01.128261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:46:01.128261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:46:01.128261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:46:01.128261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:46:01.128261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 504/1008] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:46:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:46:01.135321 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a64127-2348-489e-a931-eb9e899f9987 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:01.179994 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:01.187265 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2342cb-4778-4526-8cf4-9420b344d89b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:01.223636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db5c2a-5ff4-4432-b97f-1a73928c4ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:01.224253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db5c2a-5ff4-4432-b97f-1a73928c4ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:01.224533 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db5c2a-5ff4-4432-b97f-1a73928c4ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:01.224830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db5c2a-5ff4-4432-b97f-1a73928c4ce8 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:01.225506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db5c2a-5ff4-4432-b97f-1a73928c4ce8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:01.225809 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db5c2a-5ff4-4432-b97f-1a73928c4ce8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:01.227164 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db5c2a-5ff4-4432-b97f-1a73928c4ce8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:01.232289 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 505/1009] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:01.237816 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db5c2a-5ff4-4432-b97f-1a73928c4ce8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:01.242195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a64127-2348-489e-a931-eb9e899f9987 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:01.278209 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ff752-26b2-4ae7-82ca-a44356effb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:01.278764 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ff752-26b2-4ae7-82ca-a44356effb84 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:01.279039 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ff752-26b2-4ae7-82ca-a44356effb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:01.279303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ff752-26b2-4ae7-82ca-a44356effb84 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:01.280532 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ff752-26b2-4ae7-82ca-a44356effb84 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:01.280859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ff752-26b2-4ae7-82ca-a44356effb84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:01.282318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ff752-26b2-4ae7-82ca-a44356effb84 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:01.287585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 505/1010] 10.222.0.75 () {56 vars in 1112 bytes} [Thu Jul 28 17:46:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:01.293121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ff752-26b2-4ae7-82ca-a44356effb84 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:01.349839 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:01.354204 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db5c2a-5ff4-4432-b97f-1a73928c4ce8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:01.391801 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1510160-058a-461e-824e-61f44aaec7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:01.392439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1510160-058a-461e-824e-61f44aaec7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:01.392721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1510160-058a-461e-824e-61f44aaec7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:01.393040 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1510160-058a-461e-824e-61f44aaec7e9 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:01.393728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1510160-058a-461e-824e-61f44aaec7e9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:01.394038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1510160-058a-461e-824e-61f44aaec7e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:01.395403 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1510160-058a-461e-824e-61f44aaec7e9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:01.399173 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ff752-26b2-4ae7-82ca-a44356effb84 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:01.400369 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 506/1011] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:01 2022] GET /identity/v3/services?type=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:01.402447 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:01.442197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21939f30-5be3-4864-adaf-570d26a0416a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:01.443288 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21939f30-5be3-4864-adaf-570d26a0416a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:01.444066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21939f30-5be3-4864-adaf-570d26a0416a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:01.444400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21939f30-5be3-4864-adaf-570d26a0416a None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:01.445214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21939f30-5be3-4864-adaf-570d26a0416a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:01.445585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21939f30-5be3-4864-adaf-570d26a0416a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:01.447052 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21939f30-5be3-4864-adaf-570d26a0416a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:01.452999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 506/1012] 10.222.0.75 () {56 vars in 1112 bytes} [Thu Jul 28 17:46:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:01.458756 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1510160-058a-461e-824e-61f44aaec7e9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:01.577393 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1510160-058a-461e-824e-61f44aaec7e9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:01.613372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608de2f-0a52-44f1-ae97-b550c9955b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:01.614001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608de2f-0a52-44f1-ae97-b550c9955b6d None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:01.614281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608de2f-0a52-44f1-ae97-b550c9955b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:01.614554 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608de2f-0a52-44f1-ae97-b550c9955b6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:01.615280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608de2f-0a52-44f1-ae97-b550c9955b6d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:01.616791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608de2f-0a52-44f1-ae97-b550c9955b6d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:01.712160 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 507/1013] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 17:46:01 2022] POST /identity/v3/endpoints => generated 334 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:46:02.325339 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0328cf1-ca1b-4e2e-8de5-38d83d1d8e23 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:02.325861 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0328cf1-ca1b-4e2e-8de5-38d83d1d8e23 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:02.325971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0328cf1-ca1b-4e2e-8de5-38d83d1d8e23 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:02.327445 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 507/1014] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:02.332339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b95888-4e2d-48e2-9edb-e9a15fe7a799 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:02.332728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b95888-4e2d-48e2-9edb-e9a15fe7a799 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:02.332952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b95888-4e2d-48e2-9edb-e9a15fe7a799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:02.353597 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-52b95888-4e2d-48e2-9edb-e9a15fe7a799 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:02.354787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-52b95888-4e2d-48e2-9edb-e9a15fe7a799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:02.369426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:02.431454 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 508/1015] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:02 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:02.454217 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0328cf1-ca1b-4e2e-8de5-38d83d1d8e23 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:02.563428 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0328cf1-ca1b-4e2e-8de5-38d83d1d8e23 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:02.598467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21174077-0319-48e3-9c8d-122da48dbe08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:02.599031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21174077-0319-48e3-9c8d-122da48dbe08 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:02.599553 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21174077-0319-48e3-9c8d-122da48dbe08 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:02.599778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21174077-0319-48e3-9c8d-122da48dbe08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:02.600952 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21174077-0319-48e3-9c8d-122da48dbe08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:02.602415 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21174077-0319-48e3-9c8d-122da48dbe08 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:02.608793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 508/1016] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:02.609913 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b95888-4e2d-48e2-9edb-e9a15fe7a799 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:02.718873 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b95888-4e2d-48e2-9edb-e9a15fe7a799 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:02.752991 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54604e-69b7-45fc-bca6-7eafc424bcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:02.753615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54604e-69b7-45fc-bca6-7eafc424bcf7 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:02.753899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54604e-69b7-45fc-bca6-7eafc424bcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:02.754175 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54604e-69b7-45fc-bca6-7eafc424bcf7 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:02.754865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54604e-69b7-45fc-bca6-7eafc424bcf7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:02.756293 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54604e-69b7-45fc-bca6-7eafc424bcf7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:02.772270 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:02.881572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 509/1017] 10.222.0.75 () {60 vars in 1141 bytes} [Thu Jul 28 17:46:02 2022] POST /identity/v3/projects => generated 311 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:46:03.469141 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0212cc-2bbf-4761-ab2a-af8c5b8b63c7 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:03.469689 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0212cc-2bbf-4761-ab2a-af8c5b8b63c7 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:03.469689 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0212cc-2bbf-4761-ab2a-af8c5b8b63c7 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:03.471211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 509/1018] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:03.476114 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc029036-d33b-429e-ad1d-e30a7568fb7e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:03.476503 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc029036-d33b-429e-ad1d-e30a7568fb7e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:03.476663 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc029036-d33b-429e-ad1d-e30a7568fb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:03.495310 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-bc029036-d33b-429e-ad1d-e30a7568fb7e None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:03.496498 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bc029036-d33b-429e-ad1d-e30a7568fb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:03.567042 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 510/1019] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:03 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:03.589603 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0212cc-2bbf-4761-ab2a-af8c5b8b63c7 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:03.629462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:03.696292 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0212cc-2bbf-4761-ab2a-af8c5b8b63c7 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:03.730733 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d20a99-99d8-4b10-970b-c91c0ab98aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:03.731355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d20a99-99d8-4b10-970b-c91c0ab98aa0 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:03.731636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d20a99-99d8-4b10-970b-c91c0ab98aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:03.731910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d20a99-99d8-4b10-970b-c91c0ab98aa0 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:03.733170 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d20a99-99d8-4b10-970b-c91c0ab98aa0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:03.734562 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d20a99-99d8-4b10-970b-c91c0ab98aa0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:03.823313 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905cd38-e971-4b7f-81c2-c7ae923b18ef None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:03.823602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905cd38-e971-4b7f-81c2-c7ae923b18ef None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:03.823928 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905cd38-e971-4b7f-81c2-c7ae923b18ef None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:03.825377 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 511/1020] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:03.830062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ed3c3-d510-4b84-b6ab-daf712985640 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:03.830348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ed3c3-d510-4b84-b6ab-daf712985640 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:03.830622 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ed3c3-d510-4b84-b6ab-daf712985640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:03.849353 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 510/1021] 10.222.0.75 () {60 vars in 1141 bytes} [Thu Jul 28 17:46:03 2022] POST /identity/v3/services => generated 242 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:46:03.850037 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-857ed3c3-d510-4b84-b6ab-daf712985640 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:03.851216 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-857ed3c3-d510-4b84-b6ab-daf712985640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:03.948782 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 512/1022] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:46:03.966725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d20a99-99d8-4b10-970b-c91c0ab98aa0 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:04.075268 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:04.082234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d20a99-99d8-4b10-970b-c91c0ab98aa0 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:04.115970 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3e629-b1cc-4b4a-a8ee-1c26241495ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:04.117162 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3e629-b1cc-4b4a-a8ee-1c26241495ee None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:04.117797 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3e629-b1cc-4b4a-a8ee-1c26241495ee None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:04.118636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3e629-b1cc-4b4a-a8ee-1c26241495ee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:04.129981 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3e629-b1cc-4b4a-a8ee-1c26241495ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:46:04.134996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-62c3e629-b1cc-4b4a-a8ee-1c26241495ee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:46:04.134996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:04.134996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:04.134996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:04.134996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:04.134996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:04.134996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:04.134996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:04.134996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:04.134996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:04.134996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:04.134996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:04.134996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:46:04.134996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:46:04.134996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:46:04.134996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:46:04.135942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:46:04.135942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:46:04.135942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:46:04.135942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:46:04.135942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:04.135942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:04.135942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:04.135942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:04.135942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:04.135942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:04.135942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:04.135942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:04.135942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:04.135942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:04.135942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:04.135942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:04.137496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:04.137496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:04.137496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:04.137496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:04.137496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:46:04.137496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:46:04.137496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:46:04.137496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:46:04.137496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:46:04.137496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:46:04.137496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:46:04.137496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:46:04.137496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 511/1023] 10.222.0.75 () {56 vars in 1120 bytes} [Thu Jul 28 17:46:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:46:04.142359 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ed3c3-d510-4b84-b6ab-daf712985640 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:04.196906 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:04.245265 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ed3c3-d510-4b84-b6ab-daf712985640 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:04.281264 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9497651-e827-4008-92f5-e9c414b4d6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:04.282118 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9497651-e827-4008-92f5-e9c414b4d6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:04.282605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9497651-e827-4008-92f5-e9c414b4d6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:04.283094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9497651-e827-4008-92f5-e9c414b4d6a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:04.283976 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9497651-e827-4008-92f5-e9c414b4d6a3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:04.284431 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9497651-e827-4008-92f5-e9c414b4d6a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:04.285971 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9497651-e827-4008-92f5-e9c414b4d6a3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:04.299498 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 513/1024] 10.222.0.75 () {56 vars in 1115 bytes} [Thu Jul 28 17:46:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:04.300961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3e629-b1cc-4b4a-a8ee-1c26241495ee None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:04.411716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3e629-b1cc-4b4a-a8ee-1c26241495ee None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:04.446125 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad58bcf-95ba-464b-a608-3ab8629e35a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:04.446767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad58bcf-95ba-464b-a608-3ab8629e35a9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:04.447042 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad58bcf-95ba-464b-a608-3ab8629e35a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:04.447313 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad58bcf-95ba-464b-a608-3ab8629e35a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:04.458975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad58bcf-95ba-464b-a608-3ab8629e35a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:04.460454 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad58bcf-95ba-464b-a608-3ab8629e35a9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:04.475159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-2ad58bcf-95ba-464b-a608-3ab8629e35a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:46:04.475159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:04.475159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:04.475159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:04.475159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:04.475159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:04.475159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:04.475159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:04.475159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:04.475159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:04.475159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:04.475159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:04.475159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:46:04.475159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:46:04.475159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:46:04.476509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:46:04.476509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:04.476509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:04.476509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:04.476509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:04.476509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:04.476509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:04.476509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:04.476509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:04.476509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:04.476509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:04.476509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:04.476509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:04.476509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:04.476509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:04.476509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:04.476509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:04.477436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:46:04.477436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:46:04.477436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:46:04.477436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:46:04.477436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 512/1025] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:04.484900 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9497651-e827-4008-92f5-e9c414b4d6a3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:04.591397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9497651-e827-4008-92f5-e9c414b4d6a3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:04.605699 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:04.627211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbefa2-784f-46d3-9532-50932a6eb4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:04.627830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbefa2-784f-46d3-9532-50932a6eb4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:04.628111 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbefa2-784f-46d3-9532-50932a6eb4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:04.628383 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbefa2-784f-46d3-9532-50932a6eb4d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:04.629123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbefa2-784f-46d3-9532-50932a6eb4d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:04.629429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbefa2-784f-46d3-9532-50932a6eb4d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:04.630791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbefa2-784f-46d3-9532-50932a6eb4d9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:04.644427 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 514/1026] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:04.649544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad58bcf-95ba-464b-a608-3ab8629e35a9 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:04.662284 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:04.751107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad58bcf-95ba-464b-a608-3ab8629e35a9 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:04.785564 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e47e9-6e30-4a6a-a7ba-a6d1ca6ee030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:04.786206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e47e9-6e30-4a6a-a7ba-a6d1ca6ee030 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:04.786489 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e47e9-6e30-4a6a-a7ba-a6d1ca6ee030 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:04.786868 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e47e9-6e30-4a6a-a7ba-a6d1ca6ee030 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:04.794655 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e47e9-6e30-4a6a-a7ba-a6d1ca6ee030 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:04.796153 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e47e9-6e30-4a6a-a7ba-a6d1ca6ee030 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:04.807432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-157e47e9-6e30-4a6a-a7ba-a6d1ca6ee030 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:46:04.807432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:04.807432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:04.807432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:04.807432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:04.807432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:04.807432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:04.807432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:04.807432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:04.807432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:04.807432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:04.807432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:04.807432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:46:04.807432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:46:04.807432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:46:04.807432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:46:04.808376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:04.808376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:04.808376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:46:04.808376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:46:04.808376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:46:04.808376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:46:04.808376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:04.808376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:04.808376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:04.808376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:04.808376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:04.808376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:04.808376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:04.808376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:04.808376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:04.808376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:04.808376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:04.808376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:04.809399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:04.809399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:04.809399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:46:04.809399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:46:04.809399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:46:04.809399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:46:04.809399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:46:04.809399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:46:04.809399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:46:04.809399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:46:04.809399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 513/1027] 10.222.0.75 () {56 vars in 1093 bytes} [Thu Jul 28 17:46:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:46:04.816055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbefa2-784f-46d3-9532-50932a6eb4d9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:04.917546 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbefa2-784f-46d3-9532-50932a6eb4d9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:04.953190 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e576a-011e-462b-ae03-2c8665d511b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:04.953819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e576a-011e-462b-ae03-2c8665d511b5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:04.954100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e576a-011e-462b-ae03-2c8665d511b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:04.954375 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e576a-011e-462b-ae03-2c8665d511b5 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:04.955195 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e576a-011e-462b-ae03-2c8665d511b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:04.955506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e576a-011e-462b-ae03-2c8665d511b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:04.956956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e576a-011e-462b-ae03-2c8665d511b5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:04.962372 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cd4f7-103d-497e-beb1-2f2c5f564f87 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:04.962668 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cd4f7-103d-497e-beb1-2f2c5f564f87 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:04.962951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cd4f7-103d-497e-beb1-2f2c5f564f87 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:04.964436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 514/1028] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:46:04.970134 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f12857-b3da-45ff-887d-f3be5c06f63f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:04.970416 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f12857-b3da-45ff-887d-f3be5c06f63f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:04.970694 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f12857-b3da-45ff-887d-f3be5c06f63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:04.977487 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 515/1029] 10.222.0.75 () {56 vars in 1133 bytes} [Thu Jul 28 17:46:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:04.983129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e576a-011e-462b-ae03-2c8665d511b5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:04.991674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-84f12857-b3da-45ff-887d-f3be5c06f63f None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:04.993341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-84f12857-b3da-45ff-887d-f3be5c06f63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:05.016125 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:05.063629 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:05.071631 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 515/1030] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:46:05.091920 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e576a-011e-462b-ae03-2c8665d511b5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:05.096190 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f12857-b3da-45ff-887d-f3be5c06f63f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:05.129162 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e3c12-e1fc-47bb-a47b-fdc7ddfd6f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:05.130214 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3c12-e1fc-47bb-a47b-fdc7ddfd6f48 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:05.130731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3c12-e1fc-47bb-a47b-fdc7ddfd6f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:05.131069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3c12-e1fc-47bb-a47b-fdc7ddfd6f48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:05.199698 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f12857-b3da-45ff-887d-f3be5c06f63f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:05.202954 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e3c12-e1fc-47bb-a47b-fdc7ddfd6f48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:05.204419 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e3c12-e1fc-47bb-a47b-fdc7ddfd6f48 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:05.235188 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:05.237317 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eac344-def8-4f2a-abad-ca2bb822f23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:05.237976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eac344-def8-4f2a-abad-ca2bb822f23a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:05.238404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eac344-def8-4f2a-abad-ca2bb822f23a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:05.238684 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eac344-def8-4f2a-abad-ca2bb822f23a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:05.240616 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eac344-def8-4f2a-abad-ca2bb822f23a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:05.242118 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eac344-def8-4f2a-abad-ca2bb822f23a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:05.249679 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 516/1031] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:05.250996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eac344-def8-4f2a-abad-ca2bb822f23a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:05.306540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 516/1032] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:46:04 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:46:05.312460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e3c12-e1fc-47bb-a47b-fdc7ddfd6f48 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:05.330472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:05.365945 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eac344-def8-4f2a-abad-ca2bb822f23a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:05.405279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f969a99-c67f-4830-b9cb-e1d8fb352894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:05.406279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f969a99-c67f-4830-b9cb-e1d8fb352894 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:05.406279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f969a99-c67f-4830-b9cb-e1d8fb352894 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:05.406533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f969a99-c67f-4830-b9cb-e1d8fb352894 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:05.407236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f969a99-c67f-4830-b9cb-e1d8fb352894 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:05.408709 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f969a99-c67f-4830-b9cb-e1d8fb352894 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:05.426657 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e3c12-e1fc-47bb-a47b-fdc7ddfd6f48 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:05.457080 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:05.462419 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6c7da-f983-4bd4-b8bf-1903391d826b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:05.463075 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6c7da-f983-4bd4-b8bf-1903391d826b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:05.463351 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6c7da-f983-4bd4-b8bf-1903391d826b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:05.465816 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6c7da-f983-4bd4-b8bf-1903391d826b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:05.476393 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6c7da-f983-4bd4-b8bf-1903391d826b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:05.477993 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6c7da-f983-4bd4-b8bf-1903391d826b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:05.493244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-97f6c7da-f983-4bd4-b8bf-1903391d826b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:46:05.493244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:05.493244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:05.493244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:05.493244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:05.493244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:05.493244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:05.493244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:05.493244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:05.493244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:05.493244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:05.493244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:05.493244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:46:05.493244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:46:05.493244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:46:05.494630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:46:05.494630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:05.494630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:05.494630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:05.494630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:05.494630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:05.494630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:05.494630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:05.494630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:05.494630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:05.494630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:05.494630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:05.494630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:05.494630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:05.494630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:05.494630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:05.494630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:05.495607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:46:05.495607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:46:05.495607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:46:05.495607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:05.495607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 517/1033] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:05.500666 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6c7da-f983-4bd4-b8bf-1903391d826b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:05.503326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 517/1034] 10.222.0.75 () {60 vars in 1132 bytes} [Thu Jul 28 17:46:05 2022] POST /identity/v3/users => generated 285 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:46:05.625435 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6c7da-f983-4bd4-b8bf-1903391d826b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:05.665925 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846172b-cfc7-463b-b576-24ec0538dbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:05.666209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846172b-cfc7-463b-b576-24ec0538dbda None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:05.666501 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846172b-cfc7-463b-b576-24ec0538dbda None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:05.666779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846172b-cfc7-463b-b576-24ec0538dbda None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:05.667488 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846172b-cfc7-463b-b576-24ec0538dbda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:05.667798 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846172b-cfc7-463b-b576-24ec0538dbda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:05.669208 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846172b-cfc7-463b-b576-24ec0538dbda None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:05.683859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 518/1035] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:05.690450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f969a99-c67f-4830-b9cb-e1d8fb352894 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:05.811710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f969a99-c67f-4830-b9cb-e1d8fb352894 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:05.851359 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:05.864020 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91aa688-4e3c-4d7c-a8f4-a3690815b0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:05.867993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aa688-4e3c-4d7c-a8f4-a3690815b0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:05.867993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aa688-4e3c-4d7c-a8f4-a3690815b0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:05.867993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aa688-4e3c-4d7c-a8f4-a3690815b0d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:05.872491 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91aa688-4e3c-4d7c-a8f4-a3690815b0d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:05.874037 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91aa688-4e3c-4d7c-a8f4-a3690815b0d7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:05.885591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-e91aa688-4e3c-4d7c-a8f4-a3690815b0d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:46:05.885591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:05.885591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:05.885591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:05.885591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:05.885591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:05.885591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:05.885591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:05.885591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:05.885591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:05.885591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:05.885591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:05.885591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:46:05.885591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:46:05.885591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:46:05.886506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:46:05.886506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:05.886506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:05.886506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:05.886506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:05.886506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:05.886506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:05.886506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:05.886506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:05.886506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:05.886506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:05.886506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:05.886506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:05.886506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:05.886506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:05.886506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:05.886506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:05.887821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:46:05.887821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:46:05.887821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:46:05.887821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:46:05.887821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:46:05.887821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:46:05.887821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:46:05.887821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:46:05.887821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 518/1036] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:46:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:05.893003 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846172b-cfc7-463b-b576-24ec0538dbda None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:05.921323 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d993ef-2f85-4dea-a49f-d31eab4cab06 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:05.921323 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d993ef-2f85-4dea-a49f-d31eab4cab06 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:05.921878 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d993ef-2f85-4dea-a49f-d31eab4cab06 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:05.923726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 519/1037] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:46:05.928902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d5e08-dc22-4cd1-baeb-497e0635d300 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:05.929363 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d5e08-dc22-4cd1-baeb-497e0635d300 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:05.929646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d5e08-dc22-4cd1-baeb-497e0635d300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:05.944067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:05.949816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-af7d5e08-dc22-4cd1-baeb-497e0635d300 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:05.951093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-af7d5e08-dc22-4cd1-baeb-497e0635d300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:06.004209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846172b-cfc7-463b-b576-24ec0538dbda None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:06.029055 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 520/1038] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:46:06.040404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00646e6-b54a-4058-9146-92924a599f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:06.041066 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00646e6-b54a-4058-9146-92924a599f98 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:06.041355 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00646e6-b54a-4058-9146-92924a599f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:06.041635 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00646e6-b54a-4058-9146-92924a599f98 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:06.042643 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00646e6-b54a-4058-9146-92924a599f98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:06.042755 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00646e6-b54a-4058-9146-92924a599f98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:06.043618 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d5e08-dc22-4cd1-baeb-497e0635d300 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:06.044129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00646e6-b54a-4058-9146-92924a599f98 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:06.057603 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 519/1039] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:46:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:06.063541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00646e6-b54a-4058-9146-92924a599f98 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:06.160872 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d5e08-dc22-4cd1-baeb-497e0635d300 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:06.175889 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:06.191351 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00646e6-b54a-4058-9146-92924a599f98 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:06.200628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:06.200822 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeac8a7-296b-4e38-817e-d3afaacee77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:06.200822 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeac8a7-296b-4e38-817e-d3afaacee77c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:06.200822 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeac8a7-296b-4e38-817e-d3afaacee77c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:06.200822 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeac8a7-296b-4e38-817e-d3afaacee77c None admin] PATH_INFO: `/v3/services/image` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:06.201685 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeac8a7-296b-4e38-817e-d3afaacee77c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:06.202603 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeac8a7-296b-4e38-817e-d3afaacee77c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:06.211680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-ddeac8a7-296b-4e38-817e-d3afaacee77c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:46:06.211680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:06.211680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:46:06.211680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:46:06.211680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:46:06.211680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:46:06.211680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:46:06.211680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:46:06.211680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:46:06.211680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:46:06.211680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:46:06.211680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:46:06.211680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:06.211680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:06.211680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:06.211680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:06.211680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:06.212999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:06.212999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:06.212999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:06.212999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:06.212999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:06.212999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:06.212999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:46:06.212999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:46:06.212999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:46:06.212999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:46:06.212999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:06.212999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:06.212999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:06.212999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:06.212999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:06.212999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:06.213880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:06.213880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:06.213880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:06.213880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:06.213880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:06.213880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:06.213880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:06.213880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:06.213880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:06.213880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:06.213880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:46:06.213880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:46:06.213880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:46:06.213880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:46:06.213880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 521/1040] 10.222.0.75 () {56 vars in 1105 bytes} [Thu Jul 28 17:46:06 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:46:06.219719 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeac8a7-296b-4e38-817e-d3afaacee77c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:06.229295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37424d47-8e6a-4d7f-b4cb-381dc1cbe51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:06.229956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424d47-8e6a-4d7f-b4cb-381dc1cbe51a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:06.230245 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424d47-8e6a-4d7f-b4cb-381dc1cbe51a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:06.230558 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424d47-8e6a-4d7f-b4cb-381dc1cbe51a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:06.231352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37424d47-8e6a-4d7f-b4cb-381dc1cbe51a None admin] RBAC: Adding query filter params (role.id=4a747c3694f44616b8ca0dae0fea435f, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=c456a787159844feb7eabfd1e527e46e) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:06.231661 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37424d47-8e6a-4d7f-b4cb-381dc1cbe51a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:06.233142 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37424d47-8e6a-4d7f-b4cb-381dc1cbe51a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:06.238810 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 520/1041] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:46:06 2022] GET /identity/v3/role_assignments?user.id=c456a787159844feb7eabfd1e527e46e&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=4a747c3694f44616b8ca0dae0fea435f => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:06.332351 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeac8a7-296b-4e38-817e-d3afaacee77c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:06.375971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c465f7-cc53-405b-b22f-b2f9f3b25a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:06.376615 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c465f7-cc53-405b-b22f-b2f9f3b25a81 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:06.376925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c465f7-cc53-405b-b22f-b2f9f3b25a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:06.377198 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c465f7-cc53-405b-b22f-b2f9f3b25a81 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:06.377887 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c465f7-cc53-405b-b22f-b2f9f3b25a81 None admin] RBAC: Adding query filter params (name=image) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:06.378192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c465f7-cc53-405b-b22f-b2f9f3b25a81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:06.379586 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c465f7-cc53-405b-b22f-b2f9f3b25a81 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:06.385492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 522/1042] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:06.391718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37424d47-8e6a-4d7f-b4cb-381dc1cbe51a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:06.497906 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37424d47-8e6a-4d7f-b4cb-381dc1cbe51a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:06.533496 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41f576-b8ed-4c9d-a036-b25720539444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:06.534128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41f576-b8ed-4c9d-a036-b25720539444 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:06.538948 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41f576-b8ed-4c9d-a036-b25720539444 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:06.538948 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41f576-b8ed-4c9d-a036-b25720539444 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:06.538948 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41f576-b8ed-4c9d-a036-b25720539444 None admin] RBAC: Adding query filter params (type=image) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:06.538948 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41f576-b8ed-4c9d-a036-b25720539444 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:06.538948 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41f576-b8ed-4c9d-a036-b25720539444 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:06.547759 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 521/1043] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:06.549464 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c465f7-cc53-405b-b22f-b2f9f3b25a81 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:06.593900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:06.664575 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c465f7-cc53-405b-b22f-b2f9f3b25a81 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:06.711621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6ef24-053e-4463-b3e8-c14abce70359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:06.712278 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6ef24-053e-4463-b3e8-c14abce70359 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:06.712561 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6ef24-053e-4463-b3e8-c14abce70359 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:06.712872 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6ef24-053e-4463-b3e8-c14abce70359 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:06.713656 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6ef24-053e-4463-b3e8-c14abce70359 None admin] RBAC: Adding query filter params (interface=public, service_id=c77feaa52443487ab6fb8c5559fb8485, region_id=RegionOne) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:06.713971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6ef24-053e-4463-b3e8-c14abce70359 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:06.715400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6ef24-053e-4463-b3e8-c14abce70359 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:06.726278 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 523/1044] 10.222.0.75 () {56 vars in 1251 bytes} [Thu Jul 28 17:46:06 2022] GET /identity/v3/endpoints?service_id=c77feaa52443487ab6fb8c5559fb8485&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:06.727833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41f576-b8ed-4c9d-a036-b25720539444 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:06.762150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:06.837012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41f576-b8ed-4c9d-a036-b25720539444 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:06.870674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d30287-b531-4452-8d81-eb80045cf5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:06.871220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d30287-b531-4452-8d81-eb80045cf5bc None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:06.871497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d30287-b531-4452-8d81-eb80045cf5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:06.871767 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d30287-b531-4452-8d81-eb80045cf5bc None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:06.872421 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d30287-b531-4452-8d81-eb80045cf5bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:06.874314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d30287-b531-4452-8d81-eb80045cf5bc None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:06.889453 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 522/1045] 10.222.0.75 () {56 vars in 1087 bytes} [Thu Jul 28 17:46:06 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:46:07.628318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f51e82-220a-4cc6-ab02-ce1e46130dfc None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:07.628844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f51e82-220a-4cc6-ab02-ce1e46130dfc None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:07.628844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f51e82-220a-4cc6-ab02-ce1e46130dfc None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:07.630415 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 524/1046] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:07.635372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cea3a8-b708-4822-9594-75d65b8d5767 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:07.635752 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cea3a8-b708-4822-9594-75d65b8d5767 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:07.635933 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cea3a8-b708-4822-9594-75d65b8d5767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:07.655008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e8cea3a8-b708-4822-9594-75d65b8d5767 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:07.655995 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e8cea3a8-b708-4822-9594-75d65b8d5767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:07.724568 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 523/1047] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:07.747221 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f51e82-220a-4cc6-ab02-ce1e46130dfc None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:07.849267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f51e82-220a-4cc6-ab02-ce1e46130dfc None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:07.851653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:07.882809 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eae33a-d225-4ef4-9a50-b801af398e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:07.883386 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eae33a-d225-4ef4-9a50-b801af398e4c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:07.883667 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eae33a-d225-4ef4-9a50-b801af398e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:07.883940 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eae33a-d225-4ef4-9a50-b801af398e4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:07.894339 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eae33a-d225-4ef4-9a50-b801af398e4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:46:07.899997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-91eae33a-d225-4ef4-9a50-b801af398e4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:07.899997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:07.899997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:07.899997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:07.899997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:07.899997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:07.899997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:07.899997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:07.899997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:07.899997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:07.899997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:07.899997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:07.899997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:46:07.899997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:46:07.899997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:46:07.899997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:46:07.901182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:46:07.901182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:46:07.901182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:46:07.901182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:46:07.901182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:07.901182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:07.901182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:07.901182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:07.901182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:07.901182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:07.901182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:07.901182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:07.901182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:07.901182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:07.901182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:07.901182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:07.902056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:07.902056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:07.902056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:07.902056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:07.902056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:46:07.902056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:46:07.902056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:46:07.902056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:46:07.902056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:46:07.902056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:46:07.902056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:07.902056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:46:07.903752 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 525/1048] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:46:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:07.907366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cea3a8-b708-4822-9594-75d65b8d5767 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:07.936506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:08.013090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cea3a8-b708-4822-9594-75d65b8d5767 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:08.049675 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670f940-5e98-4088-b449-000b6df1f205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:08.050302 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670f940-5e98-4088-b449-000b6df1f205 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:08.050584 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670f940-5e98-4088-b449-000b6df1f205 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:08.050944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670f940-5e98-4088-b449-000b6df1f205 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:08.051669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670f940-5e98-4088-b449-000b6df1f205 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:08.051974 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670f940-5e98-4088-b449-000b6df1f205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:08.053375 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670f940-5e98-4088-b449-000b6df1f205 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:08.062113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 524/1049] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:46:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:08.067582 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eae33a-d225-4ef4-9a50-b801af398e4c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:08.169579 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eae33a-d225-4ef4-9a50-b801af398e4c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:08.205423 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300346c9-4d56-49d1-a52b-0463ac5c400d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:08.206075 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300346c9-4d56-49d1-a52b-0463ac5c400d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:08.206509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300346c9-4d56-49d1-a52b-0463ac5c400d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:08.206790 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300346c9-4d56-49d1-a52b-0463ac5c400d None admin] PATH_INFO: `/v3/users/a2a8ea32b1bf48f0a298c6fc972ef111` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:08.220801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300346c9-4d56-49d1-a52b-0463ac5c400d None admin] RBAC: Authorizing `identity:get_user(user_id=a2a8ea32b1bf48f0a298c6fc972ef111)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:08.222268 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300346c9-4d56-49d1-a52b-0463ac5c400d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:08.224129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 526/1050] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:08 2022] GET /identity/v3/users/a2a8ea32b1bf48f0a298c6fc972ef111 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:08.229636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670f940-5e98-4088-b449-000b6df1f205 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:08.323866 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:08.344099 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670f940-5e98-4088-b449-000b6df1f205 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:08.380054 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7bc17-db6a-4c43-8be0-c97fd4eb98f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:08.380687 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7bc17-db6a-4c43-8be0-c97fd4eb98f4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:08.380991 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7bc17-db6a-4c43-8be0-c97fd4eb98f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:08.381267 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7bc17-db6a-4c43-8be0-c97fd4eb98f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:08.452776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba142d6e-2a1a-48d0-a016-50d2af64294b None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:08.452776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba142d6e-2a1a-48d0-a016-50d2af64294b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:08.453139 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba142d6e-2a1a-48d0-a016-50d2af64294b None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:08.453953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7bc17-db6a-4c43-8be0-c97fd4eb98f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:08.456814 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 527/1051] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:46:08.456989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7bc17-db6a-4c43-8be0-c97fd4eb98f4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:08.462040 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fa235-2e69-4bb6-83dc-4631d3e83d36 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:08.462583 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fa235-2e69-4bb6-83dc-4631d3e83d36 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:08.463056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fa235-2e69-4bb6-83dc-4631d3e83d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:08.482053 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-1c6fa235-2e69-4bb6-83dc-4631d3e83d36 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:08.483566 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1c6fa235-2e69-4bb6-83dc-4631d3e83d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:08.503842 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:08.548990 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:08.561227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 528/1052] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:46:08.567646 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 525/1053] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:46:08 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 17:46:08.568826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fa235-2e69-4bb6-83dc-4631d3e83d36 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:08.584329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7bc17-db6a-4c43-8be0-c97fd4eb98f4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:08.681875 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fa235-2e69-4bb6-83dc-4631d3e83d36 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:08.702275 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7bc17-db6a-4c43-8be0-c97fd4eb98f4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:08.718369 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb6745-18c6-4503-820e-16a1e7abeaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:08.718958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb6745-18c6-4503-820e-16a1e7abeaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:08.719242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb6745-18c6-4503-820e-16a1e7abeaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:08.719520 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb6745-18c6-4503-820e-16a1e7abeaf9 None admin] PATH_INFO: `/v3/projects/5fa638df7f994683a3ea3752bd2105ff` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:08.720688 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb6745-18c6-4503-820e-16a1e7abeaf9 None admin] RBAC: Authorizing `identity:get_project(project_id=5fa638df7f994683a3ea3752bd2105ff)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:08.722174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb6745-18c6-4503-820e-16a1e7abeaf9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:08.724177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 529/1054] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:46:08 2022] GET /identity/v3/projects/5fa638df7f994683a3ea3752bd2105ff => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:08.729967 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb6745-18c6-4503-820e-16a1e7abeaf9 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:08.740344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b96ce-dfcc-40f6-bc91-1ce6610d7a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:08.741393 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b96ce-dfcc-40f6-bc91-1ce6610d7a98 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:08.741681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b96ce-dfcc-40f6-bc91-1ce6610d7a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:08.742271 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b96ce-dfcc-40f6-bc91-1ce6610d7a98 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:08.753206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:08.755141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b96ce-dfcc-40f6-bc91-1ce6610d7a98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:46:08.760112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-707b96ce-dfcc-40f6-bc91-1ce6610d7a98 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:46:08.760112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:08.760112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:08.760112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:08.760112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:08.760112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:08.760112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:08.760112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:08.760112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:08.760112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:08.760112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:08.760112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:08.760112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:46:08.760112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:46:08.760112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:46:08.760112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:46:08.761062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:46:08.761062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:46:08.761062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:46:08.761062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:46:08.761062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:08.761062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:08.761062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:08.761062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:08.761062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:08.761062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:08.761062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:08.761062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:08.761062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:08.761062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:08.761062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:08.761062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:08.761934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:08.761934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:08.761934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:08.761934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:08.761934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:46:08.761934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:46:08.761934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:46:08.761934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:46:08.761934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:46:08.761934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:46:08.761934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:46:08.761934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:08.761934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 526/1055] 10.222.0.75 () {56 vars in 1120 bytes} [Thu Jul 28 17:46:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:46:08.767876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b96ce-dfcc-40f6-bc91-1ce6610d7a98 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:08.820573 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:08.840320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb6745-18c6-4503-820e-16a1e7abeaf9 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:08.875937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282109a6-66af-4bf4-ac28-baadf874acf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:08.876442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b96ce-dfcc-40f6-bc91-1ce6610d7a98 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:08.876557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282109a6-66af-4bf4-ac28-baadf874acf9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:08.876850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282109a6-66af-4bf4-ac28-baadf874acf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:08.877125 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282109a6-66af-4bf4-ac28-baadf874acf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:08.877917 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282109a6-66af-4bf4-ac28-baadf874acf9 None admin] RBAC: Adding query filter params (role.id=d371062e071845ffa4570a76d40dff88, scope.project.id=5fa638df7f994683a3ea3752bd2105ff, user.id=a2a8ea32b1bf48f0a298c6fc972ef111) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:08.878225 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282109a6-66af-4bf4-ac28-baadf874acf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:08.879665 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282109a6-66af-4bf4-ac28-baadf874acf9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:08.885521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 530/1056] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:46:08 2022] GET /identity/v3/role_assignments?user.id=a2a8ea32b1bf48f0a298c6fc972ef111&scope.project.id=5fa638df7f994683a3ea3752bd2105ff&role.id=d371062e071845ffa4570a76d40dff88 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:08.914366 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca49628-769a-40d3-adc0-8be2ab9cd8ed None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:08.915040 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca49628-769a-40d3-adc0-8be2ab9cd8ed None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:08.915040 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca49628-769a-40d3-adc0-8be2ab9cd8ed None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:08.916474 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 531/1057] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:08.922147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc5912-c217-4ce8-b4f2-96f9144adf58 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:08.922478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc5912-c217-4ce8-b4f2-96f9144adf58 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:08.922734 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc5912-c217-4ce8-b4f2-96f9144adf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:08.926868 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d912a6-96f1-4b3f-9342-9558b13b9aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:08.927504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d912a6-96f1-4b3f-9342-9558b13b9aba None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:08.927789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d912a6-96f1-4b3f-9342-9558b13b9aba None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:08.928063 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d912a6-96f1-4b3f-9342-9558b13b9aba None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:08.928828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d912a6-96f1-4b3f-9342-9558b13b9aba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:08.929143 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d912a6-96f1-4b3f-9342-9558b13b9aba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:08.930532 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d912a6-96f1-4b3f-9342-9558b13b9aba None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:08.945423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 527/1058] 10.222.0.75 () {56 vars in 1115 bytes} [Thu Jul 28 17:46:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:08.945669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-2dbc5912-c217-4ce8-b4f2-96f9144adf58 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:08.945669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2dbc5912-c217-4ce8-b4f2-96f9144adf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:08.946756 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d912a6-96f1-4b3f-9342-9558b13b9aba None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:09.021039 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 532/1059] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:46:09.044175 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc5912-c217-4ce8-b4f2-96f9144adf58 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:09.060145 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:09.064525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d912a6-96f1-4b3f-9342-9558b13b9aba None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:09.076845 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:09.101616 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f031b2-3bec-4c56-82a9-7e1936593cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:09.102390 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f031b2-3bec-4c56-82a9-7e1936593cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:09.102690 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f031b2-3bec-4c56-82a9-7e1936593cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:09.102961 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f031b2-3bec-4c56-82a9-7e1936593cd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:09.114637 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f031b2-3bec-4c56-82a9-7e1936593cd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:09.116092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f031b2-3bec-4c56-82a9-7e1936593cd0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:09.132366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-41f031b2-3bec-4c56-82a9-7e1936593cd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:46:09.132366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:09.132366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:09.132366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:09.132366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:09.132366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:09.132366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:09.132366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:09.132366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:09.132366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:09.132366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:09.132366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:09.132366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:46:09.132366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:46:09.132366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:46:09.133610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:46:09.133610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:09.133610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:09.133610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:09.133610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:09.133610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:09.133610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:09.133610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:09.133610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:09.133610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:09.133610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:09.133610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:09.133610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:09.133610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:09.133610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:09.133610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:09.133610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:09.134708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:46:09.134708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:46:09.134708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:46:09.134708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:09.136246 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 528/1060] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:09.144797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f031b2-3bec-4c56-82a9-7e1936593cd0 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:09.151472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc5912-c217-4ce8-b4f2-96f9144adf58 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:09.189221 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70429597-8e05-4782-90e0-53b5e750442a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:09.189876 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70429597-8e05-4782-90e0-53b5e750442a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:09.190156 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70429597-8e05-4782-90e0-53b5e750442a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:09.190433 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70429597-8e05-4782-90e0-53b5e750442a None admin] PATH_INFO: `/v3/services/image` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:09.191065 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70429597-8e05-4782-90e0-53b5e750442a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:09.192446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70429597-8e05-4782-90e0-53b5e750442a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:09.201459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-70429597-8e05-4782-90e0-53b5e750442a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:46:09.201459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:09.201459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:46:09.201459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:46:09.201459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:46:09.201459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:46:09.201459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:46:09.201459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:46:09.201459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:46:09.201459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:46:09.201459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:46:09.201459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:46:09.201459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:09.201459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:09.201459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:09.201459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:09.201459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:09.202484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:09.202484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:09.202484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:09.202484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:09.202484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:09.202484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:09.202484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:46:09.202484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:46:09.202484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:46:09.202484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:46:09.202484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:09.202484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:09.202484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:09.202484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:09.202484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:09.202484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:09.203358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:09.203358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:09.203358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:09.203358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:09.203358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:09.203358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:09.203358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:09.203358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:09.203358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:09.203358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:09.203358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:46:09.203358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:46:09.203358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:46:09.203358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:46:09.203358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 533/1061] 10.222.0.75 () {56 vars in 1105 bytes} [Thu Jul 28 17:46:09 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:09.209158 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70429597-8e05-4782-90e0-53b5e750442a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:09.261737 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f031b2-3bec-4c56-82a9-7e1936593cd0 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:09.292459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:09.298922 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67c37e-671f-4d83-ad38-7e66e3b861d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:09.299623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67c37e-671f-4d83-ad38-7e66e3b861d4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:09.299928 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67c37e-671f-4d83-ad38-7e66e3b861d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:09.300181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67c37e-671f-4d83-ad38-7e66e3b861d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:09.300903 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67c37e-671f-4d83-ad38-7e66e3b861d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:09.301344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67c37e-671f-4d83-ad38-7e66e3b861d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:09.304432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67c37e-671f-4d83-ad38-7e66e3b861d4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:09.320940 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 529/1062] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:09.321822 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67c37e-671f-4d83-ad38-7e66e3b861d4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:09.324091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70429597-8e05-4782-90e0-53b5e750442a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:09.356269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:09.360221 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ea35a-eb31-4785-8a95-90a79e6dfc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:09.361042 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ea35a-eb31-4785-8a95-90a79e6dfc11 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:09.361331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ea35a-eb31-4785-8a95-90a79e6dfc11 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:09.361691 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ea35a-eb31-4785-8a95-90a79e6dfc11 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:09.362355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ea35a-eb31-4785-8a95-90a79e6dfc11 None admin] RBAC: Adding query filter params (name=image) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:09.362700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ea35a-eb31-4785-8a95-90a79e6dfc11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:09.367377 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ea35a-eb31-4785-8a95-90a79e6dfc11 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:09.374487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 534/1063] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:09.375585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ea35a-eb31-4785-8a95-90a79e6dfc11 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:09.441485 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67c37e-671f-4d83-ad38-7e66e3b861d4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:09.479376 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32352612-85b7-4f40-a40c-fe8443e58ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:09.479917 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ea35a-eb31-4785-8a95-90a79e6dfc11 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:09.480030 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32352612-85b7-4f40-a40c-fe8443e58ebb None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:09.480292 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32352612-85b7-4f40-a40c-fe8443e58ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:09.480564 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32352612-85b7-4f40-a40c-fe8443e58ebb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:09.491412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32352612-85b7-4f40-a40c-fe8443e58ebb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:09.493317 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32352612-85b7-4f40-a40c-fe8443e58ebb None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:09.507378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-32352612-85b7-4f40-a40c-fe8443e58ebb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:46:09.507378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:09.507378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:09.507378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:09.507378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:09.507378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:09.507378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:09.507378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:09.507378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:09.507378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:09.507378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:09.507378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:09.507378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:46:09.507378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:46:09.507378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:46:09.507378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:46:09.508540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:09.508540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:09.508540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:46:09.508540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:46:09.508540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:46:09.508540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:46:09.508540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:09.508540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:09.508540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:09.508540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:09.508540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:09.508540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:09.508540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:09.508540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:09.508540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:09.508540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:09.508540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:09.508540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:09.509539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:09.509539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:09.509539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:46:09.509539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:46:09.509539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:46:09.509539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:46:09.509539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:46:09.509539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:46:09.509539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:46:09.509539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:09.509539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 530/1064] 10.222.0.75 () {56 vars in 1093 bytes} [Thu Jul 28 17:46:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:09.514475 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32352612-85b7-4f40-a40c-fe8443e58ebb None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:09.519487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb0183-94fa-4c9c-ac96-259813c9f48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:09.520119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb0183-94fa-4c9c-ac96-259813c9f48b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:09.520402 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb0183-94fa-4c9c-ac96-259813c9f48b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:09.520674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb0183-94fa-4c9c-ac96-259813c9f48b None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:09.521411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb0183-94fa-4c9c-ac96-259813c9f48b None admin] RBAC: Adding query filter params (type=image) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:09.521964 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb0183-94fa-4c9c-ac96-259813c9f48b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:09.523353 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb0183-94fa-4c9c-ac96-259813c9f48b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:09.531185 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 535/1065] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:09.537091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb0183-94fa-4c9c-ac96-259813c9f48b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:09.548121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:09.604445 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:09.623775 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32352612-85b7-4f40-a40c-fe8443e58ebb None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:09.646033 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb0183-94fa-4c9c-ac96-259813c9f48b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:09.658333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d409b9b-d1ff-4450-b05a-6616145c637e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:09.658956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d409b9b-d1ff-4450-b05a-6616145c637e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:09.659242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d409b9b-d1ff-4450-b05a-6616145c637e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:09.659521 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d409b9b-d1ff-4450-b05a-6616145c637e None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:09.660322 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d409b9b-d1ff-4450-b05a-6616145c637e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:09.660642 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d409b9b-d1ff-4450-b05a-6616145c637e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:09.662351 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d409b9b-d1ff-4450-b05a-6616145c637e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:09.681195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53379f-1715-4bac-afaa-cda26b317018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:09.681953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 531/1066] 10.222.0.75 () {56 vars in 1133 bytes} [Thu Jul 28 17:46:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:09.682072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53379f-1715-4bac-afaa-cda26b317018 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:09.685143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53379f-1715-4bac-afaa-cda26b317018 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:09.685440 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53379f-1715-4bac-afaa-cda26b317018 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:09.686187 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53379f-1715-4bac-afaa-cda26b317018 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:09.687659 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d409b9b-d1ff-4450-b05a-6616145c637e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:09.687778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53379f-1715-4bac-afaa-cda26b317018 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:09.788784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 536/1067] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 17:46:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:46:09.801291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d409b9b-d1ff-4450-b05a-6616145c637e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:09.847340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23abe0d-21d9-42de-961e-48ace191b68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:09.848001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23abe0d-21d9-42de-961e-48ace191b68c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:09.848343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23abe0d-21d9-42de-961e-48ace191b68c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:09.848663 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23abe0d-21d9-42de-961e-48ace191b68c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:09.852186 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:09.862317 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23abe0d-21d9-42de-961e-48ace191b68c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:09.866789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23abe0d-21d9-42de-961e-48ace191b68c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:09.880619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-a23abe0d-21d9-42de-961e-48ace191b68c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:46:09.880619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:09.880619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:09.880619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:09.880619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:09.880619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:09.880619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:09.880619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:09.880619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:09.880619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:09.880619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:09.880619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:09.880619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:46:09.880619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:46:09.880619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:46:09.881751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:46:09.881751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:09.881751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:09.881751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:09.881751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:09.881751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:09.881751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:09.881751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:09.881751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:09.881751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:09.881751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:09.881751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:09.881751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:09.881751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:09.881751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:09.881751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:09.881751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:09.882657 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:46:09.882657 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:46:09.882657 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:46:09.882657 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:09.883395 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 532/1068] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:46:09.888032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53379f-1715-4bac-afaa-cda26b317018 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:09.955517 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:09.998070 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53379f-1715-4bac-afaa-cda26b317018 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:10.033180 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c879a9-957f-4254-a22e-981a5d38e4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:10.033806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c879a9-957f-4254-a22e-981a5d38e4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:10.034145 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c879a9-957f-4254-a22e-981a5d38e4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:10.034415 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c879a9-957f-4254-a22e-981a5d38e4a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:10.035107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c879a9-957f-4254-a22e-981a5d38e4a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:10.035409 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c879a9-957f-4254-a22e-981a5d38e4a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:10.036797 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c879a9-957f-4254-a22e-981a5d38e4a9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:10.049277 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 537/1069] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:10.054808 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23abe0d-21d9-42de-961e-48ace191b68c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:10.156032 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23abe0d-21d9-42de-961e-48ace191b68c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:10.189851 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5ef21-b116-40d1-ad29-04326d011a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:10.190490 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ef21-b116-40d1-ad29-04326d011a92 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:10.190767 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ef21-b116-40d1-ad29-04326d011a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:10.191035 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ef21-b116-40d1-ad29-04326d011a92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:10.197659 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5ef21-b116-40d1-ad29-04326d011a92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:10.199151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5ef21-b116-40d1-ad29-04326d011a92 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:10.211305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-85e5ef21-b116-40d1-ad29-04326d011a92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:46:10.211305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:10.211305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:10.211305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:10.211305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:10.211305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:10.211305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:10.211305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:10.211305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:10.211305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:10.211305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:10.211305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:10.211305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:46:10.211305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:46:10.211305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:46:10.212224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:46:10.212224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:10.212224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:10.212224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:10.212224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:10.212224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:10.212224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:10.212224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:10.212224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:10.212224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:10.212224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:10.212224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:10.212224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:10.212224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:10.212224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:10.212224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:10.212224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:10.213211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:46:10.213211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:46:10.213211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:46:10.213211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:46:10.213211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:46:10.213211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:46:10.213211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:46:10.213211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:10.213211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 533/1070] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:46:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:46:10.220210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c879a9-957f-4254-a22e-981a5d38e4a9 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:10.324150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c879a9-957f-4254-a22e-981a5d38e4a9 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:10.356152 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:10.369117 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d4269-497c-434f-848a-7e707e03533f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:10.369753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d4269-497c-434f-848a-7e707e03533f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:10.377313 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d4269-497c-434f-848a-7e707e03533f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:10.377313 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d4269-497c-434f-848a-7e707e03533f None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:10.377313 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d4269-497c-434f-848a-7e707e03533f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:10.377313 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d4269-497c-434f-848a-7e707e03533f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:10.377313 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d4269-497c-434f-848a-7e707e03533f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:10.389149 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 538/1071] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:46:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:10.391635 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5ef21-b116-40d1-ad29-04326d011a92 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:10.442879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:10.503438 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5ef21-b116-40d1-ad29-04326d011a92 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:10.539348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301ac47-1dfa-4ebd-8253-c472724f4b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:10.540027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ac47-1dfa-4ebd-8253-c472724f4b38 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:10.540312 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ac47-1dfa-4ebd-8253-c472724f4b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:10.540591 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ac47-1dfa-4ebd-8253-c472724f4b38 None admin] PATH_INFO: `/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/c456a787159844feb7eabfd1e527e46e/roles/4a747c3694f44616b8ca0dae0fea435f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:10.542839 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301ac47-1dfa-4ebd-8253-c472724f4b38 None admin] RBAC: Authorizing `identity:create_grant(project_id=883ec0c5aa374fbfbfc08eda6c626cfc, user_id=c456a787159844feb7eabfd1e527e46e, role_id=4a747c3694f44616b8ca0dae0fea435f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:10.544291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301ac47-1dfa-4ebd-8253-c472724f4b38 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:10.705669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 534/1072] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:46:10 2022] PUT /identity/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/c456a787159844feb7eabfd1e527e46e/roles/4a747c3694f44616b8ca0dae0fea435f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:46:10.918445 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5e255-06dc-4e2d-82e4-9ab2eb57946c None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:10.918955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5e255-06dc-4e2d-82e4-9ab2eb57946c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:10.919032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5e255-06dc-4e2d-82e4-9ab2eb57946c None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:10.921085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 539/1073] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:10.926656 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e2196-8a47-4928-846b-bb3bb6bce7a4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:10.927327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e2196-8a47-4928-846b-bb3bb6bce7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:10.927327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e2196-8a47-4928-846b-bb3bb6bce7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:10.946773 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b71e2196-8a47-4928-846b-bb3bb6bce7a4 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:10.947972 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b71e2196-8a47-4928-846b-bb3bb6bce7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:11.015876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 535/1074] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:11.038323 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5e255-06dc-4e2d-82e4-9ab2eb57946c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:11.144060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5e255-06dc-4e2d-82e4-9ab2eb57946c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:11.179232 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968b0bd-dc1e-4aba-9f15-57507690ccde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:11.179879 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968b0bd-dc1e-4aba-9f15-57507690ccde None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:11.180161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968b0bd-dc1e-4aba-9f15-57507690ccde None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:11.180438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968b0bd-dc1e-4aba-9f15-57507690ccde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:11.191038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968b0bd-dc1e-4aba-9f15-57507690ccde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:46:11.196004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-e968b0bd-dc1e-4aba-9f15-57507690ccde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:11.196004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:11.196004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:11.196004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:11.196004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:11.196004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:11.196004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:11.196004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:11.196004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:11.196004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:11.196004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:11.196004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:11.196004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:46:11.196004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:46:11.196004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:46:11.196004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:46:11.197011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:46:11.197011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:46:11.197011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:46:11.197011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:46:11.197011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:11.197011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:11.197011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:11.197011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:11.197011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:11.197011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:11.197011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:11.197011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:11.197011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:11.197011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:11.197011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:11.197011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:11.197853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:11.197853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:11.197853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:11.197853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:11.197853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:46:11.197853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:46:11.197853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:46:11.197853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:46:11.197853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:46:11.197853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:46:11.197853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:11.197853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:46:11.201099 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 540/1075] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:46:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:11.203272 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e2196-8a47-4928-846b-bb3bb6bce7a4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:11.244991 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:11.305303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e2196-8a47-4928-846b-bb3bb6bce7a4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:11.341971 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b072d1-8b80-4efe-9b35-b826eceecf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:11.342969 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b072d1-8b80-4efe-9b35-b826eceecf86 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:11.343473 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b072d1-8b80-4efe-9b35-b826eceecf86 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:11.343962 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b072d1-8b80-4efe-9b35-b826eceecf86 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:11.344926 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b072d1-8b80-4efe-9b35-b826eceecf86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:11.345216 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b072d1-8b80-4efe-9b35-b826eceecf86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:11.346574 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b072d1-8b80-4efe-9b35-b826eceecf86 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:11.361003 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 536/1076] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:46:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:11.363035 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968b0bd-dc1e-4aba-9f15-57507690ccde None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:11.409495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:11.467479 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968b0bd-dc1e-4aba-9f15-57507690ccde None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:11.500508 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964a147-32f2-48c5-815a-ec58768bca31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:11.501192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964a147-32f2-48c5-815a-ec58768bca31 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:11.501474 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964a147-32f2-48c5-815a-ec58768bca31 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:11.501754 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964a147-32f2-48c5-815a-ec58768bca31 None admin] PATH_INFO: `/v3/users/a2a8ea32b1bf48f0a298c6fc972ef111` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:11.502910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964a147-32f2-48c5-815a-ec58768bca31 None admin] RBAC: Authorizing `identity:get_user(user_id=a2a8ea32b1bf48f0a298c6fc972ef111)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:11.504358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964a147-32f2-48c5-815a-ec58768bca31 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:11.506166 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 541/1077] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:11 2022] GET /identity/v3/users/a2a8ea32b1bf48f0a298c6fc972ef111 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:11.511824 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b072d1-8b80-4efe-9b35-b826eceecf86 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:11.611594 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:11.615140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b072d1-8b80-4efe-9b35-b826eceecf86 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:11.649511 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff697e-2a03-495a-8a2c-a0e3134675ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:11.650333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff697e-2a03-495a-8a2c-a0e3134675ea None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:11.650611 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff697e-2a03-495a-8a2c-a0e3134675ea None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:11.651202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff697e-2a03-495a-8a2c-a0e3134675ea None admin] PATH_INFO: `/v3/projects/5fa638df7f994683a3ea3752bd2105ff` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:11.652374 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff697e-2a03-495a-8a2c-a0e3134675ea None admin] RBAC: Authorizing `identity:get_project(project_id=5fa638df7f994683a3ea3752bd2105ff)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:11.654375 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff697e-2a03-495a-8a2c-a0e3134675ea None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:11.656215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 537/1078] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:46:11 2022] GET /identity/v3/projects/5fa638df7f994683a3ea3752bd2105ff => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:11.662095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964a147-32f2-48c5-815a-ec58768bca31 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:11.762118 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964a147-32f2-48c5-815a-ec58768bca31 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:11.773355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:11.797225 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db56b5b-8bf8-4929-beb8-583381006e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:11.798282 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db56b5b-8bf8-4929-beb8-583381006e20 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:11.798282 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db56b5b-8bf8-4929-beb8-583381006e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:11.798442 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db56b5b-8bf8-4929-beb8-583381006e20 None admin] PATH_INFO: `/v3/projects/5fa638df7f994683a3ea3752bd2105ff/users/a2a8ea32b1bf48f0a298c6fc972ef111/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:11.800378 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db56b5b-8bf8-4929-beb8-583381006e20 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fa638df7f994683a3ea3752bd2105ff, user_id=a2a8ea32b1bf48f0a298c6fc972ef111, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:11.801862 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db56b5b-8bf8-4929-beb8-583381006e20 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:11.831989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e3749-495c-4178-9abf-2d7ef141df42 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:11.832476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e3749-495c-4178-9abf-2d7ef141df42 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:11.832584 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e3749-495c-4178-9abf-2d7ef141df42 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:11.833983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 538/1079] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:46:11.838723 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d56d7-e3fa-4198-9ec4-a3cdbfc2af89 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:11.839085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d56d7-e3fa-4198-9ec4-a3cdbfc2af89 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:11.839364 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d56d7-e3fa-4198-9ec4-a3cdbfc2af89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:11.857567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-383d56d7-e3fa-4198-9ec4-a3cdbfc2af89 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:11.858764 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-383d56d7-e3fa-4198-9ec4-a3cdbfc2af89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:11.900862 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 542/1080] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:46:11 2022] PUT /identity/v3/projects/5fa638df7f994683a3ea3752bd2105ff/users/a2a8ea32b1bf48f0a298c6fc972ef111/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:46:11.941114 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 539/1081] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:46:11.962784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db56b5b-8bf8-4929-beb8-583381006e20 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:12.072949 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db56b5b-8bf8-4929-beb8-583381006e20 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:12.109828 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeab510-ee92-4a0d-bb62-843e0b6036a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:12.110466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeab510-ee92-4a0d-bb62-843e0b6036a4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:12.110741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeab510-ee92-4a0d-bb62-843e0b6036a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:12.111020 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeab510-ee92-4a0d-bb62-843e0b6036a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:12.150717 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:12.180345 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeab510-ee92-4a0d-bb62-843e0b6036a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:12.181856 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeab510-ee92-4a0d-bb62-843e0b6036a4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:12.285294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 543/1082] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:46:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:46:12.293839 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d56d7-e3fa-4198-9ec4-a3cdbfc2af89 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:12.399250 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:12.403508 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d56d7-e3fa-4198-9ec4-a3cdbfc2af89 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:12.440490 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb453b7-b664-4460-a0ef-739926d98b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:12.441146 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb453b7-b664-4460-a0ef-739926d98b90 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:12.441821 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb453b7-b664-4460-a0ef-739926d98b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:12.442451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb453b7-b664-4460-a0ef-739926d98b90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:12.454302 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb453b7-b664-4460-a0ef-739926d98b90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:12.455757 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb453b7-b664-4460-a0ef-739926d98b90 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:12.471517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-cbb453b7-b664-4460-a0ef-739926d98b90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:46:12.471517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:12.471517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:12.471517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:12.471517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:12.471517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:12.471517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:12.471517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:12.471517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:12.471517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:12.471517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:12.471517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:12.471517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:46:12.471517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:46:12.471517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:46:12.472422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:46:12.472422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:12.472422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:12.472422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:12.472422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:12.472422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:12.472422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:12.472422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:12.472422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:12.472422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:12.472422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:12.472422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:12.472422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:12.472422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:12.472422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:12.472422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:12.472422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:12.473677 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:46:12.473677 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:46:12.473677 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:46:12.473677 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:12.474219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 540/1083] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:46:12.478654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeab510-ee92-4a0d-bb62-843e0b6036a4 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:12.558979 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:12.590935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeab510-ee92-4a0d-bb62-843e0b6036a4 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:12.626538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797523b9-b061-4982-ba30-78f5c8560643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:12.627158 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797523b9-b061-4982-ba30-78f5c8560643 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:12.627437 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797523b9-b061-4982-ba30-78f5c8560643 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:12.627707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797523b9-b061-4982-ba30-78f5c8560643 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:12.628389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797523b9-b061-4982-ba30-78f5c8560643 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:12.628691 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797523b9-b061-4982-ba30-78f5c8560643 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:12.630200 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797523b9-b061-4982-ba30-78f5c8560643 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:12.648801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 544/1084] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:12.720164 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fd17d-5b6b-42b9-b3f9-9d202ecc9cd4 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:12.720369 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fd17d-5b6b-42b9-b3f9-9d202ecc9cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:12.720623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fd17d-5b6b-42b9-b3f9-9d202ecc9cd4 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:12.722057 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 541/1085] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:12.727738 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437e7dc-143a-4a91-a92c-c675641bae64 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:12.728033 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437e7dc-143a-4a91-a92c-c675641bae64 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:12.728315 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437e7dc-143a-4a91-a92c-c675641bae64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:12.747386 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f437e7dc-143a-4a91-a92c-c675641bae64 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:12.749173 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f437e7dc-143a-4a91-a92c-c675641bae64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:12.823169 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 545/1086] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:12.846597 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fd17d-5b6b-42b9-b3f9-9d202ecc9cd4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:12.962355 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fd17d-5b6b-42b9-b3f9-9d202ecc9cd4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:12.996250 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5362ec-6dd8-47c4-9f5e-1f42da400164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:12.996853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5362ec-6dd8-47c4-9f5e-1f42da400164 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:12.997135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5362ec-6dd8-47c4-9f5e-1f42da400164 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:12.997426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5362ec-6dd8-47c4-9f5e-1f42da400164 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:13.008461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5362ec-6dd8-47c4-9f5e-1f42da400164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:46:13.013480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-db5362ec-6dd8-47c4-9f5e-1f42da400164 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:46:13.013480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:13.013480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:13.013480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:13.013480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:13.013480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:13.013480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:13.013480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:13.013480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:13.013480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:13.013480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:13.013480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:13.013480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:46:13.013480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:46:13.013480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:46:13.013480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:46:13.014480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:46:13.014480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:46:13.014480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:46:13.014480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:46:13.014480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:13.014480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:13.014480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:13.014480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:13.014480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:13.014480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:13.014480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:13.014480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:13.014480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:13.014480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:13.014480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:13.014480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:13.015504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:13.015504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:13.015504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:13.015504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:13.015504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:46:13.015504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:46:13.015504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:46:13.015504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:46:13.015504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:46:13.015504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:46:13.015504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:46:13.015504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:13.015504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 542/1087] 10.222.0.75 () {56 vars in 1120 bytes} [Thu Jul 28 17:46:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:13.021025 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437e7dc-143a-4a91-a92c-c675641bae64 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:13.080191 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:13.120670 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437e7dc-143a-4a91-a92c-c675641bae64 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:13.154853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f756e-8495-41f9-b4ce-deda26a79657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:13.155477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f756e-8495-41f9-b4ce-deda26a79657 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:13.155760 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f756e-8495-41f9-b4ce-deda26a79657 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:13.156034 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f756e-8495-41f9-b4ce-deda26a79657 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:13.156739 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f756e-8495-41f9-b4ce-deda26a79657 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:13.157072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f756e-8495-41f9-b4ce-deda26a79657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:13.158464 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f756e-8495-41f9-b4ce-deda26a79657 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:13.166300 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 546/1088] 10.222.0.75 () {56 vars in 1115 bytes} [Thu Jul 28 17:46:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:13.172410 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5362ec-6dd8-47c4-9f5e-1f42da400164 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:13.186310 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:13.276534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5362ec-6dd8-47c4-9f5e-1f42da400164 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:13.309288 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57c546-6f39-456a-a7a1-c71cc9844546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:13.309951 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57c546-6f39-456a-a7a1-c71cc9844546 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:13.310234 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57c546-6f39-456a-a7a1-c71cc9844546 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:13.310509 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57c546-6f39-456a-a7a1-c71cc9844546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:13.320650 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57c546-6f39-456a-a7a1-c71cc9844546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:13.322108 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57c546-6f39-456a-a7a1-c71cc9844546 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:13.336233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-fd57c546-6f39-456a-a7a1-c71cc9844546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:46:13.336233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:13.336233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:13.336233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:13.336233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:13.336233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:13.336233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:13.336233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:13.336233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:13.336233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:13.336233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:13.336233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:13.336233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:46:13.336233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:46:13.336233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:46:13.337235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:46:13.337235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:13.337235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:13.337235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:13.337235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:13.337235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:13.337235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:13.337235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:13.337235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:13.337235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:13.337235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:13.337235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:13.337235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:13.337235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:13.337235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:13.337235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:13.337235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:13.338127 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:46:13.338127 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:46:13.338127 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:46:13.338127 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:13.341077 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 543/1089] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:13.343943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f756e-8495-41f9-b4ce-deda26a79657 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:13.440819 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f756e-8495-41f9-b4ce-deda26a79657 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:13.462604 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:13.474370 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df077dd-a840-4cd2-ae20-37794333b500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:13.475043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df077dd-a840-4cd2-ae20-37794333b500 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:13.475323 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df077dd-a840-4cd2-ae20-37794333b500 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:13.475597 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df077dd-a840-4cd2-ae20-37794333b500 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:13.476287 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df077dd-a840-4cd2-ae20-37794333b500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:13.476592 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df077dd-a840-4cd2-ae20-37794333b500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:13.478018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df077dd-a840-4cd2-ae20-37794333b500 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:13.490814 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 547/1090] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:13.496390 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57c546-6f39-456a-a7a1-c71cc9844546 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:13.564165 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:13.664587 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57c546-6f39-456a-a7a1-c71cc9844546 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:13.698244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4f22b-6648-4cf9-90af-b1e6d5da4f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:13.698887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4f22b-6648-4cf9-90af-b1e6d5da4f2c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:13.699170 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4f22b-6648-4cf9-90af-b1e6d5da4f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:13.699443 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4f22b-6648-4cf9-90af-b1e6d5da4f2c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:13.706916 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4f22b-6648-4cf9-90af-b1e6d5da4f2c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:13.708364 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4f22b-6648-4cf9-90af-b1e6d5da4f2c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:13.719579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-7de4f22b-6648-4cf9-90af-b1e6d5da4f2c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:46:13.719579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:13.719579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:13.719579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:13.719579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:13.719579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:13.719579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:13.719579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:13.719579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:13.719579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:13.719579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:13.719579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:13.719579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:46:13.719579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:46:13.719579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:46:13.719579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:46:13.720506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:13.720506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:13.720506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:46:13.720506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:46:13.720506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:46:13.720506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:46:13.720506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:13.720506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:13.720506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:13.720506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:13.720506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:13.720506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:13.720506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:13.720506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:13.720506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:13.720506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:13.720506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:13.720506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:13.721482 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:13.721482 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:13.721482 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:46:13.721482 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:46:13.721482 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:46:13.721482 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:46:13.721482 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:46:13.721482 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:46:13.721482 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:46:13.721482 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:13.721482 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 544/1091] 10.222.0.75 () {56 vars in 1093 bytes} [Thu Jul 28 17:46:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:13.726550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df077dd-a840-4cd2-ae20-37794333b500 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:13.826220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df077dd-a840-4cd2-ae20-37794333b500 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:13.860994 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda4856-52e8-44a0-bc4a-20c13ce3bbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:13.861629 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda4856-52e8-44a0-bc4a-20c13ce3bbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:13.861915 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda4856-52e8-44a0-bc4a-20c13ce3bbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:13.862211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda4856-52e8-44a0-bc4a-20c13ce3bbe5 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:13.862990 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda4856-52e8-44a0-bc4a-20c13ce3bbe5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:13.863299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda4856-52e8-44a0-bc4a-20c13ce3bbe5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:13.868418 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda4856-52e8-44a0-bc4a-20c13ce3bbe5 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:13.900056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 548/1092] 10.222.0.75 () {56 vars in 1133 bytes} [Thu Jul 28 17:46:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:13.907496 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4f22b-6648-4cf9-90af-b1e6d5da4f2c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:13.928057 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b49c9-307e-453c-831a-bd714be6036e None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:13.928345 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b49c9-307e-453c-831a-bd714be6036e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:13.928623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b49c9-307e-453c-831a-bd714be6036e None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:13.930014 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 549/1093] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:46:13.934965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1ba12-35a8-42c8-ba5e-817694ec1248 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:13.935767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1ba12-35a8-42c8-ba5e-817694ec1248 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:13.936046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1ba12-35a8-42c8-ba5e-817694ec1248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:13.953363 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-1af1ba12-35a8-42c8-ba5e-817694ec1248 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:13.954561 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1af1ba12-35a8-42c8-ba5e-817694ec1248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:13.988991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:14.009881 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4f22b-6648-4cf9-90af-b1e6d5da4f2c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:14.024794 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 550/1094] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:46:14.032540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:14.043725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5dffbf-0587-47fe-a9df-c9ddb4b85d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:14.043873 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1ba12-35a8-42c8-ba5e-817694ec1248 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:14.044927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dffbf-0587-47fe-a9df-c9ddb4b85d95 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:14.045210 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dffbf-0587-47fe-a9df-c9ddb4b85d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:14.045482 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dffbf-0587-47fe-a9df-c9ddb4b85d95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:14.113358 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5dffbf-0587-47fe-a9df-c9ddb4b85d95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:14.114732 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5dffbf-0587-47fe-a9df-c9ddb4b85d95 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:14.141453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1ba12-35a8-42c8-ba5e-817694ec1248 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:14.182082 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cadbd-a621-4975-8e3b-b448ed7e3657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:14.182729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cadbd-a621-4975-8e3b-b448ed7e3657 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:14.183009 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cadbd-a621-4975-8e3b-b448ed7e3657 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:14.183289 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cadbd-a621-4975-8e3b-b448ed7e3657 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:14.193979 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cadbd-a621-4975-8e3b-b448ed7e3657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:46:14.200085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-d44cadbd-a621-4975-8e3b-b448ed7e3657 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:14.200085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:14.200085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:14.200085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:14.200085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:14.200085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:14.200085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:14.200085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:14.200085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:14.200085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:14.200085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:14.200085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:14.200085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:46:14.200085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:46:14.200085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:46:14.200085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:46:14.201132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:46:14.201132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:46:14.201132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:46:14.201132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:46:14.201132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:14.201132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:14.201132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:14.201132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:14.201132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:14.201132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:14.201132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:14.201132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:14.201132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:14.201132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:14.201132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:14.201132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:14.201998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:14.201998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:14.201998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:14.201998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:14.201998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:46:14.201998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:46:14.201998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:46:14.201998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:46:14.201998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:46:14.201998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:46:14.201998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:14.201998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:46:14.202647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 551/1095] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:46:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:46:14.210130 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cadbd-a621-4975-8e3b-b448ed7e3657 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:14.220672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 545/1096] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:46:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:46:14.226615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5dffbf-0587-47fe-a9df-c9ddb4b85d95 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:14.248070 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:14.250957 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:14.316082 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cadbd-a621-4975-8e3b-b448ed7e3657 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:14.326088 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5dffbf-0587-47fe-a9df-c9ddb4b85d95 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:14.350468 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881ceca-d57f-4a39-9eb3-13a08d7737c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:14.351097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881ceca-d57f-4a39-9eb3-13a08d7737c2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:14.351380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881ceca-d57f-4a39-9eb3-13a08d7737c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:14.351655 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881ceca-d57f-4a39-9eb3-13a08d7737c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:14.352373 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881ceca-d57f-4a39-9eb3-13a08d7737c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:14.352685 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881ceca-d57f-4a39-9eb3-13a08d7737c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:14.354109 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881ceca-d57f-4a39-9eb3-13a08d7737c2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:14.362910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 552/1097] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:46:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:14.367785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb62a1-b3f7-4427-b461-dbce41e7f439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:14.367785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb62a1-b3f7-4427-b461-dbce41e7f439 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:14.367785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb62a1-b3f7-4427-b461-dbce41e7f439 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:14.367785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb62a1-b3f7-4427-b461-dbce41e7f439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:14.368610 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881ceca-d57f-4a39-9eb3-13a08d7737c2 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:14.374927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb62a1-b3f7-4427-b461-dbce41e7f439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:14.376374 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb62a1-b3f7-4427-b461-dbce41e7f439 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:14.391861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-6ddb62a1-b3f7-4427-b461-dbce41e7f439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:46:14.391861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:14.391861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:14.391861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:14.391861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:14.391861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:14.391861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:14.391861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:14.391861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:14.391861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:14.391861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:14.391861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:14.391861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:46:14.391861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:46:14.391861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:46:14.392805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:46:14.392805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:14.392805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:14.392805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:14.392805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:14.392805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:14.392805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:14.392805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:14.392805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:14.392805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:14.392805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:14.392805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:14.392805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:14.392805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:14.392805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:14.392805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:14.392805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:14.393752 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:46:14.393752 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:46:14.393752 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:46:14.393752 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:14.393752 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 546/1098] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:14.398849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb62a1-b3f7-4427-b461-dbce41e7f439 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:14.465509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:14.472341 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:14.474580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881ceca-d57f-4a39-9eb3-13a08d7737c2 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:14.495766 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb62a1-b3f7-4427-b461-dbce41e7f439 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:14.506424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546a34f-60e7-489d-bf40-8f877185b677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:14.507073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546a34f-60e7-489d-bf40-8f877185b677 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:14.507360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546a34f-60e7-489d-bf40-8f877185b677 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:14.507633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546a34f-60e7-489d-bf40-8f877185b677 None admin] PATH_INFO: `/v3/users/a2a8ea32b1bf48f0a298c6fc972ef111` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:14.508846 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546a34f-60e7-489d-bf40-8f877185b677 None admin] RBAC: Authorizing `identity:get_user(user_id=a2a8ea32b1bf48f0a298c6fc972ef111)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:14.510299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546a34f-60e7-489d-bf40-8f877185b677 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:14.512278 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 553/1099] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:14 2022] GET /identity/v3/users/a2a8ea32b1bf48f0a298c6fc972ef111 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:14.518305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546a34f-60e7-489d-bf40-8f877185b677 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:14.533081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be503b-fa36-4f91-80c8-dea653c184a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:14.533713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be503b-fa36-4f91-80c8-dea653c184a5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:14.533990 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be503b-fa36-4f91-80c8-dea653c184a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:14.534269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be503b-fa36-4f91-80c8-dea653c184a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:14.534964 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be503b-fa36-4f91-80c8-dea653c184a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:14.535272 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be503b-fa36-4f91-80c8-dea653c184a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:14.536641 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be503b-fa36-4f91-80c8-dea653c184a5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:14.549065 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 547/1100] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:14.554925 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be503b-fa36-4f91-80c8-dea653c184a5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:14.629881 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546a34f-60e7-489d-bf40-8f877185b677 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:14.656127 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be503b-fa36-4f91-80c8-dea653c184a5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:14.664135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413dcbb-84c5-4882-8c59-c80cd302786f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:14.664777 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413dcbb-84c5-4882-8c59-c80cd302786f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:14.665058 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413dcbb-84c5-4882-8c59-c80cd302786f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:14.665336 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413dcbb-84c5-4882-8c59-c80cd302786f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:14.689290 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981700fd-102f-412c-94ab-76b2d9ea0673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:14.689924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981700fd-102f-412c-94ab-76b2d9ea0673 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:14.690207 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981700fd-102f-412c-94ab-76b2d9ea0673 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:14.690481 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981700fd-102f-412c-94ab-76b2d9ea0673 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:14.692242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:14.692350 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:14.697603 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981700fd-102f-412c-94ab-76b2d9ea0673 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:14.699036 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981700fd-102f-412c-94ab-76b2d9ea0673 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:14.713779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-981700fd-102f-412c-94ab-76b2d9ea0673 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:46:14.713779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:14.713779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:14.713779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:14.713779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:14.713779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:14.713779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:14.713779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:14.713779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:14.713779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:14.713779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:14.713779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:14.713779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:46:14.713779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:46:14.713779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:46:14.714927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:46:14.714927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:14.714927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:14.714927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:14.714927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:14.714927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:14.714927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:14.714927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:14.714927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:14.714927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:14.714927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:14.714927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:14.714927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:14.714927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:14.714927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:14.714927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:14.714927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:14.715827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:46:14.715827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:46:14.715827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:46:14.715827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:46:14.715827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:46:14.715827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:46:14.715827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:46:14.715827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:14.717072 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 548/1101] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:46:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:46:14.722967 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981700fd-102f-412c-94ab-76b2d9ea0673 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:14.733997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413dcbb-84c5-4882-8c59-c80cd302786f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:14.735463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413dcbb-84c5-4882-8c59-c80cd302786f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:14.824063 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981700fd-102f-412c-94ab-76b2d9ea0673 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:14.835083 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 554/1102] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:46:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 17:46:14.840877 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413dcbb-84c5-4882-8c59-c80cd302786f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:14.863264 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b229e7d-86f3-4061-9ee7-f3de63d51e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:14.863888 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b229e7d-86f3-4061-9ee7-f3de63d51e88 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:14.864172 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b229e7d-86f3-4061-9ee7-f3de63d51e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:14.864453 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b229e7d-86f3-4061-9ee7-f3de63d51e88 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:14.865231 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b229e7d-86f3-4061-9ee7-f3de63d51e88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:14.865543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b229e7d-86f3-4061-9ee7-f3de63d51e88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:14.866967 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b229e7d-86f3-4061-9ee7-f3de63d51e88 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:14.878702 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 549/1103] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:46:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:14.884768 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b229e7d-86f3-4061-9ee7-f3de63d51e88 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:14.899281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:14.940180 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413dcbb-84c5-4882-8c59-c80cd302786f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:14.940712 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:14.973979 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482a379-cddc-4feb-ac20-81115462f12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:14.974622 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482a379-cddc-4feb-ac20-81115462f12e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:14.974908 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482a379-cddc-4feb-ac20-81115462f12e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:14.975182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482a379-cddc-4feb-ac20-81115462f12e None admin] PATH_INFO: `/v3/projects/5fa638df7f994683a3ea3752bd2105ff` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:14.976340 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482a379-cddc-4feb-ac20-81115462f12e None admin] RBAC: Authorizing `identity:get_project(project_id=5fa638df7f994683a3ea3752bd2105ff)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:14.977830 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482a379-cddc-4feb-ac20-81115462f12e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:14.979508 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 555/1104] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:46:14 2022] GET /identity/v3/projects/5fa638df7f994683a3ea3752bd2105ff => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:14.985251 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b229e7d-86f3-4061-9ee7-f3de63d51e88 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:14.986103 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482a379-cddc-4feb-ac20-81115462f12e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:15.019261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cd117-904b-49a0-9638-8ba237bb27b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:15.019869 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cd117-904b-49a0-9638-8ba237bb27b9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:15.020148 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cd117-904b-49a0-9638-8ba237bb27b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:15.020517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cd117-904b-49a0-9638-8ba237bb27b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:15.021239 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40cd117-904b-49a0-9638-8ba237bb27b9 None admin] RBAC: Adding query filter params (role.id=4a747c3694f44616b8ca0dae0fea435f, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=c456a787159844feb7eabfd1e527e46e) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:15.021825 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40cd117-904b-49a0-9638-8ba237bb27b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:15.023241 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40cd117-904b-49a0-9638-8ba237bb27b9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:15.029792 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 550/1105] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:46:14 2022] GET /identity/v3/role_assignments?user.id=c456a787159844feb7eabfd1e527e46e&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=4a747c3694f44616b8ca0dae0fea435f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:15.087367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482a379-cddc-4feb-ac20-81115462f12e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:15.117081 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:15.125017 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78d8fe-b3e5-4db4-9ec8-46a32d976b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:15.125663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78d8fe-b3e5-4db4-9ec8-46a32d976b04 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:15.125988 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78d8fe-b3e5-4db4-9ec8-46a32d976b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:15.126264 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78d8fe-b3e5-4db4-9ec8-46a32d976b04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:15.142576 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78d8fe-b3e5-4db4-9ec8-46a32d976b04 None admin] RBAC: Adding query filter params (role.id=d371062e071845ffa4570a76d40dff88, scope.project.id=5fa638df7f994683a3ea3752bd2105ff, user.id=a2a8ea32b1bf48f0a298c6fc972ef111) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:15.142576 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78d8fe-b3e5-4db4-9ec8-46a32d976b04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:15.142576 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78d8fe-b3e5-4db4-9ec8-46a32d976b04 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:15.142576 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 556/1106] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:46:14 2022] GET /identity/v3/role_assignments?user.id=a2a8ea32b1bf48f0a298c6fc972ef111&scope.project.id=5fa638df7f994683a3ea3752bd2105ff&role.id=d371062e071845ffa4570a76d40dff88 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:17.184350 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6d27a-974d-4e1f-9459-cf791c2e43f6 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:17.185457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6d27a-974d-4e1f-9459-cf791c2e43f6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:17.185457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6d27a-974d-4e1f-9459-cf791c2e43f6 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:17.186771 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 551/1107] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:17.191991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9145be-bf44-499e-b800-9c7c2e562c11 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:17.192413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9145be-bf44-499e-b800-9c7c2e562c11 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:17.192551 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9145be-bf44-499e-b800-9c7c2e562c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:17.210879 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-bd9145be-bf44-499e-b800-9c7c2e562c11 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:17.212098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bd9145be-bf44-499e-b800-9c7c2e562c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:17.276416 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 557/1108] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:17.300473 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6d27a-974d-4e1f-9459-cf791c2e43f6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:17.399980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6d27a-974d-4e1f-9459-cf791c2e43f6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:17.416767 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:17.433359 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3671120-0206-45b6-b15e-d9f77b419240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:17.435615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3671120-0206-45b6-b15e-d9f77b419240 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:17.435615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3671120-0206-45b6-b15e-d9f77b419240 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:17.435615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3671120-0206-45b6-b15e-d9f77b419240 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:17.436233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3671120-0206-45b6-b15e-d9f77b419240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:17.437690 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3671120-0206-45b6-b15e-d9f77b419240 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:17.439271 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 552/1109] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:17.445327 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9145be-bf44-499e-b800-9c7c2e562c11 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:17.541240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9145be-bf44-499e-b800-9c7c2e562c11 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:17.564138 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:17.575404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c50915-9d94-4575-84df-fe75ead1d187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:17.578902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c50915-9d94-4575-84df-fe75ead1d187 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:17.578902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c50915-9d94-4575-84df-fe75ead1d187 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:17.578902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c50915-9d94-4575-84df-fe75ead1d187 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:17.578902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c50915-9d94-4575-84df-fe75ead1d187 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:17.578902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c50915-9d94-4575-84df-fe75ead1d187 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:17.719260 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 558/1110] 10.222.0.75 () {60 vars in 1132 bytes} [Thu Jul 28 17:46:17 2022] POST /identity/v3/users => generated 286 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:46:19.747038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f550687-f9b4-451e-b4ec-225ff66aad90 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:19.748082 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f550687-f9b4-451e-b4ec-225ff66aad90 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:19.748188 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f550687-f9b4-451e-b4ec-225ff66aad90 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:19.749664 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 553/1111] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:19.754966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f59a4-d133-461c-a7ef-39c30d27b45b None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:19.755372 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f59a4-d133-461c-a7ef-39c30d27b45b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:19.755527 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f59a4-d133-461c-a7ef-39c30d27b45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:19.773532 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-5e6f59a4-d133-461c-a7ef-39c30d27b45b None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:19.774735 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5e6f59a4-d133-461c-a7ef-39c30d27b45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:19.839539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 559/1112] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:19.862962 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f550687-f9b4-451e-b4ec-225ff66aad90 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:19.960595 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f550687-f9b4-451e-b4ec-225ff66aad90 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:19.992883 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d770610-7f15-4822-a093-920cc1b701e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:19.993513 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d770610-7f15-4822-a093-920cc1b701e4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:19.993794 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d770610-7f15-4822-a093-920cc1b701e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:19.994067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d770610-7f15-4822-a093-920cc1b701e4 None admin] PATH_INFO: `/v3/roles/e2024b6eae3d49f09caa7d4275eb88bc` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:19.995485 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d770610-7f15-4822-a093-920cc1b701e4 None admin] RBAC: Authorizing `identity:get_role(role_id=e2024b6eae3d49f09caa7d4275eb88bc)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:19.996860 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d770610-7f15-4822-a093-920cc1b701e4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:19.998770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 554/1113] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:19 2022] GET /identity/v3/roles/e2024b6eae3d49f09caa7d4275eb88bc => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:20.004618 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f59a4-d133-461c-a7ef-39c30d27b45b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:20.100926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f59a4-d133-461c-a7ef-39c30d27b45b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:20.110541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:20.134412 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf64fba-30f9-44fd-9bf4-15aa7227f887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:20.135044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf64fba-30f9-44fd-9bf4-15aa7227f887 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:20.135328 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf64fba-30f9-44fd-9bf4-15aa7227f887 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:20.135602 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf64fba-30f9-44fd-9bf4-15aa7227f887 None admin] PATH_INFO: `/v3/users/208e357d484a4cc6a5283c8155c22ff7` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:20.148982 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf64fba-30f9-44fd-9bf4-15aa7227f887 None admin] RBAC: Authorizing `identity:get_user(user_id=208e357d484a4cc6a5283c8155c22ff7)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:20.150493 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf64fba-30f9-44fd-9bf4-15aa7227f887 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:20.152111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 560/1114] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:20 2022] GET /identity/v3/users/208e357d484a4cc6a5283c8155c22ff7 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:20.158361 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d770610-7f15-4822-a093-920cc1b701e4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:20.212548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:20.256511 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d770610-7f15-4822-a093-920cc1b701e4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:20.290188 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3acf3d-c624-43f3-ab4d-0aa106436e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:20.290800 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3acf3d-c624-43f3-ab4d-0aa106436e54 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:20.291085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3acf3d-c624-43f3-ab4d-0aa106436e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:20.291407 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3acf3d-c624-43f3-ab4d-0aa106436e54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:20.358586 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3acf3d-c624-43f3-ab4d-0aa106436e54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:20.360018 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3acf3d-c624-43f3-ab4d-0aa106436e54 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:20.411938 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:20.455580 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 555/1115] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:46:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:46:20.461605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf64fba-30f9-44fd-9bf4-15aa7227f887 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:20.557630 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf64fba-30f9-44fd-9bf4-15aa7227f887 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:20.594422 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219c4d9-7f67-427d-a3f7-3250e9b72cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:20.595063 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219c4d9-7f67-427d-a3f7-3250e9b72cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:20.595341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219c4d9-7f67-427d-a3f7-3250e9b72cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:20.595616 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219c4d9-7f67-427d-a3f7-3250e9b72cd9 None admin] PATH_INFO: `/v3/projects/5fa638df7f994683a3ea3752bd2105ff` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:20.596784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219c4d9-7f67-427d-a3f7-3250e9b72cd9 None admin] RBAC: Authorizing `identity:get_project(project_id=5fa638df7f994683a3ea3752bd2105ff)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:20.598230 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219c4d9-7f67-427d-a3f7-3250e9b72cd9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:20.599892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 561/1116] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:46:20 2022] GET /identity/v3/projects/5fa638df7f994683a3ea3752bd2105ff => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:20.606057 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3acf3d-c624-43f3-ab4d-0aa106436e54 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:20.702358 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3acf3d-c624-43f3-ab4d-0aa106436e54 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:20.736679 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762ca42-8e01-4ac7-9bf5-b93b256dea8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:20.737331 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762ca42-8e01-4ac7-9bf5-b93b256dea8c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:20.737616 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762ca42-8e01-4ac7-9bf5-b93b256dea8c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:20.737899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762ca42-8e01-4ac7-9bf5-b93b256dea8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:20.738690 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762ca42-8e01-4ac7-9bf5-b93b256dea8c None admin] RBAC: Adding query filter params (role.id=e2024b6eae3d49f09caa7d4275eb88bc, scope.project.id=5fa638df7f994683a3ea3752bd2105ff, user.id=208e357d484a4cc6a5283c8155c22ff7) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:20.739003 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762ca42-8e01-4ac7-9bf5-b93b256dea8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:20.740516 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762ca42-8e01-4ac7-9bf5-b93b256dea8c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:20.745929 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 556/1117] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:46:20 2022] GET /identity/v3/role_assignments?user.id=208e357d484a4cc6a5283c8155c22ff7&scope.project.id=5fa638df7f994683a3ea3752bd2105ff&role.id=e2024b6eae3d49f09caa7d4275eb88bc => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:22.708691 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e7e13-0638-416e-b743-adb238d9a687 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:22.709269 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e7e13-0638-416e-b743-adb238d9a687 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:22.709269 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e7e13-0638-416e-b743-adb238d9a687 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:22.710619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 562/1118] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:22.716335 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d808d7-02a1-4c0c-85fe-26ea80eda066 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:22.716792 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d808d7-02a1-4c0c-85fe-26ea80eda066 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:22.716901 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d808d7-02a1-4c0c-85fe-26ea80eda066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:22.735774 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-22d808d7-02a1-4c0c-85fe-26ea80eda066 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:22.737003 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-22d808d7-02a1-4c0c-85fe-26ea80eda066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:22.750279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:22.805913 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 557/1119] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:22.829033 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e7e13-0638-416e-b743-adb238d9a687 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:22.864724 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:22.929828 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e7e13-0638-416e-b743-adb238d9a687 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:22.962262 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e2f34-3d89-4546-9696-9e2a974ff8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:22.962838 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e2f34-3d89-4546-9696-9e2a974ff8cc None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:22.963125 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e2f34-3d89-4546-9696-9e2a974ff8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:22.963397 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e2f34-3d89-4546-9696-9e2a974ff8cc None admin] PATH_INFO: `/v3/roles/e2024b6eae3d49f09caa7d4275eb88bc` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:22.964849 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e2f34-3d89-4546-9696-9e2a974ff8cc None admin] RBAC: Authorizing `identity:get_role(role_id=e2024b6eae3d49f09caa7d4275eb88bc)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:22.966832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e2f34-3d89-4546-9696-9e2a974ff8cc None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:22.968164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 563/1120] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:22 2022] GET /identity/v3/roles/e2024b6eae3d49f09caa7d4275eb88bc => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:22.974019 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d808d7-02a1-4c0c-85fe-26ea80eda066 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:23.070168 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d808d7-02a1-4c0c-85fe-26ea80eda066 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:23.103752 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d95fa6-9166-4dec-9b10-7046102c60aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:23.104385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d95fa6-9166-4dec-9b10-7046102c60aa None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:23.104668 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d95fa6-9166-4dec-9b10-7046102c60aa None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:23.104973 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d95fa6-9166-4dec-9b10-7046102c60aa None admin] PATH_INFO: `/v3/users/208e357d484a4cc6a5283c8155c22ff7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:23.106162 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d95fa6-9166-4dec-9b10-7046102c60aa None admin] RBAC: Authorizing `identity:get_user(user_id=208e357d484a4cc6a5283c8155c22ff7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:23.108078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d95fa6-9166-4dec-9b10-7046102c60aa None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:23.109698 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 558/1121] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:22 2022] GET /identity/v3/users/208e357d484a4cc6a5283c8155c22ff7 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:23.115365 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e2f34-3d89-4546-9696-9e2a974ff8cc None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:23.210916 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e2f34-3d89-4546-9696-9e2a974ff8cc None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:23.212455 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:23.245733 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b7824-1ccb-4bf1-b00a-2ad93604a02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:23.246362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b7824-1ccb-4bf1-b00a-2ad93604a02c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:23.246641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b7824-1ccb-4bf1-b00a-2ad93604a02c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:23.246984 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b7824-1ccb-4bf1-b00a-2ad93604a02c None admin] PATH_INFO: `/v3/projects/5fa638df7f994683a3ea3752bd2105ff` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:23.248143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b7824-1ccb-4bf1-b00a-2ad93604a02c None admin] RBAC: Authorizing `identity:get_project(project_id=5fa638df7f994683a3ea3752bd2105ff)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:23.249606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b7824-1ccb-4bf1-b00a-2ad93604a02c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:23.251244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 564/1122] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:46:23 2022] GET /identity/v3/projects/5fa638df7f994683a3ea3752bd2105ff => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:23.257193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d95fa6-9166-4dec-9b10-7046102c60aa None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:23.275068 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:23.354982 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d95fa6-9166-4dec-9b10-7046102c60aa None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:23.388468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360b380-1404-47cd-8572-27c262a80bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:23.389147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360b380-1404-47cd-8572-27c262a80bef None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:23.389428 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360b380-1404-47cd-8572-27c262a80bef None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:23.389700 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360b380-1404-47cd-8572-27c262a80bef None admin] PATH_INFO: `/v3/projects/5fa638df7f994683a3ea3752bd2105ff/users/208e357d484a4cc6a5283c8155c22ff7/roles/e2024b6eae3d49f09caa7d4275eb88bc` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:23.391820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360b380-1404-47cd-8572-27c262a80bef None admin] RBAC: Authorizing `identity:create_grant(project_id=5fa638df7f994683a3ea3752bd2105ff, user_id=208e357d484a4cc6a5283c8155c22ff7, role_id=e2024b6eae3d49f09caa7d4275eb88bc)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:23.393263 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360b380-1404-47cd-8572-27c262a80bef None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:23.472809 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 559/1123] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:46:23 2022] PUT /identity/v3/projects/5fa638df7f994683a3ea3752bd2105ff/users/208e357d484a4cc6a5283c8155c22ff7/roles/e2024b6eae3d49f09caa7d4275eb88bc => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:46:25.453341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce72bd-1ed0-4fc4-8ab1-22f0695126e9 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:25.453882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce72bd-1ed0-4fc4-8ab1-22f0695126e9 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:25.453882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce72bd-1ed0-4fc4-8ab1-22f0695126e9 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:25.455230 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 565/1124] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:25.460437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e540b-a179-45a2-9750-958272abbe5b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:25.460867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e540b-a179-45a2-9750-958272abbe5b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:25.461019 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e540b-a179-45a2-9750-958272abbe5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:25.478630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4d5e540b-a179-45a2-9750-958272abbe5b None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:25.479810 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4d5e540b-a179-45a2-9750-958272abbe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:25.544190 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 560/1125] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:25.567454 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce72bd-1ed0-4fc4-8ab1-22f0695126e9 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:25.666644 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce72bd-1ed0-4fc4-8ab1-22f0695126e9 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:25.700623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe72638-402e-4197-bc64-43bea8e7a306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:25.701287 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe72638-402e-4197-bc64-43bea8e7a306 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:25.701572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe72638-402e-4197-bc64-43bea8e7a306 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:25.701848 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe72638-402e-4197-bc64-43bea8e7a306 None admin] PATH_INFO: `/v3/roles/e2024b6eae3d49f09caa7d4275eb88bc` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:25.703283 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe72638-402e-4197-bc64-43bea8e7a306 None admin] RBAC: Authorizing `identity:get_role(role_id=e2024b6eae3d49f09caa7d4275eb88bc)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:25.704668 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe72638-402e-4197-bc64-43bea8e7a306 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:25.706050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 566/1126] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:25 2022] GET /identity/v3/roles/e2024b6eae3d49f09caa7d4275eb88bc => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:25.712017 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e540b-a179-45a2-9750-958272abbe5b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:25.719985 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:25.811008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e540b-a179-45a2-9750-958272abbe5b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:25.843574 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e9be8-f146-45d8-a797-36a7bccc9b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:25.844217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e9be8-f146-45d8-a797-36a7bccc9b4f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:25.844494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e9be8-f146-45d8-a797-36a7bccc9b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:25.844807 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e9be8-f146-45d8-a797-36a7bccc9b4f None admin] PATH_INFO: `/v3/users/208e357d484a4cc6a5283c8155c22ff7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:25.845951 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e9be8-f146-45d8-a797-36a7bccc9b4f None admin] RBAC: Authorizing `identity:get_user(user_id=208e357d484a4cc6a5283c8155c22ff7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:25.847377 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e9be8-f146-45d8-a797-36a7bccc9b4f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:25.849014 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 561/1127] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:25 2022] GET /identity/v3/users/208e357d484a4cc6a5283c8155c22ff7 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:25.854790 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe72638-402e-4197-bc64-43bea8e7a306 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:25.894597 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:25.968319 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe72638-402e-4197-bc64-43bea8e7a306 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:26.002564 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a740e0c-f7d4-4147-b8b9-9f79351ace02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:26.003183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a740e0c-f7d4-4147-b8b9-9f79351ace02 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:26.003465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a740e0c-f7d4-4147-b8b9-9f79351ace02 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:26.003767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a740e0c-f7d4-4147-b8b9-9f79351ace02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:26.069252 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a740e0c-f7d4-4147-b8b9-9f79351ace02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:26.070704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a740e0c-f7d4-4147-b8b9-9f79351ace02 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:26.107804 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:26.165299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 567/1128] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:46:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:46:26.172076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e9be8-f146-45d8-a797-36a7bccc9b4f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:26.243946 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:26.276938 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e9be8-f146-45d8-a797-36a7bccc9b4f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:26.317322 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158d543-ba2c-42f8-82a4-578152624e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:26.317955 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158d543-ba2c-42f8-82a4-578152624e02 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:26.318234 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158d543-ba2c-42f8-82a4-578152624e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:26.318504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158d543-ba2c-42f8-82a4-578152624e02 None admin] PATH_INFO: `/v3/projects/5fa638df7f994683a3ea3752bd2105ff` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:26.319642 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158d543-ba2c-42f8-82a4-578152624e02 None admin] RBAC: Authorizing `identity:get_project(project_id=5fa638df7f994683a3ea3752bd2105ff)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:26.321090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158d543-ba2c-42f8-82a4-578152624e02 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:26.322763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 562/1129] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:46:26 2022] GET /identity/v3/projects/5fa638df7f994683a3ea3752bd2105ff => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:26.329012 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a740e0c-f7d4-4147-b8b9-9f79351ace02 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:26.427231 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a740e0c-f7d4-4147-b8b9-9f79351ace02 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:26.460225 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc810d15-6bf3-46bd-a95a-5a3ab285f749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:26.460865 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc810d15-6bf3-46bd-a95a-5a3ab285f749 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:26.461146 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc810d15-6bf3-46bd-a95a-5a3ab285f749 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:26.461419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc810d15-6bf3-46bd-a95a-5a3ab285f749 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:26.462205 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc810d15-6bf3-46bd-a95a-5a3ab285f749 None admin] RBAC: Adding query filter params (role.id=e2024b6eae3d49f09caa7d4275eb88bc, scope.project.id=5fa638df7f994683a3ea3752bd2105ff, user.id=208e357d484a4cc6a5283c8155c22ff7) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:26.462522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc810d15-6bf3-46bd-a95a-5a3ab285f749 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:26.463959 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc810d15-6bf3-46bd-a95a-5a3ab285f749 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:26.469631 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 568/1130] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:46:26 2022] GET /identity/v3/role_assignments?user.id=208e357d484a4cc6a5283c8155c22ff7&scope.project.id=5fa638df7f994683a3ea3752bd2105ff&role.id=e2024b6eae3d49f09caa7d4275eb88bc => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:28.462196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5bcc0-0b97-4f93-9cfa-bc2e71d01506 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:28.462735 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5bcc0-0b97-4f93-9cfa-bc2e71d01506 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:28.462735 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5bcc0-0b97-4f93-9cfa-bc2e71d01506 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:28.464086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 563/1131] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:28.469799 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7e7de-e2f3-4bf2-87c3-35c844831288 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:28.470194 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7e7de-e2f3-4bf2-87c3-35c844831288 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:28.470359 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7e7de-e2f3-4bf2-87c3-35c844831288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:28.476669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:28.489178 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0ea7e7de-e2f3-4bf2-87c3-35c844831288 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:28.495803 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0ea7e7de-e2f3-4bf2-87c3-35c844831288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:28.555623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 569/1132] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:28.578217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5bcc0-0b97-4f93-9cfa-bc2e71d01506 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:28.686353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5bcc0-0b97-4f93-9cfa-bc2e71d01506 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:28.720642 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db2536-5b21-49cc-83df-dc049f515208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:28.721304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db2536-5b21-49cc-83df-dc049f515208 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:28.721584 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db2536-5b21-49cc-83df-dc049f515208 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:28.721853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db2536-5b21-49cc-83df-dc049f515208 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:28.722989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db2536-5b21-49cc-83df-dc049f515208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:28.724423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db2536-5b21-49cc-83df-dc049f515208 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:28.726126 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 564/1133] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:28.732780 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7e7de-e2f3-4bf2-87c3-35c844831288 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:28.830492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7e7de-e2f3-4bf2-87c3-35c844831288 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:28.860465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:28.865503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f17bb8-12a7-4df7-bf5e-73cd7d36889a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:28.866121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f17bb8-12a7-4df7-bf5e-73cd7d36889a None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:28.866402 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f17bb8-12a7-4df7-bf5e-73cd7d36889a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:28.866674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f17bb8-12a7-4df7-bf5e-73cd7d36889a None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:28.867368 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f17bb8-12a7-4df7-bf5e-73cd7d36889a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:28.868861 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f17bb8-12a7-4df7-bf5e-73cd7d36889a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:28.986588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 570/1134] 10.222.0.75 () {60 vars in 1141 bytes} [Thu Jul 28 17:46:28 2022] POST /identity/v3/projects => generated 311 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:46:31.024798 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbe78e-d8fa-4a7e-ad47-5cb71c452ea4 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:31.025335 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbe78e-d8fa-4a7e-ad47-5cb71c452ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:31.025335 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbe78e-d8fa-4a7e-ad47-5cb71c452ea4 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:31.026689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 565/1135] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:31.032529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c0b60-96f9-408f-b2a1-6362e45b59b3 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:31.033004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c0b60-96f9-408f-b2a1-6362e45b59b3 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:31.033121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c0b60-96f9-408f-b2a1-6362e45b59b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:31.050660 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-bf6c0b60-96f9-408f-b2a1-6362e45b59b3 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:31.051842 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bf6c0b60-96f9-408f-b2a1-6362e45b59b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:31.116025 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 571/1136] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:31.140391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbe78e-d8fa-4a7e-ad47-5cb71c452ea4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:31.152692 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:31.243355 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbe78e-d8fa-4a7e-ad47-5cb71c452ea4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:31.276794 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d723c-78dd-4797-9055-33a74c666aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:31.277355 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d723c-78dd-4797-9055-33a74c666aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:31.277738 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d723c-78dd-4797-9055-33a74c666aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:31.278517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d723c-78dd-4797-9055-33a74c666aa7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:31.279674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d723c-78dd-4797-9055-33a74c666aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:31.281137 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d723c-78dd-4797-9055-33a74c666aa7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:31.282724 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 566/1137] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:31.288549 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c0b60-96f9-408f-b2a1-6362e45b59b3 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:31.386296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c0b60-96f9-408f-b2a1-6362e45b59b3 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:31.400544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:31.419882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb5dd4-e84e-484a-815d-9b472e33f337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:31.420506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb5dd4-e84e-484a-815d-9b472e33f337 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:31.420815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb5dd4-e84e-484a-815d-9b472e33f337 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:31.421098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb5dd4-e84e-484a-815d-9b472e33f337 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:31.421795 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb5dd4-e84e-484a-815d-9b472e33f337 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:31.423250 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb5dd4-e84e-484a-815d-9b472e33f337 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:31.515381 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 572/1138] 10.222.0.75 () {60 vars in 1132 bytes} [Thu Jul 28 17:46:31 2022] POST /identity/v3/users => generated 286 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:46:33.547635 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c5d79-64e2-42dc-b910-ba894b6224db None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:33.548191 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c5d79-64e2-42dc-b910-ba894b6224db None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:33.548191 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c5d79-64e2-42dc-b910-ba894b6224db None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:33.549577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 567/1139] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:33.554642 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14a2da-81cd-4089-ae2b-8a14f7095837 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:33.555037 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14a2da-81cd-4089-ae2b-8a14f7095837 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:33.555201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14a2da-81cd-4089-ae2b-8a14f7095837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:33.573353 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-7e14a2da-81cd-4089-ae2b-8a14f7095837 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:33.575127 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7e14a2da-81cd-4089-ae2b-8a14f7095837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:33.639693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 573/1140] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:33.662509 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c5d79-64e2-42dc-b910-ba894b6224db None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:33.744899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:33.767427 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c5d79-64e2-42dc-b910-ba894b6224db None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:33.800836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb12fd-bd82-42be-9c38-01ebb360b4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:33.801470 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb12fd-bd82-42be-9c38-01ebb360b4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:33.801752 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb12fd-bd82-42be-9c38-01ebb360b4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:33.802022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb12fd-bd82-42be-9c38-01ebb360b4d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:33.812345 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb12fd-bd82-42be-9c38-01ebb360b4d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:46:33.817222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-4ccb12fd-bd82-42be-9c38-01ebb360b4d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:33.817222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:33.817222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:33.817222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:33.817222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:33.817222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:33.817222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:33.817222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:33.817222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:33.817222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:33.817222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:33.817222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:33.817222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:46:33.817222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:46:33.817222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:46:33.817222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:46:33.823253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:46:33.823253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:46:33.823253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:46:33.823253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:46:33.823253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:33.823253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:33.823253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:33.823253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:33.823253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:33.823253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:33.823253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:33.823253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:33.823253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:33.823253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:33.823253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:33.823253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:33.824412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:33.824412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:33.824412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:33.824412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:33.824412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:46:33.824412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:46:33.824412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:46:33.824412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:46:33.824412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:46:33.824412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:46:33.824412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:33.824412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:33.824412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 568/1141] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:46:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:33.825924 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14a2da-81cd-4089-ae2b-8a14f7095837 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:33.917825 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:33.921304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14a2da-81cd-4089-ae2b-8a14f7095837 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:33.958376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa005ad-b84d-4dc3-a6a0-bd8190bbe852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:33.959060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa005ad-b84d-4dc3-a6a0-bd8190bbe852 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:33.959348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa005ad-b84d-4dc3-a6a0-bd8190bbe852 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:33.961253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa005ad-b84d-4dc3-a6a0-bd8190bbe852 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:33.961253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa005ad-b84d-4dc3-a6a0-bd8190bbe852 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:33.961253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa005ad-b84d-4dc3-a6a0-bd8190bbe852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:33.962057 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa005ad-b84d-4dc3-a6a0-bd8190bbe852 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:33.971160 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 574/1142] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:46:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:33.977221 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb12fd-bd82-42be-9c38-01ebb360b4d6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:34.076361 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb12fd-bd82-42be-9c38-01ebb360b4d6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:34.108902 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f27649-0d7f-4af8-b7e6-a3f07075af61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:34.109537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f27649-0d7f-4af8-b7e6-a3f07075af61 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:34.109819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f27649-0d7f-4af8-b7e6-a3f07075af61 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:34.110097 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f27649-0d7f-4af8-b7e6-a3f07075af61 None admin] PATH_INFO: `/v3/users/1bfcae7c992a4a54b4713a30575e813f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:34.117591 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:34.123781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f27649-0d7f-4af8-b7e6-a3f07075af61 None admin] RBAC: Authorizing `identity:get_user(user_id=1bfcae7c992a4a54b4713a30575e813f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:34.125258 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f27649-0d7f-4af8-b7e6-a3f07075af61 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:34.130539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 569/1143] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:33 2022] GET /identity/v3/users/1bfcae7c992a4a54b4713a30575e813f => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:34.132876 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa005ad-b84d-4dc3-a6a0-bd8190bbe852 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:34.232048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa005ad-b84d-4dc3-a6a0-bd8190bbe852 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:34.264915 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86e22b-b09a-495b-a9c1-bcbf0d4b50ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:34.265537 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86e22b-b09a-495b-a9c1-bcbf0d4b50ba None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:34.265815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86e22b-b09a-495b-a9c1-bcbf0d4b50ba None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:34.266088 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86e22b-b09a-495b-a9c1-bcbf0d4b50ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:34.304574 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:34.345992 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86e22b-b09a-495b-a9c1-bcbf0d4b50ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:34.347624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86e22b-b09a-495b-a9c1-bcbf0d4b50ba None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:34.444814 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 575/1144] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:46:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:46:34.451419 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f27649-0d7f-4af8-b7e6-a3f07075af61 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:34.547785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f27649-0d7f-4af8-b7e6-a3f07075af61 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:34.581081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053c399-e585-4d4b-8a3e-be4973bc174e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:34.581716 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053c399-e585-4d4b-8a3e-be4973bc174e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:34.581999 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053c399-e585-4d4b-8a3e-be4973bc174e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:34.582300 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053c399-e585-4d4b-8a3e-be4973bc174e None admin] PATH_INFO: `/v3/projects/763e7879a2f845788dbc47bea49592d9` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:34.583430 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053c399-e585-4d4b-8a3e-be4973bc174e None admin] RBAC: Authorizing `identity:get_project(project_id=763e7879a2f845788dbc47bea49592d9)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:34.584889 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053c399-e585-4d4b-8a3e-be4973bc174e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:34.586541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 570/1145] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:46:34 2022] GET /identity/v3/projects/763e7879a2f845788dbc47bea49592d9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:34.592587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86e22b-b09a-495b-a9c1-bcbf0d4b50ba None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:34.651209 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:34.688248 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86e22b-b09a-495b-a9c1-bcbf0d4b50ba None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:34.720483 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199610ec-4a49-4c8c-b507-9d9008324c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:34.721114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199610ec-4a49-4c8c-b507-9d9008324c23 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:34.721390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199610ec-4a49-4c8c-b507-9d9008324c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:34.721657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199610ec-4a49-4c8c-b507-9d9008324c23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:34.722429 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199610ec-4a49-4c8c-b507-9d9008324c23 None admin] RBAC: Adding query filter params (role.id=d371062e071845ffa4570a76d40dff88, scope.project.id=763e7879a2f845788dbc47bea49592d9, user.id=1bfcae7c992a4a54b4713a30575e813f) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:34.722741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199610ec-4a49-4c8c-b507-9d9008324c23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:34.724163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199610ec-4a49-4c8c-b507-9d9008324c23 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:34.729357 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 576/1146] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:46:34 2022] GET /identity/v3/role_assignments?user.id=1bfcae7c992a4a54b4713a30575e813f&scope.project.id=763e7879a2f845788dbc47bea49592d9&role.id=d371062e071845ffa4570a76d40dff88 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:36.698376 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3c7bb-8bb0-429f-a011-08dbd5ab8903 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:36.698955 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3c7bb-8bb0-429f-a011-08dbd5ab8903 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:36.699368 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3c7bb-8bb0-429f-a011-08dbd5ab8903 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:36.701577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 571/1147] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:36.711571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb91f8-38df-48fe-9a03-cfcf64d71f69 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:36.712007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb91f8-38df-48fe-9a03-cfcf64d71f69 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:36.712112 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb91f8-38df-48fe-9a03-cfcf64d71f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:36.731093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-60eb91f8-38df-48fe-9a03-cfcf64d71f69 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:36.732369 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-60eb91f8-38df-48fe-9a03-cfcf64d71f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:36.800257 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 577/1148] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:36.822598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3c7bb-8bb0-429f-a011-08dbd5ab8903 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:36.884985 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:36.922748 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3c7bb-8bb0-429f-a011-08dbd5ab8903 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:36.957244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738460f-9c90-44aa-869f-f887b24c71e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:36.957805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738460f-9c90-44aa-869f-f887b24c71e4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:36.958085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738460f-9c90-44aa-869f-f887b24c71e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:36.958356 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738460f-9c90-44aa-869f-f887b24c71e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:36.971273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738460f-9c90-44aa-869f-f887b24c71e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:46:36.976209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-0738460f-9c90-44aa-869f-f887b24c71e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:36.976209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:36.976209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:36.976209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:36.976209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:36.976209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:36.976209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:36.976209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:36.976209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:36.976209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:36.976209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:36.976209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:36.976209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:46:36.976209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:46:36.976209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:46:36.976209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:46:36.977381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:46:36.977381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:46:36.977381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:46:36.977381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:46:36.977381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:36.977381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:36.977381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:36.977381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:36.977381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:36.977381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:36.977381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:36.977381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:36.977381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:36.977381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:36.977381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:36.977381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:36.978230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:36.978230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:36.978230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:36.978230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:36.978230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:46:36.978230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:46:36.978230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:46:36.978230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:46:36.978230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:46:36.978230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:46:36.978230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:36.978230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:36.978230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 572/1149] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:46:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:36.983547 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb91f8-38df-48fe-9a03-cfcf64d71f69 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:37.038923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:37.085959 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb91f8-38df-48fe-9a03-cfcf64d71f69 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:37.119094 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f95be0-dcec-426e-9fce-8f85739242e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:37.119710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95be0-dcec-426e-9fce-8f85739242e3 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:37.119991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95be0-dcec-426e-9fce-8f85739242e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:37.120265 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95be0-dcec-426e-9fce-8f85739242e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:37.121043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f95be0-dcec-426e-9fce-8f85739242e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:37.121355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f95be0-dcec-426e-9fce-8f85739242e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:37.122735 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f95be0-dcec-426e-9fce-8f85739242e3 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:37.130556 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 578/1150] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:46:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:37.136363 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738460f-9c90-44aa-869f-f887b24c71e4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:37.235093 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738460f-9c90-44aa-869f-f887b24c71e4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:37.257262 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:37.268112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594606b6-41f7-4fab-bcb2-82e59c649cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:37.268775 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594606b6-41f7-4fab-bcb2-82e59c649cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:37.269131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594606b6-41f7-4fab-bcb2-82e59c649cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:37.269410 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594606b6-41f7-4fab-bcb2-82e59c649cd0 None admin] PATH_INFO: `/v3/users/1bfcae7c992a4a54b4713a30575e813f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:37.270817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594606b6-41f7-4fab-bcb2-82e59c649cd0 None admin] RBAC: Authorizing `identity:get_user(user_id=1bfcae7c992a4a54b4713a30575e813f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:37.272242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594606b6-41f7-4fab-bcb2-82e59c649cd0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:37.273879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 573/1151] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:37 2022] GET /identity/v3/users/1bfcae7c992a4a54b4713a30575e813f => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:37.280187 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f95be0-dcec-426e-9fce-8f85739242e3 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:37.379965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f95be0-dcec-426e-9fce-8f85739242e3 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:37.397261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:37.413613 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9694cc-2c6a-471a-bdc8-5aee6f987602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:37.414251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9694cc-2c6a-471a-bdc8-5aee6f987602 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:37.414532 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9694cc-2c6a-471a-bdc8-5aee6f987602 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:37.414808 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9694cc-2c6a-471a-bdc8-5aee6f987602 None admin] PATH_INFO: `/v3/projects/763e7879a2f845788dbc47bea49592d9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:37.416011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9694cc-2c6a-471a-bdc8-5aee6f987602 None admin] RBAC: Authorizing `identity:get_project(project_id=763e7879a2f845788dbc47bea49592d9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:37.417520 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9694cc-2c6a-471a-bdc8-5aee6f987602 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:37.419212 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 579/1152] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:46:37 2022] GET /identity/v3/projects/763e7879a2f845788dbc47bea49592d9 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:37.425426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594606b6-41f7-4fab-bcb2-82e59c649cd0 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:37.522611 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594606b6-41f7-4fab-bcb2-82e59c649cd0 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:37.554848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9ba99-216d-4382-8908-957ad29e8039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:37.555508 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9ba99-216d-4382-8908-957ad29e8039 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:37.555793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9ba99-216d-4382-8908-957ad29e8039 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:37.556073 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9ba99-216d-4382-8908-957ad29e8039 None admin] PATH_INFO: `/v3/projects/763e7879a2f845788dbc47bea49592d9/users/1bfcae7c992a4a54b4713a30575e813f/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:37.558021 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9ba99-216d-4382-8908-957ad29e8039 None admin] RBAC: Authorizing `identity:create_grant(project_id=763e7879a2f845788dbc47bea49592d9, user_id=1bfcae7c992a4a54b4713a30575e813f, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:37.560025 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9ba99-216d-4382-8908-957ad29e8039 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:37.683123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 574/1153] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:46:37 2022] PUT /identity/v3/projects/763e7879a2f845788dbc47bea49592d9/users/1bfcae7c992a4a54b4713a30575e813f/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:46:39.674575 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d25c25-3905-4e6d-b089-8a42b88f970d None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:39.675088 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d25c25-3905-4e6d-b089-8a42b88f970d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:39.675179 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d25c25-3905-4e6d-b089-8a42b88f970d None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:39.676484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 580/1154] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:39.681626 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb4573-fa18-4672-b6f9-717c8f410dc3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:39.682008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb4573-fa18-4672-b6f9-717c8f410dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:39.682179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb4573-fa18-4672-b6f9-717c8f410dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:39.700921 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0ecb4573-fa18-4672-b6f9-717c8f410dc3 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:39.702088 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0ecb4573-fa18-4672-b6f9-717c8f410dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:39.746350 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:39.765386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 575/1155] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:39.788270 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d25c25-3905-4e6d-b089-8a42b88f970d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:39.890384 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d25c25-3905-4e6d-b089-8a42b88f970d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:39.923676 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b255d1-aa6c-499a-93b5-8ad00a414faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:39.924317 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b255d1-aa6c-499a-93b5-8ad00a414faf None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:39.924647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b255d1-aa6c-499a-93b5-8ad00a414faf None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:39.924910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b255d1-aa6c-499a-93b5-8ad00a414faf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:39.935771 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b255d1-aa6c-499a-93b5-8ad00a414faf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:46:39.940693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-e4b255d1-aa6c-499a-93b5-8ad00a414faf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:39.940693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:39.940693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:39.940693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:39.940693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:39.940693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:39.940693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:39.940693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:39.940693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:39.940693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:39.940693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:39.940693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:39.940693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:46:39.940693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:46:39.940693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:46:39.940693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:46:39.941787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:46:39.941787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:46:39.941787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:46:39.941787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:46:39.941787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:39.941787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:39.941787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:39.941787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:39.941787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:39.941787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:39.941787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:39.941787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:39.941787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:39.941787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:39.941787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:39.941787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:39.942826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:39.942826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:39.942826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:39.942826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:39.942826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:46:39.942826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:46:39.942826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:46:39.942826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:46:39.942826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:46:39.942826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:46:39.942826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:39.942826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:46:39.942826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 581/1156] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:46:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:39.947986 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb4573-fa18-4672-b6f9-717c8f410dc3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:40.045405 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb4573-fa18-4672-b6f9-717c8f410dc3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:40.078172 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb7192-729a-4ac3-af43-743aff2c1e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:40.078787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb7192-729a-4ac3-af43-743aff2c1e22 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:40.079066 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb7192-729a-4ac3-af43-743aff2c1e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:40.079339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb7192-729a-4ac3-af43-743aff2c1e22 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:40.080237 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb7192-729a-4ac3-af43-743aff2c1e22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:40.080344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb7192-729a-4ac3-af43-743aff2c1e22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:40.081745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb7192-729a-4ac3-af43-743aff2c1e22 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:40.089615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 576/1157] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:46:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:40.095432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b255d1-aa6c-499a-93b5-8ad00a414faf None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:40.140705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:40.192173 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b255d1-aa6c-499a-93b5-8ad00a414faf None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:40.223654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d0d71-0fdf-4cd4-90f6-42b9fbfa2052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:40.224280 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d0d71-0fdf-4cd4-90f6-42b9fbfa2052 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:40.224558 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d0d71-0fdf-4cd4-90f6-42b9fbfa2052 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:40.224854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d0d71-0fdf-4cd4-90f6-42b9fbfa2052 None admin] PATH_INFO: `/v3/users/1bfcae7c992a4a54b4713a30575e813f` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:40.225987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d0d71-0fdf-4cd4-90f6-42b9fbfa2052 None admin] RBAC: Authorizing `identity:get_user(user_id=1bfcae7c992a4a54b4713a30575e813f)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:40.227431 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d0d71-0fdf-4cd4-90f6-42b9fbfa2052 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:40.229031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 582/1158] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:40 2022] GET /identity/v3/users/1bfcae7c992a4a54b4713a30575e813f => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:40.235268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb7192-729a-4ac3-af43-743aff2c1e22 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:40.280563 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:40.333493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb7192-729a-4ac3-af43-743aff2c1e22 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:40.367008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743cc09-a954-4a89-9419-07d599ea647d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:40.367619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743cc09-a954-4a89-9419-07d599ea647d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:40.367900 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743cc09-a954-4a89-9419-07d599ea647d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:40.368173 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743cc09-a954-4a89-9419-07d599ea647d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:40.433399 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743cc09-a954-4a89-9419-07d599ea647d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:40.434844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743cc09-a954-4a89-9419-07d599ea647d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:40.477599 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:40.531345 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 577/1159] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:46:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:46:40.537276 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d0d71-0fdf-4cd4-90f6-42b9fbfa2052 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:40.635947 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d0d71-0fdf-4cd4-90f6-42b9fbfa2052 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:40.649685 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:40.669651 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f695a1-8192-45d9-b6c1-65b38242cf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:40.670291 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f695a1-8192-45d9-b6c1-65b38242cf57 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:40.670577 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f695a1-8192-45d9-b6c1-65b38242cf57 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:40.670877 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f695a1-8192-45d9-b6c1-65b38242cf57 None admin] PATH_INFO: `/v3/projects/763e7879a2f845788dbc47bea49592d9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:40.672031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f695a1-8192-45d9-b6c1-65b38242cf57 None admin] RBAC: Authorizing `identity:get_project(project_id=763e7879a2f845788dbc47bea49592d9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:40.673517 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f695a1-8192-45d9-b6c1-65b38242cf57 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:40.675245 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 583/1160] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:46:40 2022] GET /identity/v3/projects/763e7879a2f845788dbc47bea49592d9 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:40.681476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743cc09-a954-4a89-9419-07d599ea647d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:40.777304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743cc09-a954-4a89-9419-07d599ea647d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:40.810953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d75c1a-b9f1-4e18-8f45-efa0aaa26e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:40.811560 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d75c1a-b9f1-4e18-8f45-efa0aaa26e07 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:40.811846 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d75c1a-b9f1-4e18-8f45-efa0aaa26e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:40.812122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d75c1a-b9f1-4e18-8f45-efa0aaa26e07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:40.812929 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d75c1a-b9f1-4e18-8f45-efa0aaa26e07 None admin] RBAC: Adding query filter params (role.id=d371062e071845ffa4570a76d40dff88, scope.project.id=763e7879a2f845788dbc47bea49592d9, user.id=1bfcae7c992a4a54b4713a30575e813f) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:40.813238 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d75c1a-b9f1-4e18-8f45-efa0aaa26e07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:40.814961 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d75c1a-b9f1-4e18-8f45-efa0aaa26e07 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:40.820683 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 578/1161] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:46:40 2022] GET /identity/v3/role_assignments?user.id=1bfcae7c992a4a54b4713a30575e813f&scope.project.id=763e7879a2f845788dbc47bea49592d9&role.id=d371062e071845ffa4570a76d40dff88 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:42.815250 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d64f1-8359-4c03-a3f7-0ef5b66d9282 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:42.815807 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d64f1-8359-4c03-a3f7-0ef5b66d9282 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:42.815807 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d64f1-8359-4c03-a3f7-0ef5b66d9282 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:42.817202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 584/1162] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:42.822329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8b1d3-d671-4da7-a318-406ac2665f2a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:42.822728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8b1d3-d671-4da7-a318-406ac2665f2a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:42.822880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8b1d3-d671-4da7-a318-406ac2665f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:42.843943 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c8e8b1d3-d671-4da7-a318-406ac2665f2a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:42.845182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c8e8b1d3-d671-4da7-a318-406ac2665f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:42.847156 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:42.913361 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 579/1163] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:42.935280 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d64f1-8359-4c03-a3f7-0ef5b66d9282 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:43.038490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d64f1-8359-4c03-a3f7-0ef5b66d9282 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:43.071444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57528f99-94d8-4657-9cec-76148f6297b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:43.071991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57528f99-94d8-4657-9cec-76148f6297b4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:43.072276 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57528f99-94d8-4657-9cec-76148f6297b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:43.072553 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57528f99-94d8-4657-9cec-76148f6297b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:43.119930 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:43.138190 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57528f99-94d8-4657-9cec-76148f6297b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:43.139694 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57528f99-94d8-4657-9cec-76148f6297b4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:43.235590 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 585/1164] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:46:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:46:43.241630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8b1d3-d671-4da7-a318-406ac2665f2a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:43.337902 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8b1d3-d671-4da7-a318-406ac2665f2a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:43.371273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cca465-4cac-46e2-b6e6-41c6c66b8f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:43.371905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cca465-4cac-46e2-b6e6-41c6c66b8f62 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:43.372183 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cca465-4cac-46e2-b6e6-41c6c66b8f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:43.372453 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cca465-4cac-46e2-b6e6-41c6c66b8f62 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:43.378975 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cca465-4cac-46e2-b6e6-41c6c66b8f62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:43.380416 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cca465-4cac-46e2-b6e6-41c6c66b8f62 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:43.382058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:43.392681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-f4cca465-4cac-46e2-b6e6-41c6c66b8f62 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 17:46:43.392681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:43.392681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 28 17:46:43.392681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 28 17:46:43.392681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:46:43.392681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:46:43.392681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:46:43.392681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:46:43.392681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 28 17:46:43.392681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:43.392681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:46:43.392681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:43.392681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:43.392681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:43.392681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:43.392681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:43.392681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:43.396406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:43.396406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:43.396406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:43.396406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:43.396406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:43.396406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:43.396406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:46:43.396406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:46:43.396406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:46:43.396406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:46:43.396406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:43.396406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:43.396406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:43.396406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:43.396406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:43.396406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:43.397512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:43.397512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:43.397512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:43.397512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:43.397512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:43.397512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:43.397512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:43.397512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:43.397512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:43.397512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:43.397512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 28 17:46:43.397512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:46:43.397512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 17:46:43.397512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:43.397512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 580/1165] 10.222.0.75 () {56 vars in 1117 bytes} [Thu Jul 28 17:46:43 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:46:43.400352 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57528f99-94d8-4657-9cec-76148f6297b4 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:43.479162 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:43.496737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57528f99-94d8-4657-9cec-76148f6297b4 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:43.530108 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56a802-eeb5-4e64-934a-7a8c472645bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:43.530719 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56a802-eeb5-4e64-934a-7a8c472645bf None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:43.531007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56a802-eeb5-4e64-934a-7a8c472645bf None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:43.531283 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56a802-eeb5-4e64-934a-7a8c472645bf None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:43.531968 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56a802-eeb5-4e64-934a-7a8c472645bf None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:43.532274 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56a802-eeb5-4e64-934a-7a8c472645bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:43.533691 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56a802-eeb5-4e64-934a-7a8c472645bf None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:43.540694 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 586/1166] 10.222.0.75 () {56 vars in 1115 bytes} [Thu Jul 28 17:46:43 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:45.518442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda7ee6-b0a6-4ae9-810e-62d84ee8a206 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:45.518954 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda7ee6-b0a6-4ae9-810e-62d84ee8a206 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:45.519047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda7ee6-b0a6-4ae9-810e-62d84ee8a206 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:45.520616 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 581/1167] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:46:45.525964 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc005e-7372-49ee-b23f-1e5402ac1e36 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:45.526392 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc005e-7372-49ee-b23f-1e5402ac1e36 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:45.526494 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc005e-7372-49ee-b23f-1e5402ac1e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:45.544950 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-bafc005e-7372-49ee-b23f-1e5402ac1e36 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:45.546128 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bafc005e-7372-49ee-b23f-1e5402ac1e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:45.611181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 587/1168] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:45.633973 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda7ee6-b0a6-4ae9-810e-62d84ee8a206 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:45.733707 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda7ee6-b0a6-4ae9-810e-62d84ee8a206 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:45.766946 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c33eb-8f13-4a9a-b6ef-4f71077c08a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:45.767558 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c33eb-8f13-4a9a-b6ef-4f71077c08a0 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:45.767841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c33eb-8f13-4a9a-b6ef-4f71077c08a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:45.768117 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c33eb-8f13-4a9a-b6ef-4f71077c08a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:45.768852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c33eb-8f13-4a9a-b6ef-4f71077c08a0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:45.770496 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c33eb-8f13-4a9a-b6ef-4f71077c08a0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:45.849824 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 582/1169] 10.222.0.75 () {60 vars in 1138 bytes} [Thu Jul 28 17:46:45 2022] POST /identity/v3/domains => generated 267 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:46:47.859754 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7eb77-44ba-4e2b-8611-13033056db26 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:47.860344 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7eb77-44ba-4e2b-8611-13033056db26 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:47.860344 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7eb77-44ba-4e2b-8611-13033056db26 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:47.861712 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 588/1170] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:47.872995 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743dd91-bc6c-4172-8cac-2033b05895a5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:47.873468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743dd91-bc6c-4172-8cac-2033b05895a5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:47.873568 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743dd91-bc6c-4172-8cac-2033b05895a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:47.892171 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1743dd91-bc6c-4172-8cac-2033b05895a5 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:47.893392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1743dd91-bc6c-4172-8cac-2033b05895a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:47.947604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:47.961941 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 583/1171] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:47.985813 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7eb77-44ba-4e2b-8611-13033056db26 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:48.060470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:48.082844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7eb77-44ba-4e2b-8611-13033056db26 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:48.116009 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631bc2b-2b02-433e-9132-fad5a7e446e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:48.116579 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631bc2b-2b02-433e-9132-fad5a7e446e7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:48.116882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631bc2b-2b02-433e-9132-fad5a7e446e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:48.117155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631bc2b-2b02-433e-9132-fad5a7e446e7 None admin] PATH_INFO: `/v3/domains/1889bf3d8c9c4f249fda70d5cbdb098d` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:48.129332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631bc2b-2b02-433e-9132-fad5a7e446e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1889bf3d8c9c4f249fda70d5cbdb098d)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:48.130826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631bc2b-2b02-433e-9132-fad5a7e446e7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:48.132459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 589/1172] 10.222.0.75 () {56 vars in 1183 bytes} [Thu Jul 28 17:46:47 2022] GET /identity/v3/domains/1889bf3d8c9c4f249fda70d5cbdb098d => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:48.138876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743dd91-bc6c-4172-8cac-2033b05895a5 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:48.234246 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743dd91-bc6c-4172-8cac-2033b05895a5 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:48.266964 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfc21f-5aa5-4fa9-9c3d-f676aa5305ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:48.267574 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfc21f-5aa5-4fa9-9c3d-f676aa5305ef None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:48.267857 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfc21f-5aa5-4fa9-9c3d-f676aa5305ef None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:48.268134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfc21f-5aa5-4fa9-9c3d-f676aa5305ef None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:48.268835 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfc21f-5aa5-4fa9-9c3d-f676aa5305ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:48.270526 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfc21f-5aa5-4fa9-9c3d-f676aa5305ef None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:48.387396 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 584/1173] 10.222.0.75 () {60 vars in 1141 bytes} [Thu Jul 28 17:46:48 2022] POST /identity/v3/projects => generated 361 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:46:50.412315 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab0592-44b8-44a4-8ce5-6c2b71d0f234 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:50.412863 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab0592-44b8-44a4-8ce5-6c2b71d0f234 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:50.412971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab0592-44b8-44a4-8ce5-6c2b71d0f234 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:50.414251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 590/1174] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:50.419378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b5322-ed0f-4120-bbd0-84d8d0666815 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:50.419760 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b5322-ed0f-4120-bbd0-84d8d0666815 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:50.419943 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b5322-ed0f-4120-bbd0-84d8d0666815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:50.437853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1c0b5322-ed0f-4120-bbd0-84d8d0666815 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:50.439044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1c0b5322-ed0f-4120-bbd0-84d8d0666815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:50.473291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:50.504592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 585/1175] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:50.530745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab0592-44b8-44a4-8ce5-6c2b71d0f234 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:50.628570 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab0592-44b8-44a4-8ce5-6c2b71d0f234 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:50.661623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a9c3a-75e1-47cd-8103-9848ba65ab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:50.662246 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a9c3a-75e1-47cd-8103-9848ba65ab54 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:50.662522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a9c3a-75e1-47cd-8103-9848ba65ab54 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:50.662791 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a9c3a-75e1-47cd-8103-9848ba65ab54 None admin] PATH_INFO: `/v3/domains/1889bf3d8c9c4f249fda70d5cbdb098d` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:50.663923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a9c3a-75e1-47cd-8103-9848ba65ab54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1889bf3d8c9c4f249fda70d5cbdb098d)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:50.665390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a9c3a-75e1-47cd-8103-9848ba65ab54 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:50.667978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 591/1176] 10.222.0.75 () {56 vars in 1183 bytes} [Thu Jul 28 17:46:50 2022] GET /identity/v3/domains/1889bf3d8c9c4f249fda70d5cbdb098d => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:50.673708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b5322-ed0f-4120-bbd0-84d8d0666815 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:50.768576 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b5322-ed0f-4120-bbd0-84d8d0666815 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:50.801802 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c62f28-9d2b-4d5c-934f-5e63f209147c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:50.802406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62f28-9d2b-4d5c-934f-5e63f209147c None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:50.802684 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62f28-9d2b-4d5c-934f-5e63f209147c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:50.802955 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62f28-9d2b-4d5c-934f-5e63f209147c None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:50.803626 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c62f28-9d2b-4d5c-934f-5e63f209147c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:50.805066 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c62f28-9d2b-4d5c-934f-5e63f209147c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:50.945713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 586/1177] 10.222.0.75 () {60 vars in 1132 bytes} [Thu Jul 28 17:46:50 2022] POST /identity/v3/users => generated 311 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:46:52.954700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79e1b9-729a-4883-b5ca-5960387fb986 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:52.955335 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79e1b9-729a-4883-b5ca-5960387fb986 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:52.955335 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79e1b9-729a-4883-b5ca-5960387fb986 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:52.956610 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 592/1178] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:52.961857 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe7515-b462-4243-b2a2-1e0f8b929333 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:52.962257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe7515-b462-4243-b2a2-1e0f8b929333 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:52.962425 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe7515-b462-4243-b2a2-1e0f8b929333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:52.980955 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3ffe7515-b462-4243-b2a2-1e0f8b929333 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:52.982159 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3ffe7515-b462-4243-b2a2-1e0f8b929333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:53.003312 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:53.049114 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 587/1179] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:53.071637 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79e1b9-729a-4883-b5ca-5960387fb986 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:53.075407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:53.174414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79e1b9-729a-4883-b5ca-5960387fb986 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:53.206881 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bbc48-3716-416a-81f6-e2173d4355a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:53.207451 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bbc48-3716-416a-81f6-e2173d4355a9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:53.207731 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bbc48-3716-416a-81f6-e2173d4355a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:53.208004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bbc48-3716-416a-81f6-e2173d4355a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:53.219070 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3bbc48-3716-416a-81f6-e2173d4355a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:46:53.224005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-5b3bbc48-3716-416a-81f6-e2173d4355a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:53.224005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:53.224005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:53.224005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:53.224005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:53.224005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:53.224005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:53.224005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:53.224005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:53.224005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:53.224005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:53.224005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:53.224005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:46:53.224005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:46:53.224005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:46:53.224005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:46:53.225203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:46:53.225203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:46:53.225203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:46:53.225203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:46:53.225203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:53.225203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:53.225203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:53.225203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:53.225203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:53.225203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:53.225203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:53.225203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:53.225203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:53.225203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:53.225203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:53.225203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:53.226512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:53.226512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:53.226512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:53.226512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:53.226512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:46:53.226512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:46:53.226512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:46:53.226512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:46:53.226512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:46:53.226512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:46:53.226512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:53.226512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:46:53.226512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 593/1180] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:46:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:53.231809 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe7515-b462-4243-b2a2-1e0f8b929333 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:53.326708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe7515-b462-4243-b2a2-1e0f8b929333 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:53.362234 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90a6d4-502c-4ff8-9b97-266b065ab0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:53.362839 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90a6d4-502c-4ff8-9b97-266b065ab0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:53.363117 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90a6d4-502c-4ff8-9b97-266b065ab0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:53.363388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90a6d4-502c-4ff8-9b97-266b065ab0e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:53.364105 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90a6d4-502c-4ff8-9b97-266b065ab0e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:53.364405 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90a6d4-502c-4ff8-9b97-266b065ab0e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:53.365795 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90a6d4-502c-4ff8-9b97-266b065ab0e8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:53.373579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 588/1181] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:46:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:53.379351 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bbc48-3716-416a-81f6-e2173d4355a9 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:53.439969 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:53.477876 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bbc48-3716-416a-81f6-e2173d4355a9 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:53.510239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae156644-c139-41d3-85c5-bba0090c887b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:53.511380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae156644-c139-41d3-85c5-bba0090c887b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:53.511661 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae156644-c139-41d3-85c5-bba0090c887b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:53.511935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae156644-c139-41d3-85c5-bba0090c887b None admin] PATH_INFO: `/v3/users/2625435d94ad4809887ecd34eead7756` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:53.525102 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae156644-c139-41d3-85c5-bba0090c887b None admin] RBAC: Authorizing `identity:get_user(user_id=2625435d94ad4809887ecd34eead7756)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:53.527177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae156644-c139-41d3-85c5-bba0090c887b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:53.528857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 594/1182] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:53 2022] GET /identity/v3/users/2625435d94ad4809887ecd34eead7756 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:53.538126 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90a6d4-502c-4ff8-9b97-266b065ab0e8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:53.557866 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:53.637167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90a6d4-502c-4ff8-9b97-266b065ab0e8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:53.670038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53a294-8ddd-4634-b1f7-924ddf7ee084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:53.670644 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53a294-8ddd-4634-b1f7-924ddf7ee084 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:53.670924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53a294-8ddd-4634-b1f7-924ddf7ee084 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:53.671194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53a294-8ddd-4634-b1f7-924ddf7ee084 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:53.737164 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53a294-8ddd-4634-b1f7-924ddf7ee084 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:53.738599 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53a294-8ddd-4634-b1f7-924ddf7ee084 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:53.755966 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:53.835073 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 589/1183] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:46:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:46:53.841107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae156644-c139-41d3-85c5-bba0090c887b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:53.937175 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae156644-c139-41d3-85c5-bba0090c887b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:53.959833 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:53.970885 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e7740-8171-4d66-a5d1-bd26aed2bc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:53.971531 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e7740-8171-4d66-a5d1-bd26aed2bc3e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:53.971821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e7740-8171-4d66-a5d1-bd26aed2bc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:53.972066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e7740-8171-4d66-a5d1-bd26aed2bc3e None admin] PATH_INFO: `/v3/projects/e698e67a6e3044c5a7616a58d0c80933` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:53.973567 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e7740-8171-4d66-a5d1-bd26aed2bc3e None admin] RBAC: Authorizing `identity:get_project(project_id=e698e67a6e3044c5a7616a58d0c80933)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:53.975295 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e7740-8171-4d66-a5d1-bd26aed2bc3e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:53.976983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 595/1184] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:46:53 2022] GET /identity/v3/projects/e698e67a6e3044c5a7616a58d0c80933 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:53.983132 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53a294-8ddd-4634-b1f7-924ddf7ee084 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:54.083251 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53a294-8ddd-4634-b1f7-924ddf7ee084 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:54.099868 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:54.116364 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce077d67-6b5f-4642-98b7-ba207f8741b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:54.118091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce077d67-6b5f-4642-98b7-ba207f8741b7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:54.118091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce077d67-6b5f-4642-98b7-ba207f8741b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:54.118091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce077d67-6b5f-4642-98b7-ba207f8741b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:54.118430 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce077d67-6b5f-4642-98b7-ba207f8741b7 None admin] RBAC: Adding query filter params (role.id=d371062e071845ffa4570a76d40dff88, scope.project.id=e698e67a6e3044c5a7616a58d0c80933, user.id=2625435d94ad4809887ecd34eead7756) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:54.118606 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce077d67-6b5f-4642-98b7-ba207f8741b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:54.120582 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce077d67-6b5f-4642-98b7-ba207f8741b7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:54.125847 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 590/1185] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:46:53 2022] GET /identity/v3/role_assignments?user.id=2625435d94ad4809887ecd34eead7756&scope.project.id=e698e67a6e3044c5a7616a58d0c80933&role.id=d371062e071845ffa4570a76d40dff88 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:56.104050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615776e-9b6f-4240-8739-3712d8fd3be6 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:56.104605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615776e-9b6f-4240-8739-3712d8fd3be6 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:56.104605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615776e-9b6f-4240-8739-3712d8fd3be6 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:56.105973 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 596/1186] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:56.111053 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d4acb-878e-46f9-8ee4-f64e6da5e665 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:56.111506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d4acb-878e-46f9-8ee4-f64e6da5e665 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:56.111601 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d4acb-878e-46f9-8ee4-f64e6da5e665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:56.129971 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-190d4acb-878e-46f9-8ee4-f64e6da5e665 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:56.131146 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-190d4acb-878e-46f9-8ee4-f64e6da5e665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:56.196022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 591/1187] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:56.218956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615776e-9b6f-4240-8739-3712d8fd3be6 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:56.319231 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615776e-9b6f-4240-8739-3712d8fd3be6 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:56.353334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9b1d6-55d6-4693-acad-6eeaa949981d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:56.354024 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9b1d6-55d6-4693-acad-6eeaa949981d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:56.354876 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9b1d6-55d6-4693-acad-6eeaa949981d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:56.355097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9b1d6-55d6-4693-acad-6eeaa949981d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:56.364892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9b1d6-55d6-4693-acad-6eeaa949981d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:46:56.369729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-41b9b1d6-55d6-4693-acad-6eeaa949981d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:56.369729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:56.369729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:56.369729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:56.369729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:56.369729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:56.369729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:56.369729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:56.369729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:56.369729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:56.369729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:56.369729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:56.369729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:46:56.369729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:46:56.369729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:46:56.369729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:46:56.370815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:46:56.370815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:46:56.370815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:46:56.370815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:46:56.370815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:56.370815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:56.370815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:56.370815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:56.370815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:56.370815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:56.370815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:56.370815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:56.370815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:56.370815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:56.370815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:56.370815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:56.371857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:56.371857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:56.371857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:56.371857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:56.371857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:46:56.371857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:46:56.371857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:46:56.371857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:46:56.371857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:46:56.371857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:46:56.371857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:56.371857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:46:56.372911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 597/1188] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:46:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:56.377048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d4acb-878e-46f9-8ee4-f64e6da5e665 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:56.472877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d4acb-878e-46f9-8ee4-f64e6da5e665 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:56.485274 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:56.504862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eab616-a828-4b22-a2e8-e511fbc67d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:56.505470 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eab616-a828-4b22-a2e8-e511fbc67d76 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:56.505749 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eab616-a828-4b22-a2e8-e511fbc67d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:56.506021 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eab616-a828-4b22-a2e8-e511fbc67d76 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:56.506731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eab616-a828-4b22-a2e8-e511fbc67d76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:56.507031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eab616-a828-4b22-a2e8-e511fbc67d76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:56.508381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eab616-a828-4b22-a2e8-e511fbc67d76 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:56.516725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 592/1189] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:46:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:56.522845 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9b1d6-55d6-4693-acad-6eeaa949981d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:56.571378 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:56.619309 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9b1d6-55d6-4693-acad-6eeaa949981d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:56.652542 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af247457-c6a7-403c-a36b-d2f06f71b8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:56.653224 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af247457-c6a7-403c-a36b-d2f06f71b8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:56.653476 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af247457-c6a7-403c-a36b-d2f06f71b8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:56.653748 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af247457-c6a7-403c-a36b-d2f06f71b8e4 None admin] PATH_INFO: `/v3/users/2625435d94ad4809887ecd34eead7756` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:56.654903 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af247457-c6a7-403c-a36b-d2f06f71b8e4 None admin] RBAC: Authorizing `identity:get_user(user_id=2625435d94ad4809887ecd34eead7756)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:56.656343 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af247457-c6a7-403c-a36b-d2f06f71b8e4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:56.657951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 598/1190] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:56 2022] GET /identity/v3/users/2625435d94ad4809887ecd34eead7756 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:56.663885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eab616-a828-4b22-a2e8-e511fbc67d76 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:56.760643 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eab616-a828-4b22-a2e8-e511fbc67d76 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:56.793392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa771d-657a-414d-b124-fac42fb40a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:56.794025 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa771d-657a-414d-b124-fac42fb40a0a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:56.794304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa771d-657a-414d-b124-fac42fb40a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:56.794578 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa771d-657a-414d-b124-fac42fb40a0a None admin] PATH_INFO: `/v3/projects/e698e67a6e3044c5a7616a58d0c80933` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:56.795718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa771d-657a-414d-b124-fac42fb40a0a None admin] RBAC: Authorizing `identity:get_project(project_id=e698e67a6e3044c5a7616a58d0c80933)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:56.797179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa771d-657a-414d-b124-fac42fb40a0a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:56.798829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 593/1191] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:46:56 2022] GET /identity/v3/projects/e698e67a6e3044c5a7616a58d0c80933 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:56.805154 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af247457-c6a7-403c-a36b-d2f06f71b8e4 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:56.910875 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af247457-c6a7-403c-a36b-d2f06f71b8e4 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:56.927367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:56.944011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d0a66-a390-4afa-ad40-08b5237088ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:56.944682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d0a66-a390-4afa-ad40-08b5237088ab None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:56.944989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d0a66-a390-4afa-ad40-08b5237088ab None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:56.945262 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d0a66-a390-4afa-ad40-08b5237088ab None admin] PATH_INFO: `/v3/projects/e698e67a6e3044c5a7616a58d0c80933/users/2625435d94ad4809887ecd34eead7756/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:56.947199 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d0a66-a390-4afa-ad40-08b5237088ab None admin] RBAC: Authorizing `identity:create_grant(project_id=e698e67a6e3044c5a7616a58d0c80933, user_id=2625435d94ad4809887ecd34eead7756, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:56.949303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d0a66-a390-4afa-ad40-08b5237088ab None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:57.033584 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 599/1192] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:46:56 2022] PUT /identity/v3/projects/e698e67a6e3044c5a7616a58d0c80933/users/2625435d94ad4809887ecd34eead7756/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:46:58.993054 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fe8b9-a1ef-4ac9-867c-038ffa2bee90 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:58.993613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fe8b9-a1ef-4ac9-867c-038ffa2bee90 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:58.993613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fe8b9-a1ef-4ac9-867c-038ffa2bee90 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:58.995538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 594/1193] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:46:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:59.000637 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b18ce0-c58b-482d-ac48-293a9b19daa4 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:59.001050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b18ce0-c58b-482d-ac48-293a9b19daa4 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:59.001241 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b18ce0-c58b-482d-ac48-293a9b19daa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:59.019352 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-01b18ce0-c58b-482d-ac48-293a9b19daa4 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:59.020550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-01b18ce0-c58b-482d-ac48-293a9b19daa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:59.092995 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 600/1194] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:46:59.117056 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fe8b9-a1ef-4ac9-867c-038ffa2bee90 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:59.164762 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:59.224765 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fe8b9-a1ef-4ac9-867c-038ffa2bee90 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:59.260632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139882c-d216-4ba0-b397-fff44329fe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:59.261214 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139882c-d216-4ba0-b397-fff44329fe57 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:59.261491 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139882c-d216-4ba0-b397-fff44329fe57 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:59.261764 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139882c-d216-4ba0-b397-fff44329fe57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:59.279738 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139882c-d216-4ba0-b397-fff44329fe57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:46:59.289455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-9139882c-d216-4ba0-b397-fff44329fe57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:59.289455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:59.289455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:59.289455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:59.289455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:59.289455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:59.289455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:59.289455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:59.289455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:59.289455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:59.289455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:59.289455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:59.289455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:46:59.289455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:46:59.289455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:46:59.289455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:46:59.294849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:46:59.294849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:46:59.294849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:46:59.294849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:46:59.294849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:59.294849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:59.294849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:59.294849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:59.294849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:59.294849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:59.294849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:59.294849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:59.294849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:59.294849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:59.294849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:59.294849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:59.296623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:59.296623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:59.296623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:59.296623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:59.296623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:46:59.296623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:46:59.296623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:46:59.296623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:46:59.296623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:46:59.296623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:46:59.296623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:59.296623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:46:59.296623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 595/1195] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:46:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:59.299819 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b18ce0-c58b-482d-ac48-293a9b19daa4 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:59.397655 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b18ce0-c58b-482d-ac48-293a9b19daa4 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:59.407130 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:59.430561 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b34ddd-88db-4a00-af14-9f2040f3eb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:59.431178 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b34ddd-88db-4a00-af14-9f2040f3eb5a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:59.431459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b34ddd-88db-4a00-af14-9f2040f3eb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:59.431732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b34ddd-88db-4a00-af14-9f2040f3eb5a None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:59.432486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b34ddd-88db-4a00-af14-9f2040f3eb5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:59.432813 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b34ddd-88db-4a00-af14-9f2040f3eb5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:59.434214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b34ddd-88db-4a00-af14-9f2040f3eb5a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:59.442426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 601/1196] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:46:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:59.448714 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139882c-d216-4ba0-b397-fff44329fe57 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:59.547565 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139882c-d216-4ba0-b397-fff44329fe57 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:59.547999 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:59.579179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7fb77-ef3b-4503-9d89-7614c3891366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:59.579808 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7fb77-ef3b-4503-9d89-7614c3891366 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:59.580086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7fb77-ef3b-4503-9d89-7614c3891366 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:59.580358 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7fb77-ef3b-4503-9d89-7614c3891366 None admin] PATH_INFO: `/v3/users/2625435d94ad4809887ecd34eead7756` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:59.581617 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7fb77-ef3b-4503-9d89-7614c3891366 None admin] RBAC: Authorizing `identity:get_user(user_id=2625435d94ad4809887ecd34eead7756)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:59.583036 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7fb77-ef3b-4503-9d89-7614c3891366 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:59.584624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 596/1197] 10.222.0.75 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:59 2022] GET /identity/v3/users/2625435d94ad4809887ecd34eead7756 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:59.591017 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b34ddd-88db-4a00-af14-9f2040f3eb5a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:59.699337 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b34ddd-88db-4a00-af14-9f2040f3eb5a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:59.732062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72713f63-144d-464f-9900-f81818407c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:59.732681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72713f63-144d-464f-9900-f81818407c39 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:59.733057 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72713f63-144d-464f-9900-f81818407c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:59.733335 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72713f63-144d-464f-9900-f81818407c39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:59.770617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:59.797834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72713f63-144d-464f-9900-f81818407c39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:59.799241 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72713f63-144d-464f-9900-f81818407c39 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:59.894602 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 602/1198] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:46:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:46:59.900456 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7fb77-ef3b-4503-9d89-7614c3891366 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:00.010627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7fb77-ef3b-4503-9d89-7614c3891366 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:00.043561 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e3782-ab4c-4f85-b41f-4b41b4bd0b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:00.044195 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e3782-ab4c-4f85-b41f-4b41b4bd0b71 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:00.044476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e3782-ab4c-4f85-b41f-4b41b4bd0b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:00.044775 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e3782-ab4c-4f85-b41f-4b41b4bd0b71 None admin] PATH_INFO: `/v3/projects/e698e67a6e3044c5a7616a58d0c80933` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:00.045920 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e3782-ab4c-4f85-b41f-4b41b4bd0b71 None admin] RBAC: Authorizing `identity:get_project(project_id=e698e67a6e3044c5a7616a58d0c80933)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:00.047346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e3782-ab4c-4f85-b41f-4b41b4bd0b71 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:00.049095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 597/1199] 10.222.0.75 () {56 vars in 1186 bytes} [Thu Jul 28 17:46:59 2022] GET /identity/v3/projects/e698e67a6e3044c5a7616a58d0c80933 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:00.055199 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72713f63-144d-464f-9900-f81818407c39 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:00.122625 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:00.152328 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72713f63-144d-464f-9900-f81818407c39 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:00.186162 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5d4ba-d88d-43d3-ad4d-f1a876594358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:00.186774 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5d4ba-d88d-43d3-ad4d-f1a876594358 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:00.187057 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5d4ba-d88d-43d3-ad4d-f1a876594358 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:00.187339 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5d4ba-d88d-43d3-ad4d-f1a876594358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:00.188115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5d4ba-d88d-43d3-ad4d-f1a876594358 None admin] RBAC: Adding query filter params (role.id=d371062e071845ffa4570a76d40dff88, scope.project.id=e698e67a6e3044c5a7616a58d0c80933, user.id=2625435d94ad4809887ecd34eead7756) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:00.188428 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5d4ba-d88d-43d3-ad4d-f1a876594358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:00.189901 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5d4ba-d88d-43d3-ad4d-f1a876594358 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:00.195534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 603/1200] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:00 2022] GET /identity/v3/role_assignments?user.id=2625435d94ad4809887ecd34eead7756&scope.project.id=e698e67a6e3044c5a7616a58d0c80933&role.id=d371062e071845ffa4570a76d40dff88 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:10.039371 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=81 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:10.192954 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=33 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:17.416411 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2945805-d4ee-44fb-8e29-e2baf932608e None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:17.417010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2945805-d4ee-44fb-8e29-e2baf932608e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:17.417010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2945805-d4ee-44fb-8e29-e2baf932608e None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:17.418349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 598/1201] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:17.423620 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefa7f7-7f17-480f-8813-f268192acbcd None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:17.424170 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefa7f7-7f17-480f-8813-f268192acbcd None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:17.424378 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefa7f7-7f17-480f-8813-f268192acbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:17.442341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-fcefa7f7-7f17-480f-8813-f268192acbcd None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:17.443539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fcefa7f7-7f17-480f-8813-f268192acbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:17.509559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 604/1202] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:48:17.536482 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2945805-d4ee-44fb-8e29-e2baf932608e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:17.651034 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2945805-d4ee-44fb-8e29-e2baf932608e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:17.685313 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf421c76-17fd-4350-8f83-ba46cb35b7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:17.687365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf421c76-17fd-4350-8f83-ba46cb35b7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:17.687365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf421c76-17fd-4350-8f83-ba46cb35b7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:17.687365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf421c76-17fd-4350-8f83-ba46cb35b7b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:17.696777 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf421c76-17fd-4350-8f83-ba46cb35b7b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:17.698239 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf421c76-17fd-4350-8f83-ba46cb35b7b2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:17.712908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-cf421c76-17fd-4350-8f83-ba46cb35b7b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:17.712908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:17.712908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:17.712908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:17.712908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:17.712908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:17.712908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:17.712908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:17.712908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:17.712908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:17.712908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:17.712908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:17.712908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:17.712908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:17.712908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:17.717686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:17.717686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:17.717686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:17.717686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:17.717686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:17.717686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:17.717686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:17.717686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:17.717686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:17.717686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:17.717686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:17.717686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:17.717686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:17.717686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:17.717686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:17.717686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:17.717686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:17.718907 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:17.718907 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:17.718907 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:17.718907 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:48:17.718907 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 599/1203] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:17.720192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefa7f7-7f17-480f-8813-f268192acbcd None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:17.817706 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefa7f7-7f17-480f-8813-f268192acbcd None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:17.847174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:17.853495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a70318-9f10-4c82-aa4c-fbade6494a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:17.856362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a70318-9f10-4c82-aa4c-fbade6494a1b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:17.856362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a70318-9f10-4c82-aa4c-fbade6494a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:17.856362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a70318-9f10-4c82-aa4c-fbade6494a1b None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:17.856362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a70318-9f10-4c82-aa4c-fbade6494a1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:17.856362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a70318-9f10-4c82-aa4c-fbade6494a1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:17.857024 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a70318-9f10-4c82-aa4c-fbade6494a1b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:17.868040 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 605/1204] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:17.873922 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf421c76-17fd-4350-8f83-ba46cb35b7b2 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:17.928108 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:17.978612 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf421c76-17fd-4350-8f83-ba46cb35b7b2 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:18.016825 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da402f-6449-422e-9dab-c7a068c73387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:18.017452 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da402f-6449-422e-9dab-c7a068c73387 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:18.017736 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da402f-6449-422e-9dab-c7a068c73387 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:18.018012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da402f-6449-422e-9dab-c7a068c73387 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:18.018691 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da402f-6449-422e-9dab-c7a068c73387 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:18.020137 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da402f-6449-422e-9dab-c7a068c73387 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:18.163842 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 600/1205] 10.222.0.75 () {60 vars in 1132 bytes} [Thu Jul 28 17:48:17 2022] POST /identity/v3/users => generated 251 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:48:20.182012 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975b4c8-93b1-4077-bc0a-4bde081f0faf None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:20.182593 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975b4c8-93b1-4077-bc0a-4bde081f0faf None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:20.182593 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975b4c8-93b1-4077-bc0a-4bde081f0faf None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:20.183903 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 606/1206] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:20.189179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce591851-c6b5-4594-993d-3f8776a56baf None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:20.189603 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce591851-c6b5-4594-993d-3f8776a56baf None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:20.189735 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce591851-c6b5-4594-993d-3f8776a56baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:20.211496 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ce591851-c6b5-4594-993d-3f8776a56baf None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:20.214178 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ce591851-c6b5-4594-993d-3f8776a56baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:20.285635 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 601/1207] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:20.308858 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975b4c8-93b1-4077-bc0a-4bde081f0faf None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:20.418843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975b4c8-93b1-4077-bc0a-4bde081f0faf None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:20.452103 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389893e-c550-4938-97e4-53f6b3b8d84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:20.452679 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389893e-c550-4938-97e4-53f6b3b8d84f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:20.452987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389893e-c550-4938-97e4-53f6b3b8d84f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:20.453260 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389893e-c550-4938-97e4-53f6b3b8d84f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:20.464742 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389893e-c550-4938-97e4-53f6b3b8d84f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:20.469657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-c389893e-c550-4938-97e4-53f6b3b8d84f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:20.469657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:20.469657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:20.469657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:20.469657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:20.469657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:20.469657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:20.469657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:20.469657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:20.469657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:20.469657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:20.469657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:20.469657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:20.469657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:20.469657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:20.469657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:20.470897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:20.470897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:20.470897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:20.470897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:20.470897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:20.470897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:20.470897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:20.470897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:20.470897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:20.470897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:20.470897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:20.470897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:20.470897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:20.470897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:20.470897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:20.470897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:20.472164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:20.472164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:20.472164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:20.472164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:20.472164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:20.472164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:20.472164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:20.472164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:20.472164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:20.472164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:20.472164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:20.472164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:20.472164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 607/1208] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:48:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:20.476780 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce591851-c6b5-4594-993d-3f8776a56baf None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:20.515367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:20.575011 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce591851-c6b5-4594-993d-3f8776a56baf None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:20.607589 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12389b-ef92-4cc8-a6d8-a65f65be0384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:20.610009 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12389b-ef92-4cc8-a6d8-a65f65be0384 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:20.610009 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12389b-ef92-4cc8-a6d8-a65f65be0384 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:20.610009 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12389b-ef92-4cc8-a6d8-a65f65be0384 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:20.610009 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12389b-ef92-4cc8-a6d8-a65f65be0384 None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:20.610009 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12389b-ef92-4cc8-a6d8-a65f65be0384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:20.611058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12389b-ef92-4cc8-a6d8-a65f65be0384 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:20.618528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 602/1209] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:48:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:20.624323 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389893e-c550-4938-97e4-53f6b3b8d84f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:20.676734 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:20.730163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389893e-c550-4938-97e4-53f6b3b8d84f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:20.764504 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6db48-c050-4578-a62c-25a829de264e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:20.765222 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6db48-c050-4578-a62c-25a829de264e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:20.765500 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6db48-c050-4578-a62c-25a829de264e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:20.765803 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6db48-c050-4578-a62c-25a829de264e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:20.776110 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6db48-c050-4578-a62c-25a829de264e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:20.777593 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6db48-c050-4578-a62c-25a829de264e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:20.791298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-a9a6db48-c050-4578-a62c-25a829de264e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:20.791298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:20.791298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:20.791298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:20.791298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:20.791298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:20.791298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:20.791298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:20.791298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:20.791298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:20.791298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:20.791298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:20.791298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:20.791298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:20.791298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:20.792259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:20.792259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:20.792259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:20.792259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:20.792259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:20.792259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:20.792259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:20.792259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:20.792259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:20.792259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:20.792259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:20.792259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:20.792259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:20.792259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:20.792259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:20.792259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:20.792259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:20.793377 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:20.793377 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:20.793377 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:20.793377 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:20.793377 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 608/1210] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:20.798397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12389b-ef92-4cc8-a6d8-a65f65be0384 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:20.894610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:20.897467 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12389b-ef92-4cc8-a6d8-a65f65be0384 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:20.929487 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657ef25-63c6-4f3b-86fc-c574aec67065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:20.930101 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657ef25-63c6-4f3b-86fc-c574aec67065 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:20.930380 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657ef25-63c6-4f3b-86fc-c574aec67065 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:20.930655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657ef25-63c6-4f3b-86fc-c574aec67065 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:20.931335 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657ef25-63c6-4f3b-86fc-c574aec67065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:20.932162 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657ef25-63c6-4f3b-86fc-c574aec67065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:20.933534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657ef25-63c6-4f3b-86fc-c574aec67065 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:20.944877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 603/1211] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:20.951199 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6db48-c050-4578-a62c-25a829de264e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:21.059796 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6db48-c050-4578-a62c-25a829de264e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:21.061313 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:21.092456 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb59f9b-7e4d-4381-8abd-0825525b3ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:21.093123 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb59f9b-7e4d-4381-8abd-0825525b3ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:21.093408 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb59f9b-7e4d-4381-8abd-0825525b3ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:21.093684 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb59f9b-7e4d-4381-8abd-0825525b3ae6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:21.101093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb59f9b-7e4d-4381-8abd-0825525b3ae6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:21.102553 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb59f9b-7e4d-4381-8abd-0825525b3ae6 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:21.114136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-bfb59f9b-7e4d-4381-8abd-0825525b3ae6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:48:21.114136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:21.114136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:21.114136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:21.114136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:21.114136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:21.114136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:21.114136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:21.114136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:21.114136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:21.114136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:21.114136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:21.114136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:21.114136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:21.114136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:21.114136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:21.115242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:21.115242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:21.115242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:21.115242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:21.115242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:21.115242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:21.115242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:21.115242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:21.115242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:21.115242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:21.115242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:21.115242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:21.115242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:21.115242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:21.115242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:21.115242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:21.115242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:21.115242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:21.116463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:21.116463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:21.116463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:21.116463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:21.116463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:21.116463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:21.116463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:21.116463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:21.116463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:48:21.116463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:21.116463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 609/1212] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:21.121958 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657ef25-63c6-4f3b-86fc-c574aec67065 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:21.221810 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657ef25-63c6-4f3b-86fc-c574aec67065 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:21.256216 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f90785-7978-46d4-a465-b071270b4a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:21.256869 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f90785-7978-46d4-a465-b071270b4a98 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:21.257156 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f90785-7978-46d4-a465-b071270b4a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:21.257432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f90785-7978-46d4-a465-b071270b4a98 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:21.258229 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f90785-7978-46d4-a465-b071270b4a98 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:21.258538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f90785-7978-46d4-a465-b071270b4a98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:21.260058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f90785-7978-46d4-a465-b071270b4a98 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:21.277343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 604/1213] 10.222.0.75 () {56 vars in 1143 bytes} [Thu Jul 28 17:48:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:21.283209 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb59f9b-7e4d-4381-8abd-0825525b3ae6 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:21.396783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb59f9b-7e4d-4381-8abd-0825525b3ae6 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:21.430187 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78799ac-e570-4a07-8099-bbc80eda9574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:21.430796 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78799ac-e570-4a07-8099-bbc80eda9574 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:21.431072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78799ac-e570-4a07-8099-bbc80eda9574 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:21.431338 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78799ac-e570-4a07-8099-bbc80eda9574 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:21.460091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:21.496715 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78799ac-e570-4a07-8099-bbc80eda9574 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:21.498308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78799ac-e570-4a07-8099-bbc80eda9574 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:21.592288 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 610/1214] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:48:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:48:21.598229 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f90785-7978-46d4-a465-b071270b4a98 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:21.621908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:21.701743 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f90785-7978-46d4-a465-b071270b4a98 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:21.735978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263e7d8-49d7-4d60-9619-53b069776c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:21.736613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263e7d8-49d7-4d60-9619-53b069776c8d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:21.736926 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263e7d8-49d7-4d60-9619-53b069776c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:21.737202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263e7d8-49d7-4d60-9619-53b069776c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:21.747011 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263e7d8-49d7-4d60-9619-53b069776c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:21.748467 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263e7d8-49d7-4d60-9619-53b069776c8d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:21.763548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-b263e7d8-49d7-4d60-9619-53b069776c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:21.763548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:21.763548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:21.763548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:21.763548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:21.763548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:21.763548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:21.763548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:21.763548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:21.763548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:21.763548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:21.763548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:21.763548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:21.763548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:21.763548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:21.764624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:21.764624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:21.764624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:21.764624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:21.764624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:21.764624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:21.764624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:21.764624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:21.764624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:21.764624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:21.764624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:21.764624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:21.764624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:21.764624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:21.764624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:21.764624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:21.764624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:21.777737 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:21.777737 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:21.777737 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:21.777737 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:48:21.777737 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 605/1215] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:21.778081 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78799ac-e570-4a07-8099-bbc80eda9574 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:21.830062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:21.869748 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78799ac-e570-4a07-8099-bbc80eda9574 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:21.901921 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e612253-3315-455f-8834-aad378f24cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:21.902532 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e612253-3315-455f-8834-aad378f24cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:21.902811 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e612253-3315-455f-8834-aad378f24cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:21.903106 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e612253-3315-455f-8834-aad378f24cf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:21.904140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e612253-3315-455f-8834-aad378f24cf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:21.904140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e612253-3315-455f-8834-aad378f24cf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:21.905483 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e612253-3315-455f-8834-aad378f24cf1 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:21.916192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 611/1216] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:21.922131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263e7d8-49d7-4d60-9619-53b069776c8d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:21.998174 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:22.030949 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263e7d8-49d7-4d60-9619-53b069776c8d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:22.065097 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fc0e8-a55a-4062-8656-680a794cc000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:22.065752 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fc0e8-a55a-4062-8656-680a794cc000 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:22.066036 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fc0e8-a55a-4062-8656-680a794cc000 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:22.066314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fc0e8-a55a-4062-8656-680a794cc000 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:22.073731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fc0e8-a55a-4062-8656-680a794cc000 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:22.075230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fc0e8-a55a-4062-8656-680a794cc000 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:22.087196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-016fc0e8-a55a-4062-8656-680a794cc000 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:22.087196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:22.087196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:22.087196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:22.087196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:22.087196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:22.087196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:22.087196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:22.087196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:22.087196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:22.087196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:22.087196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:22.087196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:22.087196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:22.087196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:22.088353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:22.088353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:22.088353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:22.088353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:22.088353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:22.088353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:22.088353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:22.088353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:22.088353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:22.088353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:22.088353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:22.088353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:22.088353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:22.088353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:22.088353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:22.088353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:22.088353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:22.089865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:22.089865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:22.089865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:22.089865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:22.089865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:22.089865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:22.089865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:22.089865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:48:22.089865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 606/1217] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:22.095068 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e612253-3315-455f-8834-aad378f24cf1 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:22.203709 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e612253-3315-455f-8834-aad378f24cf1 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:22.226666 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:22.242300 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49eebd-5681-4b94-811b-87e4c42a64b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:22.242916 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49eebd-5681-4b94-811b-87e4c42a64b8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:22.243193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49eebd-5681-4b94-811b-87e4c42a64b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:22.243466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49eebd-5681-4b94-811b-87e4c42a64b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:22.244214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49eebd-5681-4b94-811b-87e4c42a64b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:22.245067 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49eebd-5681-4b94-811b-87e4c42a64b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:22.246519 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49eebd-5681-4b94-811b-87e4c42a64b8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:22.258307 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 612/1218] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:22.265294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fc0e8-a55a-4062-8656-680a794cc000 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:22.362280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fc0e8-a55a-4062-8656-680a794cc000 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:22.390375 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:22.396257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c13ebe-80ae-42a0-a8c8-a014cc9cd15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:22.396891 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c13ebe-80ae-42a0-a8c8-a014cc9cd15a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:22.397177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c13ebe-80ae-42a0-a8c8-a014cc9cd15a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:22.397444 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c13ebe-80ae-42a0-a8c8-a014cc9cd15a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:22.398222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c13ebe-80ae-42a0-a8c8-a014cc9cd15a None admin] RBAC: Adding query filter params (role.id=6f10ff8509da43688fba83e6a4fd5c5f, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=cff43a72eaef462f86426ad3ceccd3a4) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:22.398527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c13ebe-80ae-42a0-a8c8-a014cc9cd15a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:22.399934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c13ebe-80ae-42a0-a8c8-a014cc9cd15a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:22.405136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 607/1219] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:48:22 2022] GET /identity/v3/role_assignments?user.id=cff43a72eaef462f86426ad3ceccd3a4&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=6f10ff8509da43688fba83e6a4fd5c5f => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:24.371803 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8be55-d029-465a-9d96-d75404a7941f None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:24.372284 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8be55-d029-465a-9d96-d75404a7941f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:24.372462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8be55-d029-465a-9d96-d75404a7941f None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:24.373784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 613/1220] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:48:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:24.379148 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b97c7c-15a8-4d8a-8c09-1a69dc332d03 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:24.379540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b97c7c-15a8-4d8a-8c09-1a69dc332d03 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:24.379697 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b97c7c-15a8-4d8a-8c09-1a69dc332d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:24.397818 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-06b97c7c-15a8-4d8a-8c09-1a69dc332d03 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:24.401432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-06b97c7c-15a8-4d8a-8c09-1a69dc332d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:24.465247 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 608/1221] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:24.488205 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8be55-d029-465a-9d96-d75404a7941f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:24.585555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8be55-d029-465a-9d96-d75404a7941f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:24.618550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11915f55-41af-4c8b-a8bf-8ff361e0b9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:24.619118 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11915f55-41af-4c8b-a8bf-8ff361e0b9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:24.619394 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11915f55-41af-4c8b-a8bf-8ff361e0b9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:24.619664 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11915f55-41af-4c8b-a8bf-8ff361e0b9f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:24.629450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11915f55-41af-4c8b-a8bf-8ff361e0b9f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:24.634273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-11915f55-41af-4c8b-a8bf-8ff361e0b9f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:24.634273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:24.634273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:24.634273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:24.634273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:24.634273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:24.634273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:24.634273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:24.634273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:24.634273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:24.634273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:24.634273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:24.634273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:24.634273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:24.634273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:24.634273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:24.635467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:24.635467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:24.635467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:24.635467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:24.635467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:24.635467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:24.635467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:24.635467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:24.635467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:24.635467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:24.635467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:24.635467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:24.635467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:24.635467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:24.635467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:24.635467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:24.636477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:24.636477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:24.636477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:24.636477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:24.636477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:24.636477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:24.636477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:24.636477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:24.636477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:24.636477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:24.636477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:24.636477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:24.636477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 614/1222] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:48:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:24.642100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b97c7c-15a8-4d8a-8c09-1a69dc332d03 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:24.740526 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b97c7c-15a8-4d8a-8c09-1a69dc332d03 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:24.763759 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:24.774196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d909b-3527-40fe-92ec-3495f7fb2714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:24.774809 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d909b-3527-40fe-92ec-3495f7fb2714 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:24.775088 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d909b-3527-40fe-92ec-3495f7fb2714 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:24.775359 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d909b-3527-40fe-92ec-3495f7fb2714 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:24.776113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d909b-3527-40fe-92ec-3495f7fb2714 None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:24.776417 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d909b-3527-40fe-92ec-3495f7fb2714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:24.778354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d909b-3527-40fe-92ec-3495f7fb2714 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:24.786692 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 609/1223] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:48:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:24.792495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11915f55-41af-4c8b-a8bf-8ff361e0b9f3 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:24.835521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:24.894172 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11915f55-41af-4c8b-a8bf-8ff361e0b9f3 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:24.927179 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641a398-ddd2-459c-b0bd-e4dbe1d8fa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:24.927822 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641a398-ddd2-459c-b0bd-e4dbe1d8fa88 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:24.928106 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641a398-ddd2-459c-b0bd-e4dbe1d8fa88 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:24.928433 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641a398-ddd2-459c-b0bd-e4dbe1d8fa88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:24.938698 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641a398-ddd2-459c-b0bd-e4dbe1d8fa88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:24.940177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641a398-ddd2-459c-b0bd-e4dbe1d8fa88 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:24.955181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-a641a398-ddd2-459c-b0bd-e4dbe1d8fa88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:24.955181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:24.955181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:24.955181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:24.955181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:24.955181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:24.955181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:24.955181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:24.955181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:24.955181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:24.955181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:24.955181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:24.955181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:24.955181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:24.955181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:24.956163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:24.956163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:24.956163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:24.956163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:24.956163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:24.956163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:24.956163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:24.956163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:24.956163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:24.956163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:24.956163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:24.956163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:24.956163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:24.956163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:24.956163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:24.956163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:24.956163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:24.957161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:24.957161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:24.957161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:24.957161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:24.957161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 615/1224] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:24.962408 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d909b-3527-40fe-92ec-3495f7fb2714 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:25.061122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d909b-3527-40fe-92ec-3495f7fb2714 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:25.095610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46697da4-4023-4a31-9d1d-d7d45c9b6c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:25.096229 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46697da4-4023-4a31-9d1d-d7d45c9b6c54 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:25.096509 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46697da4-4023-4a31-9d1d-d7d45c9b6c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:25.096807 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46697da4-4023-4a31-9d1d-d7d45c9b6c54 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:25.097497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46697da4-4023-4a31-9d1d-d7d45c9b6c54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:25.097802 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46697da4-4023-4a31-9d1d-d7d45c9b6c54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:25.099192 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46697da4-4023-4a31-9d1d-d7d45c9b6c54 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:25.111425 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 610/1225] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:25.117409 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641a398-ddd2-459c-b0bd-e4dbe1d8fa88 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:25.210347 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:25.217058 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641a398-ddd2-459c-b0bd-e4dbe1d8fa88 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:25.249628 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5ca52-518e-4a92-a27c-4cca2e4125c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:25.250268 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5ca52-518e-4a92-a27c-4cca2e4125c0 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:25.250551 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5ca52-518e-4a92-a27c-4cca2e4125c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:25.250819 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5ca52-518e-4a92-a27c-4cca2e4125c0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:25.258288 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5ca52-518e-4a92-a27c-4cca2e4125c0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:25.260114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5ca52-518e-4a92-a27c-4cca2e4125c0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:25.272043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-adc5ca52-518e-4a92-a27c-4cca2e4125c0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:48:25.272043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:25.272043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:25.272043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:25.272043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:25.272043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:25.272043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:25.272043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:25.272043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:25.272043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:25.272043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:25.272043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:25.272043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:25.272043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:25.272043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:25.272043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:25.273197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:25.273197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:25.273197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:25.273197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:25.273197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:25.273197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:25.273197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:25.273197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:25.273197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:25.273197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:25.273197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:25.273197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:25.273197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:25.273197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:25.273197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:25.273197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:25.273197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:25.273197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:25.274341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:25.274341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:25.274341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:25.274341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:25.274341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:25.274341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:25.274341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:25.274341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:25.274341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:48:25.274341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:25.274341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 616/1226] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:25.279128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46697da4-4023-4a31-9d1d-d7d45c9b6c54 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:25.327768 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:25.380163 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46697da4-4023-4a31-9d1d-d7d45c9b6c54 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:25.415755 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552cb8b-8ebe-4fd5-8896-b73c509ceb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:25.416373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552cb8b-8ebe-4fd5-8896-b73c509ceb04 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:25.416653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552cb8b-8ebe-4fd5-8896-b73c509ceb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:25.416959 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552cb8b-8ebe-4fd5-8896-b73c509ceb04 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:25.417767 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552cb8b-8ebe-4fd5-8896-b73c509ceb04 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:25.418073 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552cb8b-8ebe-4fd5-8896-b73c509ceb04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:25.419484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552cb8b-8ebe-4fd5-8896-b73c509ceb04 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:25.436620 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 611/1227] 10.222.0.75 () {56 vars in 1143 bytes} [Thu Jul 28 17:48:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:25.442349 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5ca52-518e-4a92-a27c-4cca2e4125c0 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:25.545147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5ca52-518e-4a92-a27c-4cca2e4125c0 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:25.578767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8104e-3421-4817-9d9b-4b2388a49184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:25.579407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8104e-3421-4817-9d9b-4b2388a49184 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:25.579690 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8104e-3421-4817-9d9b-4b2388a49184 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:25.579964 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8104e-3421-4817-9d9b-4b2388a49184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:25.590584 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8104e-3421-4817-9d9b-4b2388a49184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:25.592048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8104e-3421-4817-9d9b-4b2388a49184 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:25.606736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-f7b8104e-3421-4817-9d9b-4b2388a49184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:25.606736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:25.606736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:25.606736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:25.606736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:25.606736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:25.606736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:25.606736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:25.606736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:25.606736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:25.606736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:25.606736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:25.606736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:25.606736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:25.606736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:25.607650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:25.607650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:25.607650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:25.607650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:25.607650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:25.607650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:25.607650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:25.607650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:25.607650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:25.607650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:25.607650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:25.607650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:25.607650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:25.607650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:25.607650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:25.607650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:25.607650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:25.608575 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:25.608575 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:25.608575 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:25.608575 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:25.608575 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 617/1228] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:25.613665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552cb8b-8ebe-4fd5-8896-b73c509ceb04 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:25.726783 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552cb8b-8ebe-4fd5-8896-b73c509ceb04 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:25.729074 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:25.760289 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97463c-be3d-4467-bc42-69de22af9c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:25.760928 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97463c-be3d-4467-bc42-69de22af9c01 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:25.761208 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97463c-be3d-4467-bc42-69de22af9c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:25.761478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97463c-be3d-4467-bc42-69de22af9c01 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:25.762166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97463c-be3d-4467-bc42-69de22af9c01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:25.762470 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97463c-be3d-4467-bc42-69de22af9c01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:25.763842 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97463c-be3d-4467-bc42-69de22af9c01 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:25.775115 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 612/1229] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:25.780946 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8104e-3421-4817-9d9b-4b2388a49184 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:25.790199 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:25.878052 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8104e-3421-4817-9d9b-4b2388a49184 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:25.912391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71419d3-c8ee-4471-a68a-69746d689208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:25.913102 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71419d3-c8ee-4471-a68a-69746d689208 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:25.913389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71419d3-c8ee-4471-a68a-69746d689208 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:25.913666 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71419d3-c8ee-4471-a68a-69746d689208 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:25.921028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71419d3-c8ee-4471-a68a-69746d689208 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:25.922582 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71419d3-c8ee-4471-a68a-69746d689208 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:25.934303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-a71419d3-c8ee-4471-a68a-69746d689208 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:25.934303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:25.934303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:25.934303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:25.934303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:25.934303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:25.934303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:25.934303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:25.934303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:25.934303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:25.934303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:25.934303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:25.934303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:25.934303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:25.934303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:25.935356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:25.935356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:25.935356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:25.935356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:25.935356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:25.935356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:25.935356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:25.935356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:25.935356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:25.935356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:25.935356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:25.935356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:25.935356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:25.935356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:25.935356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:25.935356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:25.935356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:25.936502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:25.936502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:25.936502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:25.936502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:25.936502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:25.936502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:25.936502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:25.936502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:25.936502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 618/1230] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:25.941602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97463c-be3d-4467-bc42-69de22af9c01 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:26.065004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97463c-be3d-4467-bc42-69de22af9c01 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:26.097836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0836e0d-f8a7-4c83-b6fd-6208e6e8b713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:26.098453 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0836e0d-f8a7-4c83-b6fd-6208e6e8b713 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:26.098738 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0836e0d-f8a7-4c83-b6fd-6208e6e8b713 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:26.099014 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0836e0d-f8a7-4c83-b6fd-6208e6e8b713 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:26.099769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0836e0d-f8a7-4c83-b6fd-6208e6e8b713 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:26.100080 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0836e0d-f8a7-4c83-b6fd-6208e6e8b713 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:26.101537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0836e0d-f8a7-4c83-b6fd-6208e6e8b713 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:26.114009 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 613/1231] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:26.120166 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71419d3-c8ee-4471-a68a-69746d689208 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:26.186671 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:26.220554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71419d3-c8ee-4471-a68a-69746d689208 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:26.254230 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0947b3f-a459-43a1-89e0-1a546e8c217f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:26.254905 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0947b3f-a459-43a1-89e0-1a546e8c217f None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:26.255190 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0947b3f-a459-43a1-89e0-1a546e8c217f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:26.255473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0947b3f-a459-43a1-89e0-1a546e8c217f None admin] PATH_INFO: `/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/cff43a72eaef462f86426ad3ceccd3a4/roles/6f10ff8509da43688fba83e6a4fd5c5f` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:26.273965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0947b3f-a459-43a1-89e0-1a546e8c217f None admin] RBAC: Authorizing `identity:create_grant(project_id=883ec0c5aa374fbfbfc08eda6c626cfc, user_id=cff43a72eaef462f86426ad3ceccd3a4, role_id=6f10ff8509da43688fba83e6a4fd5c5f)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:26.275461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0947b3f-a459-43a1-89e0-1a546e8c217f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:26.360708 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 619/1232] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:48:26 2022] PUT /identity/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/cff43a72eaef462f86426ad3ceccd3a4/roles/6f10ff8509da43688fba83e6a4fd5c5f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:48:28.338537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25ee62-89fb-432d-a194-2402ddc75df8 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:28.339063 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25ee62-89fb-432d-a194-2402ddc75df8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:28.339063 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25ee62-89fb-432d-a194-2402ddc75df8 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:28.340444 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 614/1233] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:28.345907 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f3433-5fb5-409b-8e7d-3ae7e85fb848 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:28.346341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f3433-5fb5-409b-8e7d-3ae7e85fb848 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:28.346470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f3433-5fb5-409b-8e7d-3ae7e85fb848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:28.364079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b65f3433-5fb5-409b-8e7d-3ae7e85fb848 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:28.365328 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b65f3433-5fb5-409b-8e7d-3ae7e85fb848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:28.430666 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 620/1234] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:28.454469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25ee62-89fb-432d-a194-2402ddc75df8 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:28.479402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:28.553592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25ee62-89fb-432d-a194-2402ddc75df8 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:28.587308 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5e0de-256a-465a-8641-1249a1d3f7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:28.587946 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5e0de-256a-465a-8641-1249a1d3f7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:28.588231 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5e0de-256a-465a-8641-1249a1d3f7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:28.588506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5e0de-256a-465a-8641-1249a1d3f7c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:28.606205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5e0de-256a-465a-8641-1249a1d3f7c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:28.606205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-e8c5e0de-256a-465a-8641-1249a1d3f7c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:28.606205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:28.606205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:28.606205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:28.606205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:28.606205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:28.606205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:28.606205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:28.606205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:28.606205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:28.606205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:28.606205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:28.606205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:28.607309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:28.607309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:28.607309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:28.607309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:28.607309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:28.607309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:28.607309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:28.607309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:28.607309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:28.607309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:28.607309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:28.607309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:28.607309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:28.607309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:28.607309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:28.607309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:28.607309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:28.608205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:28.608205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:28.608205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:28.608205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:28.608205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:28.608205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:28.608205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:28.608205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:28.608205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:28.608205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:28.608205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:28.608205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:28.608205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:28.608205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:48:28.608205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 615/1235] 10.222.0.75 () {56 vars in 1102 bytes} [Thu Jul 28 17:48:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:28.611747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f3433-5fb5-409b-8e7d-3ae7e85fb848 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:28.657069 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:28.709689 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f3433-5fb5-409b-8e7d-3ae7e85fb848 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:28.743451 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da49c81-07eb-4821-bdd1-13ef00760ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:28.744098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da49c81-07eb-4821-bdd1-13ef00760ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:28.744378 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da49c81-07eb-4821-bdd1-13ef00760ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:28.744651 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da49c81-07eb-4821-bdd1-13ef00760ad7 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:28.745394 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da49c81-07eb-4821-bdd1-13ef00760ad7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:28.746242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da49c81-07eb-4821-bdd1-13ef00760ad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:28.747634 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da49c81-07eb-4821-bdd1-13ef00760ad7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:28.755244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 621/1236] 10.222.0.75 () {56 vars in 1103 bytes} [Thu Jul 28 17:48:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:28.761014 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5e0de-256a-465a-8641-1249a1d3f7c6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:28.844394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:28.860330 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5e0de-256a-465a-8641-1249a1d3f7c6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:28.893266 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52310ed8-272c-43a3-9350-fcd01a197781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:28.893908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52310ed8-272c-43a3-9350-fcd01a197781 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:28.894261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52310ed8-272c-43a3-9350-fcd01a197781 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:28.894532 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52310ed8-272c-43a3-9350-fcd01a197781 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:28.905381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52310ed8-272c-43a3-9350-fcd01a197781 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:28.906845 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52310ed8-272c-43a3-9350-fcd01a197781 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:28.921095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-52310ed8-272c-43a3-9350-fcd01a197781 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:28.921095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:28.921095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:28.921095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:28.921095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:28.921095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:28.921095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:28.921095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:28.921095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:28.921095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:28.921095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:28.921095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:28.921095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:28.921095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:28.921095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:28.925769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:28.925769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:28.925769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:28.925769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:28.925769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:28.925769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:28.925769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:28.925769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:28.925769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:28.925769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:28.925769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:28.925769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:28.925769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:28.925769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:28.925769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:28.925769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:28.925769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:28.926865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:28.926865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:28.926865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:28.926865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:48:28.926865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 616/1237] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:28.928039 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da49c81-07eb-4821-bdd1-13ef00760ad7 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:29.025593 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da49c81-07eb-4821-bdd1-13ef00760ad7 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:29.035872 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:29.061726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7281c85-d509-47fc-bb6a-2e4f171c1c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:29.062347 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7281c85-d509-47fc-bb6a-2e4f171c1c66 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:29.062627 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7281c85-d509-47fc-bb6a-2e4f171c1c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:29.062900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7281c85-d509-47fc-bb6a-2e4f171c1c66 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:29.063760 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7281c85-d509-47fc-bb6a-2e4f171c1c66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:29.064063 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7281c85-d509-47fc-bb6a-2e4f171c1c66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:29.065480 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7281c85-d509-47fc-bb6a-2e4f171c1c66 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:29.079859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 622/1238] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:29.085654 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52310ed8-272c-43a3-9350-fcd01a197781 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:29.186164 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52310ed8-272c-43a3-9350-fcd01a197781 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:29.219256 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d305b-1ff3-4ab5-8500-41f94ed74662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:29.219899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d305b-1ff3-4ab5-8500-41f94ed74662 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:29.220182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d305b-1ff3-4ab5-8500-41f94ed74662 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:29.220459 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d305b-1ff3-4ab5-8500-41f94ed74662 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:29.223142 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:29.228261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d305b-1ff3-4ab5-8500-41f94ed74662 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:29.229776 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d305b-1ff3-4ab5-8500-41f94ed74662 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:29.241418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-c75d305b-1ff3-4ab5-8500-41f94ed74662 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:48:29.241418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:29.241418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:29.241418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:29.241418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:29.241418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:29.241418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:29.241418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:29.241418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:29.241418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:29.241418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:29.241418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:29.241418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:29.241418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:29.241418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:29.241418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:29.242569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:29.242569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:29.242569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:29.242569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:29.242569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:29.242569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:29.242569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:29.242569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:29.242569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:29.242569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:29.242569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:29.242569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:29.242569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:29.242569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:29.242569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:29.242569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:29.242569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:29.242569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:29.243567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:29.243567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:29.243567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:29.243567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:29.243567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:29.243567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:29.243567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:29.243567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:29.243567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:48:29.243567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:48:29.243567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 617/1239] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:29.248436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7281c85-d509-47fc-bb6a-2e4f171c1c66 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:29.347098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7281c85-d509-47fc-bb6a-2e4f171c1c66 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:29.380758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23caabfd-486a-4401-ae0e-45a1cf8b48a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:29.381477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caabfd-486a-4401-ae0e-45a1cf8b48a5 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:29.381763 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caabfd-486a-4401-ae0e-45a1cf8b48a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:29.382096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caabfd-486a-4401-ae0e-45a1cf8b48a5 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:29.382945 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23caabfd-486a-4401-ae0e-45a1cf8b48a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:29.383262 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23caabfd-486a-4401-ae0e-45a1cf8b48a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:29.384791 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23caabfd-486a-4401-ae0e-45a1cf8b48a5 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:29.404655 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 623/1240] 10.222.0.75 () {56 vars in 1143 bytes} [Thu Jul 28 17:48:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:29.410766 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d305b-1ff3-4ab5-8500-41f94ed74662 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:29.512622 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d305b-1ff3-4ab5-8500-41f94ed74662 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:29.545857 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4654b-98b0-49c8-ba14-7bc4ff652c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:29.546501 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4654b-98b0-49c8-ba14-7bc4ff652c30 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:29.546787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4654b-98b0-49c8-ba14-7bc4ff652c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:29.547062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4654b-98b0-49c8-ba14-7bc4ff652c30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:29.606696 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:29.613079 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4654b-98b0-49c8-ba14-7bc4ff652c30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:29.614557 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4654b-98b0-49c8-ba14-7bc4ff652c30 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:29.711432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 618/1241] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:48:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:48:29.717552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23caabfd-486a-4401-ae0e-45a1cf8b48a5 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:29.744329 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:29.814934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23caabfd-486a-4401-ae0e-45a1cf8b48a5 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:29.848113 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93299742-0625-4ff9-a01d-74c0221831d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:29.848784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93299742-0625-4ff9-a01d-74c0221831d3 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:29.849060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93299742-0625-4ff9-a01d-74c0221831d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:29.849334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93299742-0625-4ff9-a01d-74c0221831d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:29.859036 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93299742-0625-4ff9-a01d-74c0221831d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:29.860487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93299742-0625-4ff9-a01d-74c0221831d3 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:29.875818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-93299742-0625-4ff9-a01d-74c0221831d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:29.875818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:29.875818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:29.875818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:29.875818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:29.875818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:29.875818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:29.875818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:29.875818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:29.875818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:29.875818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:29.875818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:29.875818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:29.875818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:29.875818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:29.877002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:29.877002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:29.877002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:29.877002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:29.877002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:29.877002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:29.877002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:29.877002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:29.877002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:29.877002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:29.877002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:29.877002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:29.877002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:29.877002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:29.877002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:29.877002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:29.877002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:29.878288 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:29.878288 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:29.878288 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:29.878288 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:29.878288 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 624/1242] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:29.883379 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4654b-98b0-49c8-ba14-7bc4ff652c30 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:29.978536 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:29.984416 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4654b-98b0-49c8-ba14-7bc4ff652c30 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:30.019605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddd5e3-aa1f-4f3e-8280-04fa52f32c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:30.020219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddd5e3-aa1f-4f3e-8280-04fa52f32c4a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:30.020498 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddd5e3-aa1f-4f3e-8280-04fa52f32c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:30.020792 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddd5e3-aa1f-4f3e-8280-04fa52f32c4a None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:30.021527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddd5e3-aa1f-4f3e-8280-04fa52f32c4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:30.021831 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddd5e3-aa1f-4f3e-8280-04fa52f32c4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:30.023186 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddd5e3-aa1f-4f3e-8280-04fa52f32c4a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:30.035279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 619/1243] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:30.040995 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93299742-0625-4ff9-a01d-74c0221831d3 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:30.124589 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:30.145073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93299742-0625-4ff9-a01d-74c0221831d3 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:30.177054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72382cb3-cfa3-4725-afa9-38c8d5478612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:30.177693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72382cb3-cfa3-4725-afa9-38c8d5478612 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:30.177978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72382cb3-cfa3-4725-afa9-38c8d5478612 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:30.178350 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72382cb3-cfa3-4725-afa9-38c8d5478612 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:30.185479 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72382cb3-cfa3-4725-afa9-38c8d5478612 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:30.186942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72382cb3-cfa3-4725-afa9-38c8d5478612 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:30.198167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-72382cb3-cfa3-4725-afa9-38c8d5478612 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:30.198167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:30.198167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:30.198167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:30.198167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:30.198167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:30.198167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:30.198167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:30.198167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:30.198167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:30.198167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:30.198167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:30.198167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:30.198167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:30.198167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:30.202657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:30.202657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:30.202657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:30.202657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:30.202657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:30.202657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:30.202657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:30.202657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:30.202657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:30.202657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:30.202657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:30.202657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:30.202657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:30.202657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:30.202657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:30.202657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:30.202657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:30.203764 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:30.203764 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:30.203764 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:30.203764 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:30.203764 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:30.203764 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:30.203764 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:30.203764 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:30.203764 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 625/1244] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:30.205290 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddd5e3-aa1f-4f3e-8280-04fa52f32c4a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:30.304221 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddd5e3-aa1f-4f3e-8280-04fa52f32c4a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:30.340774 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62bd1f-4fef-4d8e-b0f1-31d052ed661c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:30.341408 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62bd1f-4fef-4d8e-b0f1-31d052ed661c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:30.341697 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62bd1f-4fef-4d8e-b0f1-31d052ed661c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:30.341964 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62bd1f-4fef-4d8e-b0f1-31d052ed661c None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:30.342763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62bd1f-4fef-4d8e-b0f1-31d052ed661c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:30.343068 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62bd1f-4fef-4d8e-b0f1-31d052ed661c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:30.344586 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62bd1f-4fef-4d8e-b0f1-31d052ed661c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:30.357542 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 620/1245] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:30.363689 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72382cb3-cfa3-4725-afa9-38c8d5478612 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:30.462966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72382cb3-cfa3-4725-afa9-38c8d5478612 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:30.498299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955aa126-7ba5-4764-a36e-21a0404a1f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:30.498917 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955aa126-7ba5-4764-a36e-21a0404a1f2c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:30.499200 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955aa126-7ba5-4764-a36e-21a0404a1f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:30.499476 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955aa126-7ba5-4764-a36e-21a0404a1f2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:30.500265 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955aa126-7ba5-4764-a36e-21a0404a1f2c None admin] RBAC: Adding query filter params (role.id=6f10ff8509da43688fba83e6a4fd5c5f, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=cff43a72eaef462f86426ad3ceccd3a4) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:30.500580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955aa126-7ba5-4764-a36e-21a0404a1f2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:30.502058 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955aa126-7ba5-4764-a36e-21a0404a1f2c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:30.507975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 626/1246] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:48:30 2022] GET /identity/v3/role_assignments?user.id=cff43a72eaef462f86426ad3ceccd3a4&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=6f10ff8509da43688fba83e6a4fd5c5f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:32.553771 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb002c15-8cb0-4327-8f7d-423772cd1c31 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:32.554302 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb002c15-8cb0-4327-8f7d-423772cd1c31 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:32.554302 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb002c15-8cb0-4327-8f7d-423772cd1c31 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:32.555665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 621/1247] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:32.561725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1489b7d-10b2-4bc8-9231-352466d75e17 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:32.562186 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1489b7d-10b2-4bc8-9231-352466d75e17 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:32.564350 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1489b7d-10b2-4bc8-9231-352466d75e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:32.568653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:32.580473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d1489b7d-10b2-4bc8-9231-352466d75e17 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:32.581694 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d1489b7d-10b2-4bc8-9231-352466d75e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:32.647651 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 627/1248] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:32.671190 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb002c15-8cb0-4327-8f7d-423772cd1c31 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:32.689827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:32.775141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb002c15-8cb0-4327-8f7d-423772cd1c31 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:32.810984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa1830-957e-4949-9d88-3033cfa725d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:32.811711 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa1830-957e-4949-9d88-3033cfa725d6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:32.812034 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa1830-957e-4949-9d88-3033cfa725d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:32.812349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa1830-957e-4949-9d88-3033cfa725d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:32.823854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa1830-957e-4949-9d88-3033cfa725d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:32.831965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-25fa1830-957e-4949-9d88-3033cfa725d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:32.831965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:32.831965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:32.831965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:32.831965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:32.831965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:32.831965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:32.831965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:32.831965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:32.831965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:32.831965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:32.831965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:32.831965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:32.831965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:32.831965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:32.831965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:32.832980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:32.832980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:32.832980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:32.832980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:32.832980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:32.832980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:32.832980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:32.832980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:32.832980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:32.832980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:32.832980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:32.832980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:32.832980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:32.832980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:32.832980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:32.832980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:32.834060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:32.834060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:32.834060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:32.834060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:32.834060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:32.834060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:32.834060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:32.834060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:32.834060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:32.834060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:32.834060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:32.834060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:48:32.834060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 622/1249] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:48:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:32.843927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1489b7d-10b2-4bc8-9231-352466d75e17 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:32.941503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1489b7d-10b2-4bc8-9231-352466d75e17 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:32.972060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:32.976910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629b9a8-1c57-4d3b-bc79-a89acd3337a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:32.977535 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629b9a8-1c57-4d3b-bc79-a89acd3337a7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:32.977816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629b9a8-1c57-4d3b-bc79-a89acd3337a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:32.978087 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629b9a8-1c57-4d3b-bc79-a89acd3337a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:32.978800 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629b9a8-1c57-4d3b-bc79-a89acd3337a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:32.979105 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629b9a8-1c57-4d3b-bc79-a89acd3337a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:32.981149 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629b9a8-1c57-4d3b-bc79-a89acd3337a7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:32.989468 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 628/1250] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:48:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:32.995435 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa1830-957e-4949-9d88-3033cfa725d6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:33.071426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:33.095040 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa1830-957e-4949-9d88-3033cfa725d6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:33.127598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c8b7a-808a-4738-b300-9448c7961f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:33.128248 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c8b7a-808a-4738-b300-9448c7961f55 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:33.128528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c8b7a-808a-4738-b300-9448c7961f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:33.128827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c8b7a-808a-4738-b300-9448c7961f55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:33.140209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c8b7a-808a-4738-b300-9448c7961f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:33.141999 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c8b7a-808a-4738-b300-9448c7961f55 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:33.158123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-f68c8b7a-808a-4738-b300-9448c7961f55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:33.158123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:33.158123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:33.158123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:33.158123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:33.158123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:33.158123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:33.158123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:33.158123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:33.158123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:33.158123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:33.158123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:33.158123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:33.158123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:33.158123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:33.159304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:33.159304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:33.159304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:33.159304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:33.159304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:33.159304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:33.159304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:33.159304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:33.159304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:33.159304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:33.159304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:33.159304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:33.159304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:33.159304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:33.159304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:33.159304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:33.159304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:33.160414 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:33.160414 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:33.160414 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:33.160414 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:48:33.160414 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 623/1251] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:33.165833 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629b9a8-1c57-4d3b-bc79-a89acd3337a7 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:33.264693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629b9a8-1c57-4d3b-bc79-a89acd3337a7 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:33.297358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8dd91-1f56-4a72-91f1-ec73cda9a935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:33.298060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8dd91-1f56-4a72-91f1-ec73cda9a935 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:33.298256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8dd91-1f56-4a72-91f1-ec73cda9a935 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:33.298554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8dd91-1f56-4a72-91f1-ec73cda9a935 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:33.299212 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8dd91-1f56-4a72-91f1-ec73cda9a935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:33.299516 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8dd91-1f56-4a72-91f1-ec73cda9a935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:33.300976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8dd91-1f56-4a72-91f1-ec73cda9a935 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:33.312772 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 629/1252] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:33.318472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c8b7a-808a-4738-b300-9448c7961f55 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:33.418657 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c8b7a-808a-4738-b300-9448c7961f55 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:33.444335 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:33.452972 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ee8f7-c509-4bb9-a12b-855b012a902c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:33.457027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ee8f7-c509-4bb9-a12b-855b012a902c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:33.457027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ee8f7-c509-4bb9-a12b-855b012a902c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:33.457027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ee8f7-c509-4bb9-a12b-855b012a902c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:33.462035 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ee8f7-c509-4bb9-a12b-855b012a902c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:33.463531 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ee8f7-c509-4bb9-a12b-855b012a902c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:33.475615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-710ee8f7-c509-4bb9-a12b-855b012a902c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:48:33.475615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:33.475615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:33.475615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:33.475615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:33.475615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:33.475615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:33.475615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:33.475615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:33.475615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:33.475615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:33.475615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:33.475615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:33.475615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:33.475615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:33.475615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:33.477451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:33.477451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:33.477451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:33.477451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:33.477451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:33.477451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:33.477451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:33.477451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:33.477451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:33.477451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:33.477451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:33.477451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:33.477451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:33.477451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:33.477451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:33.477451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:33.477451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:33.477451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:33.479230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:33.479230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:33.479230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:33.479230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:33.479230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:33.479230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:33.479230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:33.479230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:33.479230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:48:33.479230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:48:33.479230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 624/1253] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:33.482808 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8dd91-1f56-4a72-91f1-ec73cda9a935 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:33.541055 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:33.585345 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8dd91-1f56-4a72-91f1-ec73cda9a935 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:33.619042 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167a43b-4605-44e4-bef8-7940ac6ac2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:33.619654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167a43b-4605-44e4-bef8-7940ac6ac2ba None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:33.619934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167a43b-4605-44e4-bef8-7940ac6ac2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:33.620208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167a43b-4605-44e4-bef8-7940ac6ac2ba None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:33.621537 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167a43b-4605-44e4-bef8-7940ac6ac2ba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:33.621851 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167a43b-4605-44e4-bef8-7940ac6ac2ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:33.623289 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167a43b-4605-44e4-bef8-7940ac6ac2ba None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:33.640597 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 630/1254] 10.222.0.75 () {56 vars in 1143 bytes} [Thu Jul 28 17:48:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:33.646676 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ee8f7-c509-4bb9-a12b-855b012a902c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:33.746221 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ee8f7-c509-4bb9-a12b-855b012a902c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:33.781478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566809d-0f50-440c-b891-d460eea4cba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:33.782095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566809d-0f50-440c-b891-d460eea4cba9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:33.782370 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566809d-0f50-440c-b891-d460eea4cba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:33.782667 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566809d-0f50-440c-b891-d460eea4cba9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:33.843353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:33.855673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566809d-0f50-440c-b891-d460eea4cba9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:33.857211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566809d-0f50-440c-b891-d460eea4cba9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:33.954254 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 625/1255] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:48:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:48:33.960058 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167a43b-4605-44e4-bef8-7940ac6ac2ba None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:34.061652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167a43b-4605-44e4-bef8-7940ac6ac2ba None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:34.074407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:34.094603 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1fd9e-489e-45d9-90d5-a5298d8f73e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:34.095169 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1fd9e-489e-45d9-90d5-a5298d8f73e4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:34.095450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1fd9e-489e-45d9-90d5-a5298d8f73e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:34.095722 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1fd9e-489e-45d9-90d5-a5298d8f73e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:34.106283 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1fd9e-489e-45d9-90d5-a5298d8f73e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:34.107801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1fd9e-489e-45d9-90d5-a5298d8f73e4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:34.122883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-a1a1fd9e-489e-45d9-90d5-a5298d8f73e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:34.122883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:34.122883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:34.122883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:34.122883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:34.122883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:34.122883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:34.122883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:34.122883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:34.122883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:34.122883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:34.122883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:34.122883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:34.122883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:34.122883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:34.123975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:34.123975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:34.123975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:34.123975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:34.123975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:34.123975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:34.123975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:34.123975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:34.123975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:34.123975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:34.123975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:34.123975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:34.123975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:34.123975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:34.123975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:34.123975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:34.123975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:34.125096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:34.125096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:34.125096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:34.125096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:34.125096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 631/1256] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:34.129802 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566809d-0f50-440c-b891-d460eea4cba9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:34.228327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:34.240831 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566809d-0f50-440c-b891-d460eea4cba9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:34.273667 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834039c-6031-41ce-9f56-174d67390fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:34.274272 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834039c-6031-41ce-9f56-174d67390fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:34.274554 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834039c-6031-41ce-9f56-174d67390fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:34.274831 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834039c-6031-41ce-9f56-174d67390fd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:34.275514 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834039c-6031-41ce-9f56-174d67390fd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:34.275820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834039c-6031-41ce-9f56-174d67390fd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:34.277703 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834039c-6031-41ce-9f56-174d67390fd4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:34.288556 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 626/1257] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:34.294868 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1fd9e-489e-45d9-90d5-a5298d8f73e4 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:34.396380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1fd9e-489e-45d9-90d5-a5298d8f73e4 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:34.429963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4920792-0aae-4b42-a081-37dc0eae7d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:34.430601 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4920792-0aae-4b42-a081-37dc0eae7d15 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:34.430887 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4920792-0aae-4b42-a081-37dc0eae7d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:34.431161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4920792-0aae-4b42-a081-37dc0eae7d15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:34.437647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4920792-0aae-4b42-a081-37dc0eae7d15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:34.439100 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4920792-0aae-4b42-a081-37dc0eae7d15 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:34.451073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-c4920792-0aae-4b42-a081-37dc0eae7d15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:34.451073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:34.451073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:34.451073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:34.451073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:34.451073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:34.451073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:34.451073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:34.451073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:34.451073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:34.451073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:34.451073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:34.451073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:34.451073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:34.451073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:34.452114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:34.452114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:34.452114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:34.452114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:34.452114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:34.452114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:34.452114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:34.452114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:34.452114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:34.452114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:34.452114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:34.452114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:34.452114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:34.452114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:34.452114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:34.452114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:34.452114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:34.459874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:34.459874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:34.459874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:34.459874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:34.459874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:34.459874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:34.459874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:34.459874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:34.459874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 632/1258] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:34.460498 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834039c-6031-41ce-9f56-174d67390fd4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:34.558186 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834039c-6031-41ce-9f56-174d67390fd4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:34.591686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15632d84-cba1-45de-a867-41578c1c6f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:34.592292 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15632d84-cba1-45de-a867-41578c1c6f44 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:34.592571 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15632d84-cba1-45de-a867-41578c1c6f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:34.592870 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15632d84-cba1-45de-a867-41578c1c6f44 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:34.593607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15632d84-cba1-45de-a867-41578c1c6f44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:34.593911 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15632d84-cba1-45de-a867-41578c1c6f44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:34.595314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15632d84-cba1-45de-a867-41578c1c6f44 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:34.607028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 627/1259] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:34.613085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4920792-0aae-4b42-a081-37dc0eae7d15 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:34.638630 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:34.710874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4920792-0aae-4b42-a081-37dc0eae7d15 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:34.743293 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3837d7-94bc-4bce-b20e-701e2f87bbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:34.743931 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3837d7-94bc-4bce-b20e-701e2f87bbfa None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:34.744207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3837d7-94bc-4bce-b20e-701e2f87bbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:34.744476 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3837d7-94bc-4bce-b20e-701e2f87bbfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:34.745448 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3837d7-94bc-4bce-b20e-701e2f87bbfa None admin] RBAC: Adding query filter params (role.id=d371062e071845ffa4570a76d40dff88, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=cff43a72eaef462f86426ad3ceccd3a4) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:34.745817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3837d7-94bc-4bce-b20e-701e2f87bbfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:34.747221 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3837d7-94bc-4bce-b20e-701e2f87bbfa None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:34.752707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 633/1260] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:48:34 2022] GET /identity/v3/role_assignments?user.id=cff43a72eaef462f86426ad3ceccd3a4&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=d371062e071845ffa4570a76d40dff88 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:36.780111 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49be947-750e-407a-807c-62b10d65bbff None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:36.780674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49be947-750e-407a-807c-62b10d65bbff None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:36.780674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49be947-750e-407a-807c-62b10d65bbff None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:36.782045 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 628/1261] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:36.787530 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813f9c2-2b65-4e72-ba67-4b16cf7724d1 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:36.787939 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813f9c2-2b65-4e72-ba67-4b16cf7724d1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:36.790641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813f9c2-2b65-4e72-ba67-4b16cf7724d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:36.806503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0813f9c2-2b65-4e72-ba67-4b16cf7724d1 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:36.807699 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0813f9c2-2b65-4e72-ba67-4b16cf7724d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:36.887350 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 634/1262] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:36.910006 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49be947-750e-407a-807c-62b10d65bbff None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:36.921654 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:37.009378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49be947-750e-407a-807c-62b10d65bbff None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:37.042359 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b656776-5dc5-46ed-835e-8e0999b536b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:37.043436 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b656776-5dc5-46ed-835e-8e0999b536b5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.043719 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b656776-5dc5-46ed-835e-8e0999b536b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.043989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b656776-5dc5-46ed-835e-8e0999b536b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.054800 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b656776-5dc5-46ed-835e-8e0999b536b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:37.060329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-3b656776-5dc5-46ed-835e-8e0999b536b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:37.060329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:37.060329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:37.060329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:37.060329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:37.060329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:37.060329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:37.060329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:37.060329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:37.060329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:37.060329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:37.060329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:37.060329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:37.060329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:37.060329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:37.060329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:37.061423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:37.061423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:37.061423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:37.061423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:37.061423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:37.061423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:37.061423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:37.061423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:37.061423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:37.061423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:37.061423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:37.061423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:37.061423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:37.061423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:37.061423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:37.061423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:37.062294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:37.062294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:37.062294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:37.062294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:37.062294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:37.062294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:37.062294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:37.062294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:37.062294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:37.062294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:37.062294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:37.062294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:48:37.062294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 629/1263] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:48:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:37.067554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813f9c2-2b65-4e72-ba67-4b16cf7724d1 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:37.085626 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:37.163328 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813f9c2-2b65-4e72-ba67-4b16cf7724d1 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:37.197411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248decf1-853b-4b0d-9420-09408ec2b628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:37.198034 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248decf1-853b-4b0d-9420-09408ec2b628 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.198314 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248decf1-853b-4b0d-9420-09408ec2b628 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.198588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248decf1-853b-4b0d-9420-09408ec2b628 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.199349 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248decf1-853b-4b0d-9420-09408ec2b628 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:37.199859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248decf1-853b-4b0d-9420-09408ec2b628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:37.202085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248decf1-853b-4b0d-9420-09408ec2b628 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:37.210068 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 635/1264] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:48:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:37.216567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b656776-5dc5-46ed-835e-8e0999b536b5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:37.282462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:37.316481 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b656776-5dc5-46ed-835e-8e0999b536b5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:37.349158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e0a00-ed23-4198-96b4-26ef876217ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:37.349808 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e0a00-ed23-4198-96b4-26ef876217ad None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.350093 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e0a00-ed23-4198-96b4-26ef876217ad None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.350371 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e0a00-ed23-4198-96b4-26ef876217ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.361644 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e0a00-ed23-4198-96b4-26ef876217ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:37.363135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e0a00-ed23-4198-96b4-26ef876217ad None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:37.377710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-8a7e0a00-ed23-4198-96b4-26ef876217ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:37.377710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:37.377710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:37.377710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:37.377710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:37.377710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:37.377710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:37.377710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:37.377710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:37.377710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:37.377710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:37.377710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:37.377710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:37.377710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:37.377710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:37.378655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:37.378655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:37.378655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:37.378655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:37.378655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:37.378655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:37.378655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:37.378655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:37.378655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:37.378655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:37.378655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:37.378655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:37.378655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:37.378655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:37.378655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:37.378655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:37.378655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:37.379931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:37.379931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:37.379931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:37.379931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:48:37.379931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 630/1265] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:37.384784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248decf1-853b-4b0d-9420-09408ec2b628 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:37.465211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:37.483968 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248decf1-853b-4b0d-9420-09408ec2b628 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:37.516157 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d9712-e277-4e7d-9c23-10f07ce59753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:37.517061 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d9712-e277-4e7d-9c23-10f07ce59753 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.517343 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d9712-e277-4e7d-9c23-10f07ce59753 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.517612 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d9712-e277-4e7d-9c23-10f07ce59753 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.518294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d9712-e277-4e7d-9c23-10f07ce59753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:37.518598 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d9712-e277-4e7d-9c23-10f07ce59753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:37.519982 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d9712-e277-4e7d-9c23-10f07ce59753 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:37.531914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 636/1266] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:37.537650 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e0a00-ed23-4198-96b4-26ef876217ad None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:37.634243 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e0a00-ed23-4198-96b4-26ef876217ad None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:37.654208 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:37.667546 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1a089-039d-4add-bd29-52534f52c387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:37.668187 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1a089-039d-4add-bd29-52534f52c387 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.668472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1a089-039d-4add-bd29-52534f52c387 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.668766 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1a089-039d-4add-bd29-52534f52c387 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.676140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1a089-039d-4add-bd29-52534f52c387 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:37.677639 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1a089-039d-4add-bd29-52534f52c387 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:37.688577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-6dc1a089-039d-4add-bd29-52534f52c387 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:48:37.688577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:37.688577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:37.688577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:37.688577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:37.688577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:37.688577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:37.688577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:37.688577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:37.688577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:37.688577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:37.688577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:37.688577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:37.688577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:37.688577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:37.688577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:37.694044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:37.694044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:37.694044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:37.694044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:37.694044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:37.694044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:37.694044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:37.694044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:37.694044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:37.694044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:37.694044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:37.694044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:37.694044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:37.694044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:37.694044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:37.694044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:37.694044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:37.694044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:37.695305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:37.695305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:37.695305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:37.695305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:37.695305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:37.695305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:37.695305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:37.695305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:37.695305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:48:37.695305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:48:37.695305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 631/1267] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:37.696030 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d9712-e277-4e7d-9c23-10f07ce59753 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:37.793278 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d9712-e277-4e7d-9c23-10f07ce59753 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:37.827395 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbe33f-8250-494b-93e2-0abf7c9be21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:37.828110 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbe33f-8250-494b-93e2-0abf7c9be21d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.828396 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbe33f-8250-494b-93e2-0abf7c9be21d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.828674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbe33f-8250-494b-93e2-0abf7c9be21d None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.829505 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbe33f-8250-494b-93e2-0abf7c9be21d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:37.829816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbe33f-8250-494b-93e2-0abf7c9be21d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:37.831311 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbe33f-8250-494b-93e2-0abf7c9be21d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:37.840659 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:37.850107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 637/1268] 10.222.0.75 () {56 vars in 1143 bytes} [Thu Jul 28 17:48:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:37.856058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1a089-039d-4add-bd29-52534f52c387 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:37.956386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1a089-039d-4add-bd29-52534f52c387 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:37.989595 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e941c-7478-42f4-81ba-198cc0dcff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:37.990242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e941c-7478-42f4-81ba-198cc0dcff20 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.990527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e941c-7478-42f4-81ba-198cc0dcff20 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.990803 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e941c-7478-42f4-81ba-198cc0dcff20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:38.001738 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e941c-7478-42f4-81ba-198cc0dcff20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:38.003173 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e941c-7478-42f4-81ba-198cc0dcff20 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:38.017944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-154e941c-7478-42f4-81ba-198cc0dcff20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:38.017944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:38.017944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:38.017944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:38.017944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:38.017944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:38.017944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:38.017944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:38.017944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:38.017944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:38.017944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:38.017944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:38.017944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:38.017944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:38.017944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:38.019055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:38.019055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:38.019055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:38.019055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:38.019055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:38.019055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:38.019055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:38.019055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:38.019055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:38.019055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:38.019055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:38.019055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:38.019055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:38.019055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:38.019055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:38.019055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:38.019055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:38.020388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:38.020388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:38.020388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:38.020388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:48:38.020388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 632/1269] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:38.024893 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbe33f-8250-494b-93e2-0abf7c9be21d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:38.122767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbe33f-8250-494b-93e2-0abf7c9be21d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:38.159612 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f0bc8-f94a-45e0-a7f8-f0945663b049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:38.160227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f0bc8-f94a-45e0-a7f8-f0945663b049 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:38.160504 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f0bc8-f94a-45e0-a7f8-f0945663b049 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:38.160795 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f0bc8-f94a-45e0-a7f8-f0945663b049 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:38.161506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f0bc8-f94a-45e0-a7f8-f0945663b049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:38.161814 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f0bc8-f94a-45e0-a7f8-f0945663b049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:38.163207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f0bc8-f94a-45e0-a7f8-f0945663b049 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:38.175748 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 638/1270] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:38.182756 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e941c-7478-42f4-81ba-198cc0dcff20 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:38.220635 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:38.287821 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e941c-7478-42f4-81ba-198cc0dcff20 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:38.322430 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea99229-c8d7-4352-b8f6-243281d3a2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:38.323079 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea99229-c8d7-4352-b8f6-243281d3a2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:38.323364 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea99229-c8d7-4352-b8f6-243281d3a2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:38.323638 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea99229-c8d7-4352-b8f6-243281d3a2e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:38.330235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea99229-c8d7-4352-b8f6-243281d3a2e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:38.331678 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea99229-c8d7-4352-b8f6-243281d3a2e7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:38.343632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-dea99229-c8d7-4352-b8f6-243281d3a2e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:38.343632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:38.343632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:38.343632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:38.343632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:38.343632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:38.343632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:38.343632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:38.343632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:38.343632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:38.343632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:38.343632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:38.343632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:38.343632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:38.343632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:38.346112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:38.346112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:38.346112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:38.346112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:38.346112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:38.346112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:38.346112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:38.346112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:38.346112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:38.346112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:38.346112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:38.346112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:38.346112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:38.346112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:38.346112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:38.346112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:38.346112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:38.347220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:38.347220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:38.347220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:38.347220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:38.347220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:38.347220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:38.347220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:38.347220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:48:38.347220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 633/1271] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:38.350779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f0bc8-f94a-45e0-a7f8-f0945663b049 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:38.409099 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:38.455216 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f0bc8-f94a-45e0-a7f8-f0945663b049 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:38.493317 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35092f42-58f9-4e12-a031-a60dea57aed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:38.493871 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35092f42-58f9-4e12-a031-a60dea57aed5 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:38.494155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35092f42-58f9-4e12-a031-a60dea57aed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:38.494431 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35092f42-58f9-4e12-a031-a60dea57aed5 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:38.496546 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35092f42-58f9-4e12-a031-a60dea57aed5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:38.497086 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35092f42-58f9-4e12-a031-a60dea57aed5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:38.499536 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35092f42-58f9-4e12-a031-a60dea57aed5 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:38.512696 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 639/1272] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:38.519277 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea99229-c8d7-4352-b8f6-243281d3a2e7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:38.609006 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:38.617318 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea99229-c8d7-4352-b8f6-243281d3a2e7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:38.649759 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e985f60-af27-42db-a971-b274ace231d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:38.650418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e985f60-af27-42db-a971-b274ace231d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:38.650698 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e985f60-af27-42db-a971-b274ace231d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:38.650969 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e985f60-af27-42db-a971-b274ace231d3 None admin] PATH_INFO: `/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/cff43a72eaef462f86426ad3ceccd3a4/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:38.653499 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e985f60-af27-42db-a971-b274ace231d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=883ec0c5aa374fbfbfc08eda6c626cfc, user_id=cff43a72eaef462f86426ad3ceccd3a4, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:38.654917 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e985f60-af27-42db-a971-b274ace231d3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:38.784466 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 634/1273] 10.222.0.75 () {58 vars in 1439 bytes} [Thu Jul 28 17:48:38 2022] PUT /identity/v3/projects/883ec0c5aa374fbfbfc08eda6c626cfc/users/cff43a72eaef462f86426ad3ceccd3a4/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:48:40.779537 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691c2c8-b0f4-4f7a-ada7-d46de387bd93 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:40.780068 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691c2c8-b0f4-4f7a-ada7-d46de387bd93 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:40.780068 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691c2c8-b0f4-4f7a-ada7-d46de387bd93 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:40.781478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 640/1274] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:40.786685 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb14a9a-01c0-45c7-8fbf-957062b3ee18 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:40.787106 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb14a9a-01c0-45c7-8fbf-957062b3ee18 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:40.787241 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb14a9a-01c0-45c7-8fbf-957062b3ee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:40.805142 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0bb14a9a-01c0-45c7-8fbf-957062b3ee18 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:40.806423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0bb14a9a-01c0-45c7-8fbf-957062b3ee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:40.882426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 635/1275] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:40.906519 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691c2c8-b0f4-4f7a-ada7-d46de387bd93 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:41.006967 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691c2c8-b0f4-4f7a-ada7-d46de387bd93 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:41.024511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:41.040596 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526ef12-9ae7-46c1-a220-f2d7388537f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:41.041204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526ef12-9ae7-46c1-a220-f2d7388537f5 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:41.041488 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526ef12-9ae7-46c1-a220-f2d7388537f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:41.041765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526ef12-9ae7-46c1-a220-f2d7388537f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:41.051694 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526ef12-9ae7-46c1-a220-f2d7388537f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:41.056657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-2526ef12-9ae7-46c1-a220-f2d7388537f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:41.056657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:41.056657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:41.056657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:41.056657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:41.056657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:41.056657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:41.056657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:41.056657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:41.056657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:41.056657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:41.056657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:41.056657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:41.056657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:41.056657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:41.056657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:41.057839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:41.057839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:41.057839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:41.057839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:41.057839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:41.057839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:41.057839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:41.057839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:41.057839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:41.057839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:41.057839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:41.057839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:41.057839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:41.057839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:41.057839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:41.057839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:41.058899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:41.058899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:41.058899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:41.058899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:41.058899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:41.058899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:41.058899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:41.058899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:41.058899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:41.058899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:41.058899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:41.058899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:41.058899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 641/1276] 10.222.0.75 () {56 vars in 1096 bytes} [Thu Jul 28 17:48:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:41.064649 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb14a9a-01c0-45c7-8fbf-957062b3ee18 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:41.144822 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:41.163756 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb14a9a-01c0-45c7-8fbf-957062b3ee18 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:41.207897 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3019dd2-8fbd-488f-a6db-b840a07a7589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:41.208532 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3019dd2-8fbd-488f-a6db-b840a07a7589 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:41.208858 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3019dd2-8fbd-488f-a6db-b840a07a7589 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:41.209160 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3019dd2-8fbd-488f-a6db-b840a07a7589 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:41.209885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3019dd2-8fbd-488f-a6db-b840a07a7589 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:41.210191 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3019dd2-8fbd-488f-a6db-b840a07a7589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:41.211564 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3019dd2-8fbd-488f-a6db-b840a07a7589 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:41.219700 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 636/1277] 10.222.0.75 () {56 vars in 1099 bytes} [Thu Jul 28 17:48:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:41.225500 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526ef12-9ae7-46c1-a220-f2d7388537f5 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:41.325340 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526ef12-9ae7-46c1-a220-f2d7388537f5 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:41.361356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f7452-5d9d-4d0a-849a-6f9fae564a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:41.362018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f7452-5d9d-4d0a-849a-6f9fae564a64 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:41.362305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f7452-5d9d-4d0a-849a-6f9fae564a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:41.362583 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f7452-5d9d-4d0a-849a-6f9fae564a64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:41.373161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f7452-5d9d-4d0a-849a-6f9fae564a64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:41.374626 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f7452-5d9d-4d0a-849a-6f9fae564a64 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:41.389077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-509f7452-5d9d-4d0a-849a-6f9fae564a64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:41.389077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:41.389077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:41.389077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:41.389077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:41.389077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:41.389077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:41.389077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:41.389077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:41.389077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:41.389077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:41.389077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:41.389077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:41.389077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:41.389077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:41.390111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:41.390111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:41.390111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:41.390111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:41.390111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:41.390111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:41.390111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:41.390111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:41.390111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:41.390111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:41.390111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:41.390111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:41.390111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:41.390111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:41.390111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:41.390111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:41.390111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:41.391041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:41.391041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:41.391041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:41.391041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:41.391041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 642/1278] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:41.396349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3019dd2-8fbd-488f-a6db-b840a07a7589 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:41.501979 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3019dd2-8fbd-488f-a6db-b840a07a7589 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:41.547238 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de89d7-202d-4e7c-b20d-d7c76178b8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:41.547862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de89d7-202d-4e7c-b20d-d7c76178b8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:41.548147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de89d7-202d-4e7c-b20d-d7c76178b8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:41.548426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de89d7-202d-4e7c-b20d-d7c76178b8c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:41.549152 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de89d7-202d-4e7c-b20d-d7c76178b8c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:41.549463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de89d7-202d-4e7c-b20d-d7c76178b8c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:41.550828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de89d7-202d-4e7c-b20d-d7c76178b8c9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:41.563260 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 637/1279] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:41.569042 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f7452-5d9d-4d0a-849a-6f9fae564a64 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:41.599949 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:41.667169 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f7452-5d9d-4d0a-849a-6f9fae564a64 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:41.700509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df915a7-214f-48bd-b80e-0fd55e56aa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:41.701171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df915a7-214f-48bd-b80e-0fd55e56aa70 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:41.701457 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df915a7-214f-48bd-b80e-0fd55e56aa70 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:41.701737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df915a7-214f-48bd-b80e-0fd55e56aa70 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:41.709167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df915a7-214f-48bd-b80e-0fd55e56aa70 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:41.710663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df915a7-214f-48bd-b80e-0fd55e56aa70 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:41.722507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-2df915a7-214f-48bd-b80e-0fd55e56aa70 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:48:41.722507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:41.722507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:41.722507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:41.722507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:41.722507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:41.722507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:41.722507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:41.722507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:41.722507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:41.722507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:41.722507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:41.722507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:41.722507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:41.722507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:41.722507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:41.723697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:41.723697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:41.723697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:41.723697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:41.723697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:41.723697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:41.723697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:41.723697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:41.723697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:41.723697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:41.723697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:41.723697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:41.723697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:41.723697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:41.723697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:41.723697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:41.723697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:41.723697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:41.725038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:41.725038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:41.725038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:41.725038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:41.725038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:41.725038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:41.725038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:41.725038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:41.725038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:48:41.725038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:41.725038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 643/1280] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:41.729569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de89d7-202d-4e7c-b20d-d7c76178b8c9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:41.733865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:41.826686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de89d7-202d-4e7c-b20d-d7c76178b8c9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:41.860584 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94e7ae-1890-4fb8-95b8-b8b33b27d8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:41.861206 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e7ae-1890-4fb8-95b8-b8b33b27d8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:41.861485 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e7ae-1890-4fb8-95b8-b8b33b27d8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:41.861756 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e7ae-1890-4fb8-95b8-b8b33b27d8f6 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:41.862535 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94e7ae-1890-4fb8-95b8-b8b33b27d8f6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:41.862839 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94e7ae-1890-4fb8-95b8-b8b33b27d8f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:41.864242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94e7ae-1890-4fb8-95b8-b8b33b27d8f6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:41.882937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 638/1281] 10.222.0.75 () {56 vars in 1143 bytes} [Thu Jul 28 17:48:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:41.889440 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df915a7-214f-48bd-b80e-0fd55e56aa70 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:41.979948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:41.989722 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df915a7-214f-48bd-b80e-0fd55e56aa70 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:42.022645 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30605adb-9b01-41e9-a745-0ddf28e9dd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:42.023257 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30605adb-9b01-41e9-a745-0ddf28e9dd0d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:42.023536 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30605adb-9b01-41e9-a745-0ddf28e9dd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:42.023809 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30605adb-9b01-41e9-a745-0ddf28e9dd0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:42.088850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30605adb-9b01-41e9-a745-0ddf28e9dd0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:42.090305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30605adb-9b01-41e9-a745-0ddf28e9dd0d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:42.176727 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:42.187462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 644/1282] 10.222.0.75 () {58 vars in 1282 bytes} [Thu Jul 28 17:48:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:48:42.193427 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94e7ae-1890-4fb8-95b8-b8b33b27d8f6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:42.263670 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:42.301178 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94e7ae-1890-4fb8-95b8-b8b33b27d8f6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:42.336088 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff522c-9ac6-4dad-812c-b4466a7e1d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:42.336740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff522c-9ac6-4dad-812c-b4466a7e1d80 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:42.337054 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff522c-9ac6-4dad-812c-b4466a7e1d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:42.337333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff522c-9ac6-4dad-812c-b4466a7e1d80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:42.347787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff522c-9ac6-4dad-812c-b4466a7e1d80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:42.349294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff522c-9ac6-4dad-812c-b4466a7e1d80 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:42.364689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-0aff522c-9ac6-4dad-812c-b4466a7e1d80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:42.364689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:42.364689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:42.364689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:42.364689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:42.364689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:42.364689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:42.364689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:42.364689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:42.364689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:42.364689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:42.364689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:42.364689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:42.364689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:42.364689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:42.365812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:42.365812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:42.365812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:42.365812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:42.365812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:42.365812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:42.365812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:42.365812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:42.365812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:42.365812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:42.365812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:42.365812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:42.365812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:42.365812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:42.365812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:42.365812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:42.365812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:42.367235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:42.367235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:42.367235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:42.367235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:48:42.367235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 639/1283] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:42.373372 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30605adb-9b01-41e9-a745-0ddf28e9dd0d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:42.469549 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30605adb-9b01-41e9-a745-0ddf28e9dd0d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:42.513781 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b9925-5ce4-41f6-a936-5349bc79c159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:42.514403 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b9925-5ce4-41f6-a936-5349bc79c159 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:42.514685 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b9925-5ce4-41f6-a936-5349bc79c159 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:42.514960 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b9925-5ce4-41f6-a936-5349bc79c159 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:42.515652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b9925-5ce4-41f6-a936-5349bc79c159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:42.515953 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b9925-5ce4-41f6-a936-5349bc79c159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:42.517624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b9925-5ce4-41f6-a936-5349bc79c159 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:42.529183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 645/1284] 10.222.0.75 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:42.535050 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff522c-9ac6-4dad-812c-b4466a7e1d80 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:42.639196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff522c-9ac6-4dad-812c-b4466a7e1d80 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:42.652728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:42.673333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfcc6b-2714-4ab2-8dae-3e267846f28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:42.673977 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfcc6b-2714-4ab2-8dae-3e267846f28d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:42.674259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfcc6b-2714-4ab2-8dae-3e267846f28d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:42.674533 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfcc6b-2714-4ab2-8dae-3e267846f28d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:42.681055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfcc6b-2714-4ab2-8dae-3e267846f28d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:42.682573 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfcc6b-2714-4ab2-8dae-3e267846f28d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:42.693791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-74bfcc6b-2714-4ab2-8dae-3e267846f28d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:42.693791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:42.693791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:42.693791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:42.693791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:42.693791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:42.693791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:42.693791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:42.693791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:42.693791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:42.693791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:42.693791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:42.693791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:42.693791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:42.693791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:42.694829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:42.694829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:42.694829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:42.694829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:42.694829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:42.694829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:42.694829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:42.694829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:42.694829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:42.694829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:42.694829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:42.694829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:42.694829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:42.694829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:42.694829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:42.694829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:42.694829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:42.695923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:42.695923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:42.695923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:42.695923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:42.695923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:42.695923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:42.695923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:42.695923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Jul 28 17:48:42.695923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 640/1285] 10.222.0.75 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:42.701056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b9925-5ce4-41f6-a936-5349bc79c159 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:42.750195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:42.800206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b9925-5ce4-41f6-a936-5349bc79c159 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:42.832995 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e06a7b-6f9a-4666-bb3a-3b8008b5f328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:42.833615 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e06a7b-6f9a-4666-bb3a-3b8008b5f328 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:42.833895 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e06a7b-6f9a-4666-bb3a-3b8008b5f328 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:42.834167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e06a7b-6f9a-4666-bb3a-3b8008b5f328 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:42.834910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e06a7b-6f9a-4666-bb3a-3b8008b5f328 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:42.835219 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e06a7b-6f9a-4666-bb3a-3b8008b5f328 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:42.836665 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e06a7b-6f9a-4666-bb3a-3b8008b5f328 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:42.850585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 646/1286] 10.222.0.75 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:42.856907 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfcc6b-2714-4ab2-8dae-3e267846f28d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:42.956363 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfcc6b-2714-4ab2-8dae-3e267846f28d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:42.989741 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cffa10-74c3-46df-a11f-a91ab9ed50e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:42.990363 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cffa10-74c3-46df-a11f-a91ab9ed50e4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:42.990649 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cffa10-74c3-46df-a11f-a91ab9ed50e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:42.990927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cffa10-74c3-46df-a11f-a91ab9ed50e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:42.991714 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cffa10-74c3-46df-a11f-a91ab9ed50e4 None admin] RBAC: Adding query filter params (role.id=d371062e071845ffa4570a76d40dff88, scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc, user.id=cff43a72eaef462f86426ad3ceccd3a4) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:42.992027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cffa10-74c3-46df-a11f-a91ab9ed50e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:42.993486 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cffa10-74c3-46df-a11f-a91ab9ed50e4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:42.999213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 641/1287] 10.222.0.75 () {56 vars in 1374 bytes} [Thu Jul 28 17:48:42 2022] GET /identity/v3/role_assignments?user.id=cff43a72eaef462f86426ad3ceccd3a4&scope.project.id=883ec0c5aa374fbfbfc08eda6c626cfc&role.id=d371062e071845ffa4570a76d40dff88 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:45.035765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781373ed-406b-4489-8e96-0c8eaafc81c6 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:45.036295 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781373ed-406b-4489-8e96-0c8eaafc81c6 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:45.036295 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781373ed-406b-4489-8e96-0c8eaafc81c6 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:45.037690 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 647/1288] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:45.042824 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e90db-adca-4e32-a896-381caa3063d4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:45.046453 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e90db-adca-4e32-a896-381caa3063d4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:45.046453 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e90db-adca-4e32-a896-381caa3063d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:45.061133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-919e90db-adca-4e32-a896-381caa3063d4 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:45.062334 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-919e90db-adca-4e32-a896-381caa3063d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:45.092293 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:45.128529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 642/1289] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:45.151341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781373ed-406b-4489-8e96-0c8eaafc81c6 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:45.255993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781373ed-406b-4489-8e96-0c8eaafc81c6 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:45.267550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:45.290796 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d425c-883d-430c-ac60-609e98affbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:45.291347 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d425c-883d-430c-ac60-609e98affbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:45.291624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d425c-883d-430c-ac60-609e98affbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:45.291893 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d425c-883d-430c-ac60-609e98affbf3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:45.292510 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d425c-883d-430c-ac60-609e98affbf3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:45.293953 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d425c-883d-430c-ac60-609e98affbf3 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:45.302555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-0d5d425c-883d-430c-ac60-609e98affbf3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:48:45.302555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:45.302555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:45.302555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:45.302555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:45.302555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:45.302555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:45.302555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:45.302555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:48:45.302555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:45.302555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:45.302555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:45.302555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:45.302555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:45.302555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:45.302555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:45.302555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:45.303767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:45.303767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:45.303767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:45.303767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:45.303767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:45.303767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:45.303767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:45.303767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:45.303767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:45.303767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:45.303767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:45.303767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:45.303767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:45.303767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:45.303767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:45.303767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:45.305148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:45.305148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:45.305148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:45.305148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:45.305148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:45.305148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:45.305148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:45.305148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:45.305148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:45.305148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:45.305148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:45.305148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:45.305148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:48:45.305148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:45.305148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 648/1290] 10.222.0.75 () {56 vars in 1117 bytes} [Thu Jul 28 17:48:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:45.309846 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e90db-adca-4e32-a896-381caa3063d4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:45.414676 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e90db-adca-4e32-a896-381caa3063d4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:45.448340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaba3f5-e96d-4853-8f8f-ae2113e23451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:45.448990 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaba3f5-e96d-4853-8f8f-ae2113e23451 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:45.449275 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaba3f5-e96d-4853-8f8f-ae2113e23451 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:45.449553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaba3f5-e96d-4853-8f8f-ae2113e23451 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:45.450807 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaba3f5-e96d-4853-8f8f-ae2113e23451 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:45.451113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaba3f5-e96d-4853-8f8f-ae2113e23451 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:45.452484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaba3f5-e96d-4853-8f8f-ae2113e23451 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:45.457306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 643/1291] 10.222.0.75 () {56 vars in 1116 bytes} [Thu Jul 28 17:48:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:45.463094 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d425c-883d-430c-ac60-609e98affbf3 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:45.562501 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d425c-883d-430c-ac60-609e98affbf3 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:45.595882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f8789-1dee-4419-a866-cd4ef21682af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:45.596504 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f8789-1dee-4419-a866-cd4ef21682af None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:45.596812 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f8789-1dee-4419-a866-cd4ef21682af None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:45.597093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f8789-1dee-4419-a866-cd4ef21682af None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:45.597772 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f8789-1dee-4419-a866-cd4ef21682af None admin] RBAC: Adding query filter params (type=placement) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:45.598080 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f8789-1dee-4419-a866-cd4ef21682af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:45.599459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f8789-1dee-4419-a866-cd4ef21682af None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:45.603965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 649/1292] 10.222.0.75 () {56 vars in 1116 bytes} [Thu Jul 28 17:48:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:47.589214 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3796a-b653-4b06-9afd-7140abe2a04a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:47.589772 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3796a-b653-4b06-9afd-7140abe2a04a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:47.589772 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3796a-b653-4b06-9afd-7140abe2a04a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:47.591167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 644/1293] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:47.596605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73b78c-bea5-4b15-a4f2-a37b78bbb8b2 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:47.597067 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73b78c-bea5-4b15-a4f2-a37b78bbb8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:47.597158 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73b78c-bea5-4b15-a4f2-a37b78bbb8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:47.615885 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-1f73b78c-bea5-4b15-a4f2-a37b78bbb8b2 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:47.617188 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1f73b78c-bea5-4b15-a4f2-a37b78bbb8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:47.646938 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:47.682566 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 650/1294] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:47.705238 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3796a-b653-4b06-9afd-7140abe2a04a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:47.737116 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:47.808818 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3796a-b653-4b06-9afd-7140abe2a04a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:47.844979 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fee06-a8c4-4955-93e2-a3228fb2a281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:47.845670 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fee06-a8c4-4955-93e2-a3228fb2a281 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:47.845952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fee06-a8c4-4955-93e2-a3228fb2a281 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:47.846228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fee06-a8c4-4955-93e2-a3228fb2a281 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:47.846972 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fee06-a8c4-4955-93e2-a3228fb2a281 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:47.848328 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fee06-a8c4-4955-93e2-a3228fb2a281 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:48.004591 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 645/1295] 10.222.0.75 () {60 vars in 1141 bytes} [Thu Jul 28 17:48:47 2022] POST /identity/v3/services => generated 246 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:48:50.015788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c07ef8-2415-487b-95b2-8a04d093a426 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:50.016489 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c07ef8-2415-487b-95b2-8a04d093a426 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:50.016489 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c07ef8-2415-487b-95b2-8a04d093a426 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:50.018080 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 651/1296] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:50.023217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c11b8-905a-4979-b49e-bae790a5eccd None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:50.023630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c11b8-905a-4979-b49e-bae790a5eccd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:50.023782 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c11b8-905a-4979-b49e-bae790a5eccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:50.042510 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-614c11b8-905a-4979-b49e-bae790a5eccd None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:50.043709 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-614c11b8-905a-4979-b49e-bae790a5eccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:50.116313 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 646/1297] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:50 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:50.139816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c07ef8-2415-487b-95b2-8a04d093a426 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:50.239002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c07ef8-2415-487b-95b2-8a04d093a426 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:50.272931 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985999f9-1d5b-41c1-85cd-f07dd7dc4932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:50.273507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985999f9-1d5b-41c1-85cd-f07dd7dc4932 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:50.273788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985999f9-1d5b-41c1-85cd-f07dd7dc4932 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:50.274060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985999f9-1d5b-41c1-85cd-f07dd7dc4932 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:50.274682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985999f9-1d5b-41c1-85cd-f07dd7dc4932 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:50.276109 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985999f9-1d5b-41c1-85cd-f07dd7dc4932 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:50.284961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-985999f9-1d5b-41c1-85cd-f07dd7dc4932 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:48:50.284961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:50.284961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:50.284961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:50.284961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:50.284961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:50.284961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:50.284961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:50.284961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:48:50.284961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:50.284961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:50.284961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:50.284961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:50.284961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:50.284961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:50.284961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:50.284961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:50.286208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:50.286208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:50.286208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:50.286208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:50.286208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:50.286208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:50.286208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:50.286208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:50.286208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:50.286208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:50.286208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:50.286208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:50.286208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:50.286208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:50.286208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:50.286208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:50.287140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:50.287140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:50.287140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:50.287140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:50.287140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:50.287140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:50.287140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:50.287140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:50.287140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:50.287140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:50.287140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:50.287140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:50.287140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:48:50.287140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:50.287140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 652/1298] 10.222.0.75 () {56 vars in 1117 bytes} [Thu Jul 28 17:48:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:50.292497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c11b8-905a-4979-b49e-bae790a5eccd None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:50.312587 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:50.393195 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c11b8-905a-4979-b49e-bae790a5eccd None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:50.427036 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70504a31-8bdc-42dc-adcf-9c01682976fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:50.427652 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70504a31-8bdc-42dc-adcf-9c01682976fa None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:50.427936 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70504a31-8bdc-42dc-adcf-9c01682976fa None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:50.428211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70504a31-8bdc-42dc-adcf-9c01682976fa None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:50.428913 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70504a31-8bdc-42dc-adcf-9c01682976fa None admin] RBAC: Adding query filter params (name=placement) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:50.429220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70504a31-8bdc-42dc-adcf-9c01682976fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:50.430578 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70504a31-8bdc-42dc-adcf-9c01682976fa None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:50.436609 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 647/1299] 10.222.0.75 () {56 vars in 1116 bytes} [Thu Jul 28 17:48:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:50.442807 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985999f9-1d5b-41c1-85cd-f07dd7dc4932 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:50.473760 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:50.540468 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985999f9-1d5b-41c1-85cd-f07dd7dc4932 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:50.574074 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd31f1-9034-4562-bbf1-bcc34a7dc29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:50.574703 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd31f1-9034-4562-bbf1-bcc34a7dc29a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:50.575008 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd31f1-9034-4562-bbf1-bcc34a7dc29a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:50.575284 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd31f1-9034-4562-bbf1-bcc34a7dc29a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:50.576055 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd31f1-9034-4562-bbf1-bcc34a7dc29a None admin] RBAC: Adding query filter params (interface=public, service_id=b68c768ded9941ab84a191cf1ad87527, region_id=RegionOne) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:50.576424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd31f1-9034-4562-bbf1-bcc34a7dc29a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:50.577846 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd31f1-9034-4562-bbf1-bcc34a7dc29a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:50.582961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 653/1300] 10.222.0.75 () {56 vars in 1251 bytes} [Thu Jul 28 17:48:50 2022] GET /identity/v3/endpoints?service_id=b68c768ded9941ab84a191cf1ad87527&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:50.588896 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70504a31-8bdc-42dc-adcf-9c01682976fa None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:50.671732 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:50.689507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70504a31-8bdc-42dc-adcf-9c01682976fa None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:50.723042 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4fab0-bcf8-47e3-9ac3-57846444f0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:50.723663 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4fab0-bcf8-47e3-9ac3-57846444f0dd None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:50.723990 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4fab0-bcf8-47e3-9ac3-57846444f0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:50.724264 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4fab0-bcf8-47e3-9ac3-57846444f0dd None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:50.724945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4fab0-bcf8-47e3-9ac3-57846444f0dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:50.726304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4fab0-bcf8-47e3-9ac3-57846444f0dd None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:50.733729 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 648/1301] 10.222.0.75 () {56 vars in 1087 bytes} [Thu Jul 28 17:48:50 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:48:52.727513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b51ca-168e-42bb-b9b8-3698064b5daa None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:52.728088 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b51ca-168e-42bb-b9b8-3698064b5daa None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:52.728088 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b51ca-168e-42bb-b9b8-3698064b5daa None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:52.729379 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 654/1302] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:52.734625 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276738a-67b7-45da-b162-7e54b699d1cc None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:52.735055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276738a-67b7-45da-b162-7e54b699d1cc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:52.735304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276738a-67b7-45da-b162-7e54b699d1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:52.753005 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9276738a-67b7-45da-b162-7e54b699d1cc None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:52.754211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9276738a-67b7-45da-b162-7e54b699d1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:52.821036 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 649/1303] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:52.844275 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b51ca-168e-42bb-b9b8-3698064b5daa None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:52.939204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:52.945795 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b51ca-168e-42bb-b9b8-3698064b5daa None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:52.978782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824eb59c-0ebe-4c66-a445-0b0e5140136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:52.979351 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eb59c-0ebe-4c66-a445-0b0e5140136a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:52.979633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eb59c-0ebe-4c66-a445-0b0e5140136a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:52.979904 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eb59c-0ebe-4c66-a445-0b0e5140136a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:52.980523 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824eb59c-0ebe-4c66-a445-0b0e5140136a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:52.981988 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824eb59c-0ebe-4c66-a445-0b0e5140136a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:52.990623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-824eb59c-0ebe-4c66-a445-0b0e5140136a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:48:52.990623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:52.990623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:52.990623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:52.990623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:52.990623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:52.990623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:52.990623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:52.990623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:48:52.990623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:52.990623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:52.990623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:52.990623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:52.990623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:52.990623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:52.990623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:52.990623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:52.991776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:52.991776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:52.991776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:52.991776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:52.991776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:52.991776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:52.991776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:52.991776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:52.991776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:52.991776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:52.991776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:52.991776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:52.991776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:52.991776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:52.991776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:52.991776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:52.993003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:52.993003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:52.993003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:52.993003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:52.993003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:52.993003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:52.993003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:52.993003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:52.993003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:52.993003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:52.993003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:52.993003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:52.993003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:48:52.993003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jul 28 17:48:52.993003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 655/1304] 10.222.0.75 () {56 vars in 1117 bytes} [Thu Jul 28 17:48:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:52.999713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276738a-67b7-45da-b162-7e54b699d1cc None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:53.079893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:53.101387 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276738a-67b7-45da-b162-7e54b699d1cc None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:53.134415 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d08c98-848b-4ab6-bd8e-132bf140645e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:53.135030 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d08c98-848b-4ab6-bd8e-132bf140645e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:53.135312 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d08c98-848b-4ab6-bd8e-132bf140645e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:53.135587 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d08c98-848b-4ab6-bd8e-132bf140645e None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:53.136264 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d08c98-848b-4ab6-bd8e-132bf140645e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:53.136572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d08c98-848b-4ab6-bd8e-132bf140645e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:53.138667 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d08c98-848b-4ab6-bd8e-132bf140645e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:53.143950 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 650/1305] 10.222.0.75 () {56 vars in 1116 bytes} [Thu Jul 28 17:48:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:53.149909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824eb59c-0ebe-4c66-a445-0b0e5140136a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:53.248642 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824eb59c-0ebe-4c66-a445-0b0e5140136a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:53.281648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d695e-3a6b-44f9-b61d-efbf5a68d970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:53.282263 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d695e-3a6b-44f9-b61d-efbf5a68d970 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:53.282554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d695e-3a6b-44f9-b61d-efbf5a68d970 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:53.282833 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d695e-3a6b-44f9-b61d-efbf5a68d970 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:53.283554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d695e-3a6b-44f9-b61d-efbf5a68d970 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:53.284960 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d695e-3a6b-44f9-b61d-efbf5a68d970 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:53.384394 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 656/1306] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 17:48:53 2022] POST /identity/v3/endpoints => generated 331 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:49:03.162741 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=30 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:03.379605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:01.699142 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a73ce-d6b1-4f1a-b523-9f8d5a3318e1 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:01.699769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a73ce-d6b1-4f1a-b523-9f8d5a3318e1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:01.700345 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a73ce-d6b1-4f1a-b523-9f8d5a3318e1 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:01.701747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 651/1307] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:56:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:01.707040 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb5aa3-94a4-48cc-a738-07f9f4ad406e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:01.707536 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb5aa3-94a4-48cc-a738-07f9f4ad406e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:01.707625 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb5aa3-94a4-48cc-a738-07f9f4ad406e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:01.784035 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-edeb5aa3-94a4-48cc-a738-07f9f4ad406e None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:01.785435 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-edeb5aa3-94a4-48cc-a738-07f9f4ad406e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:01.898124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 657/1308] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:01.956810 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04424a-0332-4dee-aa4b-68231a4ef604 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:01.957100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04424a-0332-4dee-aa4b-68231a4ef604 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:01.957543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04424a-0332-4dee-aa4b-68231a4ef604 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:01.959205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 652/1309] 10.222.0.75 () {54 vars in 965 bytes} [Thu Jul 28 17:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:01.965446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddf7a6-502f-4f47-a4af-ca152079817c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:01.965835 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddf7a6-502f-4f47-a4af-ca152079817c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:01.966185 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddf7a6-502f-4f47-a4af-ca152079817c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:02.127914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-23ddf7a6-502f-4f47-a4af-ca152079817c None None] MFA Rules not processed for user `d0e56603b8704cb2b5587313c67254a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:02.129176 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-23ddf7a6-502f-4f47-a4af-ca152079817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:02.163366 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:02.294029 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 658/1310] 10.222.0.75 () {58 vars in 1062 bytes} [Thu Jul 28 17:56:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:02.303264 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04424a-0332-4dee-aa4b-68231a4ef604 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:02.305142 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ad04424a-0332-4dee-aa4b-68231a4ef604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:02.438133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04424a-0332-4dee-aa4b-68231a4ef604 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:02.533083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686336b-66f7-4982-8c4f-e0445e068446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:02.533729 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686336b-66f7-4982-8c4f-e0445e068446 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:02.534213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686336b-66f7-4982-8c4f-e0445e068446 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:02.534493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686336b-66f7-4982-8c4f-e0445e068446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:02.536361 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b686336b-66f7-4982-8c4f-e0445e068446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:02.605968 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:02.671274 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686336b-66f7-4982-8c4f-e0445e068446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:02.672738 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686336b-66f7-4982-8c4f-e0445e068446 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:02.694410 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 653/1311] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:05.113180 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39361c35-7a99-4a54-94f2-ceb4bd9b41d7 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:05.113752 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39361c35-7a99-4a54-94f2-ceb4bd9b41d7 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:05.113752 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39361c35-7a99-4a54-94f2-ceb4bd9b41d7 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:05.115107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 659/1312] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:05.120328 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80394cc3-145e-462e-9522-0a8bbad18898 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:05.120788 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80394cc3-145e-462e-9522-0a8bbad18898 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:05.121103 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80394cc3-145e-462e-9522-0a8bbad18898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:05.203918 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-80394cc3-145e-462e-9522-0a8bbad18898 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:05.205601 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-80394cc3-145e-462e-9522-0a8bbad18898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:05.340812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 654/1313] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:05.395783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc78a6-476c-41c2-b515-5ed8fe8d817a None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:05.396076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc78a6-476c-41c2-b515-5ed8fe8d817a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:05.396360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc78a6-476c-41c2-b515-5ed8fe8d817a None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:05.398081 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 660/1314] 10.222.0.75 () {54 vars in 965 bytes} [Thu Jul 28 17:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:05.404619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b75ecc-c9be-4258-9bcd-6feb883080e6 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:05.404967 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b75ecc-c9be-4258-9bcd-6feb883080e6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:05.405268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b75ecc-c9be-4258-9bcd-6feb883080e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:05.417357 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:05.492910 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-71b75ecc-c9be-4258-9bcd-6feb883080e6 None None] MFA Rules not processed for user `d0e56603b8704cb2b5587313c67254a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:05.494111 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-71b75ecc-c9be-4258-9bcd-6feb883080e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:05.568589 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 655/1315] 10.222.0.75 () {58 vars in 1062 bytes} [Thu Jul 28 17:56:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:05.578612 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc78a6-476c-41c2-b515-5ed8fe8d817a None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:05.580181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-75cc78a6-476c-41c2-b515-5ed8fe8d817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:05.686495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc78a6-476c-41c2-b515-5ed8fe8d817a None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:05.760034 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:05.763370 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95278f-175f-4620-ae43-912e55b8d748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:05.763992 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95278f-175f-4620-ae43-912e55b8d748 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:05.764276 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95278f-175f-4620-ae43-912e55b8d748 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:05.764554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95278f-175f-4620-ae43-912e55b8d748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:05.766238 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ab95278f-175f-4620-ae43-912e55b8d748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:05.876494 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95278f-175f-4620-ae43-912e55b8d748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:05.877989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95278f-175f-4620-ae43-912e55b8d748 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:05.896527 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 661/1316] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:08.660485 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbf328-7705-4b5e-a416-b587f62ea0d1 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:08.661017 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbf328-7705-4b5e-a416-b587f62ea0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:08.661017 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbf328-7705-4b5e-a416-b587f62ea0d1 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:08.662385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 656/1317] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:08.667384 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdda8d-42db-4f78-93f7-69a41155759c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:08.667796 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdda8d-42db-4f78-93f7-69a41155759c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:08.667955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdda8d-42db-4f78-93f7-69a41155759c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:08.734152 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-48fdda8d-42db-4f78-93f7-69a41155759c None None] MFA Rules not processed for user `5ebb75ff475d457cb684829880a3d01e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:08.735378 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-48fdda8d-42db-4f78-93f7-69a41155759c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:08.786588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:08.831361 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 662/1318] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:56:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:08.875567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbf328-7705-4b5e-a416-b587f62ea0d1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:08.877173 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-43bbf328-7705-4b5e-a416-b587f62ea0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:08.979834 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbf328-7705-4b5e-a416-b587f62ea0d1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:08.983158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:09.057032 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142df9c-611b-45cc-a60f-f73b4425a65c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:09.057683 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142df9c-611b-45cc-a60f-f73b4425a65c service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:09.057968 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142df9c-611b-45cc-a60f-f73b4425a65c service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:09.058246 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142df9c-611b-45cc-a60f-f73b4425a65c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:09.060442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e142df9c-611b-45cc-a60f-f73b4425a65c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:09.169048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142df9c-611b-45cc-a60f-f73b4425a65c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:09.170486 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142df9c-611b-45cc-a60f-f73b4425a65c service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:09.188817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 657/1319] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:12.055326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1c9e3-502c-4be0-9273-cc75c90bb111 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.055857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1c9e3-502c-4be0-9273-cc75c90bb111 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.055857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1c9e3-502c-4be0-9273-cc75c90bb111 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.057201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 663/1320] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:12.063041 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbea6a-d9bc-40e9-aef7-ed2cb4e99dff None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.063438 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbea6a-d9bc-40e9-aef7-ed2cb4e99dff None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.063594 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbea6a-d9bc-40e9-aef7-ed2cb4e99dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.103253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:12.129686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-09bbea6a-d9bc-40e9-aef7-ed2cb4e99dff None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:12.130906 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-09bbea6a-d9bc-40e9-aef7-ed2cb4e99dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:12.225729 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 658/1321] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:56:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:12.264574 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1c9e3-502c-4be0-9273-cc75c90bb111 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:12.266152 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-57f1c9e3-502c-4be0-9273-cc75c90bb111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:12.370228 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1c9e3-502c-4be0-9273-cc75c90bb111 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:12.442612 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471dd24-7f3d-469f-adea-b3f7444b0ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:12.443228 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471dd24-7f3d-469f-adea-b3f7444b0ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.443509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471dd24-7f3d-469f-adea-b3f7444b0ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.443782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471dd24-7f3d-469f-adea-b3f7444b0ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.445421 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4471dd24-7f3d-469f-adea-b3f7444b0ac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:12.453236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:12.552240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471dd24-7f3d-469f-adea-b3f7444b0ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:12.553725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471dd24-7f3d-469f-adea-b3f7444b0ac0 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:12.571396 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 664/1322] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:15.649274 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5157b-27dd-46cc-af75-88b9102426eb None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:15.649804 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5157b-27dd-46cc-af75-88b9102426eb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:15.649804 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5157b-27dd-46cc-af75-88b9102426eb None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:15.651121 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 659/1323] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:15.657205 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6779eaf-2e29-4f14-9d97-1d2a3ed2ed36 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:15.657893 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6779eaf-2e29-4f14-9d97-1d2a3ed2ed36 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:15.658135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6779eaf-2e29-4f14-9d97-1d2a3ed2ed36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:15.732721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c6779eaf-2e29-4f14-9d97-1d2a3ed2ed36 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:15.733952 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c6779eaf-2e29-4f14-9d97-1d2a3ed2ed36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:15.790722 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:15.832664 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 665/1324] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:56:15.869196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5157b-27dd-46cc-af75-88b9102426eb None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:15.871336 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c6e5157b-27dd-46cc-af75-88b9102426eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:15.981208 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5157b-27dd-46cc-af75-88b9102426eb None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:15.994967 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:16.063220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dba34-9021-4027-8789-841096546438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:16.063893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dba34-9021-4027-8789-841096546438 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:16.064181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dba34-9021-4027-8789-841096546438 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:16.064454 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dba34-9021-4027-8789-841096546438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:16.066204 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c33dba34-9021-4027-8789-841096546438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:16.183182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dba34-9021-4027-8789-841096546438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:16.185177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dba34-9021-4027-8789-841096546438 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:16.203943 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 660/1325] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:18.405463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ea690-234f-442a-bb26-f2abb8a77086 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:18.405990 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ea690-234f-442a-bb26-f2abb8a77086 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:18.406077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ea690-234f-442a-bb26-f2abb8a77086 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:18.407560 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 666/1326] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:18.412617 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517ff77-7dc0-455d-9a39-69b76d181d71 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:18.413106 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517ff77-7dc0-455d-9a39-69b76d181d71 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:18.413317 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517ff77-7dc0-455d-9a39-69b76d181d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:18.461376 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:18.479246 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7517ff77-7dc0-455d-9a39-69b76d181d71 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:18.481030 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7517ff77-7dc0-455d-9a39-69b76d181d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:18.579469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 661/1327] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:56:18.615796 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ea690-234f-442a-bb26-f2abb8a77086 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:18.617343 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1c3ea690-234f-442a-bb26-f2abb8a77086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:18.721929 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ea690-234f-442a-bb26-f2abb8a77086 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:18.797241 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8d5d1-7719-4507-be13-27c4eebec131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:18.797871 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8d5d1-7719-4507-be13-27c4eebec131 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:18.798155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8d5d1-7719-4507-be13-27c4eebec131 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:18.798434 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8d5d1-7719-4507-be13-27c4eebec131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:18.800336 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b5f8d5d1-7719-4507-be13-27c4eebec131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:18.818983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:18.912416 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8d5d1-7719-4507-be13-27c4eebec131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:18.913961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8d5d1-7719-4507-be13-27c4eebec131 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:18.935220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 667/1328] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:21.031374 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037855a-47c7-4c1f-87af-8ebb09bf5dc8 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:21.031924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037855a-47c7-4c1f-87af-8ebb09bf5dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:21.031924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037855a-47c7-4c1f-87af-8ebb09bf5dc8 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:21.033394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 662/1329] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:21.038639 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3637a2-464d-4e8d-829d-10767255e10b None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:21.039043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3637a2-464d-4e8d-829d-10767255e10b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:21.039205 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3637a2-464d-4e8d-829d-10767255e10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:21.113325 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-8c3637a2-464d-4e8d-829d-10767255e10b None None] MFA Rules not processed for user `5ebb75ff475d457cb684829880a3d01e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:21.114551 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8c3637a2-464d-4e8d-829d-10767255e10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:21.180382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:21.215161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 668/1330] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:56:21 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:21.253013 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037855a-47c7-4c1f-87af-8ebb09bf5dc8 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:21.254632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2037855a-47c7-4c1f-87af-8ebb09bf5dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:21.365107 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037855a-47c7-4c1f-87af-8ebb09bf5dc8 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:21.386906 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:21.443582 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f4e29-6842-46f2-9ab8-8d3054c43bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:21.444199 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f4e29-6842-46f2-9ab8-8d3054c43bbb service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:21.444481 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f4e29-6842-46f2-9ab8-8d3054c43bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:21.444768 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f4e29-6842-46f2-9ab8-8d3054c43bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:21.446393 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-673f4e29-6842-46f2-9ab8-8d3054c43bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:21.556467 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f4e29-6842-46f2-9ab8-8d3054c43bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:21.557954 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f4e29-6842-46f2-9ab8-8d3054c43bbb service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:21.576406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 663/1331] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:24.297056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876f8d3-13e8-4cfd-b0f9-05b74ffd75c2 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:24.297639 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876f8d3-13e8-4cfd-b0f9-05b74ffd75c2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:24.297639 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876f8d3-13e8-4cfd-b0f9-05b74ffd75c2 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:24.298977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 669/1332] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:24.304250 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db28d6d-f7b8-412f-8766-d22537eae0bc None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:24.304664 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db28d6d-f7b8-412f-8766-d22537eae0bc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:24.304838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db28d6d-f7b8-412f-8766-d22537eae0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:24.367935 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:24.371107 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-5db28d6d-f7b8-412f-8766-d22537eae0bc None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:24.372306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5db28d6d-f7b8-412f-8766-d22537eae0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:24.467131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 664/1333] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:24.504226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876f8d3-13e8-4cfd-b0f9-05b74ffd75c2 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:24.505854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5876f8d3-13e8-4cfd-b0f9-05b74ffd75c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:24.609023 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876f8d3-13e8-4cfd-b0f9-05b74ffd75c2 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:24.681432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3585c-734f-4ae4-bad4-6238ebf08e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:24.682057 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3585c-734f-4ae4-bad4-6238ebf08e13 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:24.682339 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3585c-734f-4ae4-bad4-6238ebf08e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:24.682633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3585c-734f-4ae4-bad4-6238ebf08e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:24.684881 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a2b3585c-734f-4ae4-bad4-6238ebf08e13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:24.711315 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:24.794644 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3585c-734f-4ae4-bad4-6238ebf08e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:24.796209 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3585c-734f-4ae4-bad4-6238ebf08e13 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:24.815265 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 670/1334] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:26.874330 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fe4e1-10a1-4f25-a795-7e6c67af36ba None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:26.874896 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fe4e1-10a1-4f25-a795-7e6c67af36ba None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:26.874896 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fe4e1-10a1-4f25-a795-7e6c67af36ba None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:26.876333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 665/1335] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:26.881575 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35512686-7515-4013-8ed8-ebfcbd215fa2 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:26.882009 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35512686-7515-4013-8ed8-ebfcbd215fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:26.882116 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35512686-7515-4013-8ed8-ebfcbd215fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:26.948025 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-35512686-7515-4013-8ed8-ebfcbd215fa2 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:26.949775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-35512686-7515-4013-8ed8-ebfcbd215fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:27.025425 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:27.048301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 671/1336] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:27.087886 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fe4e1-10a1-4f25-a795-7e6c67af36ba None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:27.089988 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-065fe4e1-10a1-4f25-a795-7e6c67af36ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:27.192592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fe4e1-10a1-4f25-a795-7e6c67af36ba None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:27.220911 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:27.266970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f347eb-b556-4343-856e-999d78a0be3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:27.267587 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f347eb-b556-4343-856e-999d78a0be3c service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:27.267865 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f347eb-b556-4343-856e-999d78a0be3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:27.268138 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f347eb-b556-4343-856e-999d78a0be3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:27.269789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-95f347eb-b556-4343-856e-999d78a0be3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:27.386788 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f347eb-b556-4343-856e-999d78a0be3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:27.388217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f347eb-b556-4343-856e-999d78a0be3c service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:27.406729 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 666/1337] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:30.198023 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb21b95-222d-4705-b695-9ce8d9524678 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:30.198601 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb21b95-222d-4705-b695-9ce8d9524678 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:30.198601 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb21b95-222d-4705-b695-9ce8d9524678 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:30.199985 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 672/1338] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:30.205717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79357a-cc1a-4fef-b374-48dd24e6497e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:30.206154 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79357a-cc1a-4fef-b374-48dd24e6497e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:30.206283 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79357a-cc1a-4fef-b374-48dd24e6497e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:30.273142 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8b79357a-cc1a-4fef-b374-48dd24e6497e None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:30.274352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8b79357a-cc1a-4fef-b374-48dd24e6497e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:30.283103 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:30.372921 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 667/1339] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:56:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:30.409579 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb21b95-222d-4705-b695-9ce8d9524678 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:30.411148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7bb21b95-222d-4705-b695-9ce8d9524678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:30.514309 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb21b95-222d-4705-b695-9ce8d9524678 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:30.592361 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f635a-8676-4ca2-be6d-ebfe6c6337da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:30.593070 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f635a-8676-4ca2-be6d-ebfe6c6337da service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:30.593359 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f635a-8676-4ca2-be6d-ebfe6c6337da service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:30.593643 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f635a-8676-4ca2-be6d-ebfe6c6337da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:30.595349 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-250f635a-8676-4ca2-be6d-ebfe6c6337da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:30.631864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:30.704550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f635a-8676-4ca2-be6d-ebfe6c6337da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:30.706060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f635a-8676-4ca2-be6d-ebfe6c6337da service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:30.725818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 673/1340] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:34.966996 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedebf83-0b59-43a6-b660-ea9c4c2e5c0a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:34.967555 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedebf83-0b59-43a6-b660-ea9c4c2e5c0a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:34.967555 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedebf83-0b59-43a6-b660-ea9c4c2e5c0a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:34.969103 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 668/1341] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:34.975723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26be75-bef8-4c03-bb61-476539c62e52 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:34.976212 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26be75-bef8-4c03-bb61-476539c62e52 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:34.976360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26be75-bef8-4c03-bb61-476539c62e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:35.048889 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-bb26be75-bef8-4c03-bb61-476539c62e52 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:35.049372 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bb26be75-bef8-4c03-bb61-476539c62e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:35.147084 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:35.158487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 674/1342] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:35.198352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedebf83-0b59-43a6-b660-ea9c4c2e5c0a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:35.199912 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cedebf83-0b59-43a6-b660-ea9c4c2e5c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:35.304946 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedebf83-0b59-43a6-b660-ea9c4c2e5c0a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:35.348413 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:35.385458 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc35a5-0ff6-44d3-ade3-982f103c8271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:35.386085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc35a5-0ff6-44d3-ade3-982f103c8271 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:35.386363 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc35a5-0ff6-44d3-ade3-982f103c8271 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:35.386636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc35a5-0ff6-44d3-ade3-982f103c8271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:35.388254 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e2dc35a5-0ff6-44d3-ade3-982f103c8271 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:35.501592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc35a5-0ff6-44d3-ade3-982f103c8271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:35.503119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc35a5-0ff6-44d3-ade3-982f103c8271 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:35.521413 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 669/1343] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:38.554595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4d7de-1aa3-4405-8dba-af05699c3c8f None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:38.555157 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4d7de-1aa3-4405-8dba-af05699c3c8f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:38.555157 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4d7de-1aa3-4405-8dba-af05699c3c8f None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:38.556501 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 675/1344] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:38.562006 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad272f2a-3085-46d6-8d72-6f3dd54511f9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:38.562451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad272f2a-3085-46d6-8d72-6f3dd54511f9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:38.562546 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad272f2a-3085-46d6-8d72-6f3dd54511f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:38.627909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ad272f2a-3085-46d6-8d72-6f3dd54511f9 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:38.629070 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ad272f2a-3085-46d6-8d72-6f3dd54511f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:38.647430 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:38.726439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 670/1345] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:56:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:38.764917 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4d7de-1aa3-4405-8dba-af05699c3c8f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:38.766441 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-29e4d7de-1aa3-4405-8dba-af05699c3c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:38.880219 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4d7de-1aa3-4405-8dba-af05699c3c8f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:38.954104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0afd3-a55e-47c2-9a89-b39d37a32076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:38.954725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0afd3-a55e-47c2-9a89-b39d37a32076 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:38.955005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0afd3-a55e-47c2-9a89-b39d37a32076 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:38.955278 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0afd3-a55e-47c2-9a89-b39d37a32076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:38.956938 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-63e0afd3-a55e-47c2-9a89-b39d37a32076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:39.001703 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:39.070545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0afd3-a55e-47c2-9a89-b39d37a32076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:39.072015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0afd3-a55e-47c2-9a89-b39d37a32076 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:39.091476 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 676/1346] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:43.318270 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391752db-c5e2-4990-bc04-1c5b63beb04d None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:43.318718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391752db-c5e2-4990-bc04-1c5b63beb04d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:43.318718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391752db-c5e2-4990-bc04-1c5b63beb04d None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:43.320984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 671/1347] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:56:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:43.326880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c40ab3-0f9b-46d3-ab9a-97d9fcfbb494 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:43.327367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c40ab3-0f9b-46d3-ab9a-97d9fcfbb494 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:43.327481 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c40ab3-0f9b-46d3-ab9a-97d9fcfbb494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:43.427280 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-82c40ab3-0f9b-46d3-ab9a-97d9fcfbb494 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:43.428546 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-82c40ab3-0f9b-46d3-ab9a-97d9fcfbb494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:43.538357 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:43.541518 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 677/1348] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:43.580379 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391752db-c5e2-4990-bc04-1c5b63beb04d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:43.581984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-391752db-c5e2-4990-bc04-1c5b63beb04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:43.691864 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391752db-c5e2-4990-bc04-1c5b63beb04d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:43.744105 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:43.776674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e734e6-a29a-4c05-a5b2-3ed0b07315f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:43.777333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e734e6-a29a-4c05-a5b2-3ed0b07315f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:43.777614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e734e6-a29a-4c05-a5b2-3ed0b07315f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:43.777885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e734e6-a29a-4c05-a5b2-3ed0b07315f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:43.779545 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b4e734e6-a29a-4c05-a5b2-3ed0b07315f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:43.913739 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e734e6-a29a-4c05-a5b2-3ed0b07315f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:43.913739 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e734e6-a29a-4c05-a5b2-3ed0b07315f7 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:43.929572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 672/1349] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:48.884328 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdfe3b-2a97-42cb-9072-c0af6f72d3d9 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:48.884328 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdfe3b-2a97-42cb-9072-c0af6f72d3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:48.884328 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdfe3b-2a97-42cb-9072-c0af6f72d3d9 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:48.884328 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 678/1350] 10.222.0.75 () {54 vars in 921 bytes} [Thu Jul 28 17:56:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:48.888343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848dc9f-bbd0-4342-9353-9cb725dac1d5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:48.888796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848dc9f-bbd0-4342-9353-9cb725dac1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:48.889004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848dc9f-bbd0-4342-9353-9cb725dac1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:49.014738 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f848dc9f-bbd0-4342-9353-9cb725dac1d5 None None] MFA Rules not processed for user `cff43a72eaef462f86426ad3ceccd3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:49.015896 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f848dc9f-bbd0-4342-9353-9cb725dac1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:49.043275 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:49.153942 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 673/1351] 10.222.0.75 () {58 vars in 1018 bytes} [Thu Jul 28 17:56:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:53.188191 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fb734-5e40-4162-aed7-575b4251ba6b None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:53.188697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fb734-5e40-4162-aed7-575b4251ba6b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:53.189046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fb734-5e40-4162-aed7-575b4251ba6b None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:53.190167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 679/1352] 10.222.0.75 () {54 vars in 921 bytes} [Thu Jul 28 17:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:53.195216 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108fc1a-0d1c-4485-9a83-8c8175868625 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:53.195652 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108fc1a-0d1c-4485-9a83-8c8175868625 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:53.196063 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108fc1a-0d1c-4485-9a83-8c8175868625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:53.278527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8108fc1a-0d1c-4485-9a83-8c8175868625 None None] MFA Rules not processed for user `cff43a72eaef462f86426ad3ceccd3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:53.279733 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8108fc1a-0d1c-4485-9a83-8c8175868625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:53.361986 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:53.406290 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 674/1353] 10.222.0.75 () {58 vars in 1018 bytes} [Thu Jul 28 17:56:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:54.991545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf85b28-f3e9-404b-b90a-b57603e60902 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:54.992100 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf85b28-f3e9-404b-b90a-b57603e60902 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:54.992100 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf85b28-f3e9-404b-b90a-b57603e60902 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:54.993553 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 680/1354] 10.222.0.75 () {54 vars in 921 bytes} [Thu Jul 28 17:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:54.999376 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27f71c-aa35-4dd8-b2d0-c1f0ba3ff6cf None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:54.999842 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27f71c-aa35-4dd8-b2d0-c1f0ba3ff6cf None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:55.000103 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27f71c-aa35-4dd8-b2d0-c1f0ba3ff6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:55.078529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-dc27f71c-aa35-4dd8-b2d0-c1f0ba3ff6cf None None] MFA Rules not processed for user `cff43a72eaef462f86426ad3ceccd3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:55.080005 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dc27f71c-aa35-4dd8-b2d0-c1f0ba3ff6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:55.190093 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 675/1355] 10.222.0.75 () {58 vars in 1018 bytes} [Thu Jul 28 17:56:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:58.527908 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe8803-2185-4bc5-9b83-21db3256d2da None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:58.528607 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe8803-2185-4bc5-9b83-21db3256d2da None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:58.528607 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe8803-2185-4bc5-9b83-21db3256d2da None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:58.529906 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 681/1356] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:58.535278 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1675722-db34-4023-841c-77606a548c51 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:58.535679 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1675722-db34-4023-841c-77606a548c51 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:58.535958 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1675722-db34-4023-841c-77606a548c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:58.588089 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:58.630867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c1675722-db34-4023-841c-77606a548c51 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:58.632009 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c1675722-db34-4023-841c-77606a548c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:58.751005 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 676/1357] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:58.805910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf97e0e-a429-4aaa-9da1-558ea0101c60 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:58.806557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf97e0e-a429-4aaa-9da1-558ea0101c60 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:58.807010 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf97e0e-a429-4aaa-9da1-558ea0101c60 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:58.808996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 682/1358] 10.222.0.75 () {54 vars in 962 bytes} [Thu Jul 28 17:56:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:58.816176 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47d4d9-a487-46c1-bff2-6e52af4f9bdd None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:58.816628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47d4d9-a487-46c1-bff2-6e52af4f9bdd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:58.816978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47d4d9-a487-46c1-bff2-6e52af4f9bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:58.898061 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3c47d4d9-a487-46c1-bff2-6e52af4f9bdd None None] MFA Rules not processed for user `c456a787159844feb7eabfd1e527e46e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:58.899279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3c47d4d9-a487-46c1-bff2-6e52af4f9bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:58.954752 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:59.034548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 677/1359] 10.222.0.75 () {58 vars in 1059 bytes} [Thu Jul 28 17:56:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:56:59.045434 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf97e0e-a429-4aaa-9da1-558ea0101c60 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:59.046937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-dbf97e0e-a429-4aaa-9da1-558ea0101c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:59.208786 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf97e0e-a429-4aaa-9da1-558ea0101c60 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:59.286023 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:59.331493 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d63bb-d2be-48cf-8d0a-b6d262b5a882 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:59.332095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d63bb-d2be-48cf-8d0a-b6d262b5a882 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:59.332380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d63bb-d2be-48cf-8d0a-b6d262b5a882 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:59.332647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d63bb-d2be-48cf-8d0a-b6d262b5a882 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:59.336505 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fb8d63bb-d2be-48cf-8d0a-b6d262b5a882 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:59.433418 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d63bb-d2be-48cf-8d0a-b6d262b5a882 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:59.435122 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d63bb-d2be-48cf-8d0a-b6d262b5a882 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:59.454996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 683/1360] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:01.700740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cbbb2-d09d-4afd-9c10-c8e3d00d5263 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:01.701334 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cbbb2-d09d-4afd-9c10-c8e3d00d5263 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:01.701334 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cbbb2-d09d-4afd-9c10-c8e3d00d5263 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:01.702866 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 678/1361] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:01.707776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962e7a4-15d5-4374-8a12-cd22743409ac None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:01.708222 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962e7a4-15d5-4374-8a12-cd22743409ac None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:01.708419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962e7a4-15d5-4374-8a12-cd22743409ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:01.782844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-8962e7a4-15d5-4374-8a12-cd22743409ac None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:01.784094 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8962e7a4-15d5-4374-8a12-cd22743409ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:01.825880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:01.886661 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 684/1362] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:01.933419 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cbbb2-d09d-4afd-9c10-c8e3d00d5263 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:01.933419 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e72cbbb2-d09d-4afd-9c10-c8e3d00d5263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:02.112570 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cbbb2-d09d-4afd-9c10-c8e3d00d5263 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:02.127562 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:02.245509 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cdc46-dbd6-4431-8c76-7850c06133ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:02.246141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cdc46-dbd6-4431-8c76-7850c06133ec service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:02.246427 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cdc46-dbd6-4431-8c76-7850c06133ec service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:02.246705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cdc46-dbd6-4431-8c76-7850c06133ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:02.248343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-108cdc46-dbd6-4431-8c76-7850c06133ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:02.387329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cdc46-dbd6-4431-8c76-7850c06133ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:02.388975 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cdc46-dbd6-4431-8c76-7850c06133ec service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:02.409613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 679/1363] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:04.925500 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f15b3e-c493-476d-8549-a32db05613d2 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:04.926084 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f15b3e-c493-476d-8549-a32db05613d2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:04.926084 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f15b3e-c493-476d-8549-a32db05613d2 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:04.927407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 685/1364] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:04.933361 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214f13-3998-4285-98d9-65968e7f5ae8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:04.933893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214f13-3998-4285-98d9-65968e7f5ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:04.933893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214f13-3998-4285-98d9-65968e7f5ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:04.953242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:05.029015 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fe214f13-3998-4285-98d9-65968e7f5ae8 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:05.030429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fe214f13-3998-4285-98d9-65968e7f5ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:05.155348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 680/1365] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:05.202525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c34960-67ad-4b19-b116-e9870a4961cf None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:05.203050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c34960-67ad-4b19-b116-e9870a4961cf None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:05.203721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c34960-67ad-4b19-b116-e9870a4961cf None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:05.206213 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 686/1366] 10.222.0.75 () {54 vars in 962 bytes} [Thu Jul 28 17:57:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:05.212577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc728358-2e61-4c23-94a5-4b1751510945 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:05.213099 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc728358-2e61-4c23-94a5-4b1751510945 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:05.213548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc728358-2e61-4c23-94a5-4b1751510945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:05.300621 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fc728358-2e61-4c23-94a5-4b1751510945 None None] MFA Rules not processed for user `c456a787159844feb7eabfd1e527e46e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:05.302074 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fc728358-2e61-4c23-94a5-4b1751510945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:05.345353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:05.443547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 681/1367] 10.222.0.75 () {58 vars in 1059 bytes} [Thu Jul 28 17:57:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:05.453007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c34960-67ad-4b19-b116-e9870a4961cf None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:05.454769 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b9c34960-67ad-4b19-b116-e9870a4961cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:05.615666 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c34960-67ad-4b19-b116-e9870a4961cf None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:05.640071 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:05.741487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff67606-8c13-44bf-aca3-e225b781036f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:05.742247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff67606-8c13-44bf-aca3-e225b781036f service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:05.742652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff67606-8c13-44bf-aca3-e225b781036f service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:05.743077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff67606-8c13-44bf-aca3-e225b781036f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:05.745378 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8ff67606-8c13-44bf-aca3-e225b781036f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:05.846632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff67606-8c13-44bf-aca3-e225b781036f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:05.848485 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff67606-8c13-44bf-aca3-e225b781036f service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:05.870880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 687/1368] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:57:06.833658 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ae18b-d372-4329-92cf-c692fa8c4665 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:06.834193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ae18b-d372-4329-92cf-c692fa8c4665 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:06.834193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ae18b-d372-4329-92cf-c692fa8c4665 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:06.836100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 682/1369] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:57:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:06.843216 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cee881-7d43-455d-b497-0a0380917dda None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:06.843705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cee881-7d43-455d-b497-0a0380917dda None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:06.844001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cee881-7d43-455d-b497-0a0380917dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:06.877694 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:06.913738 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-26cee881-7d43-455d-b497-0a0380917dda None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:06.915585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-26cee881-7d43-455d-b497-0a0380917dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:07.032942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 688/1370] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:07.373434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901ec48-c1c1-469d-9c5a-e69354daa3b7 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:07.373851 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901ec48-c1c1-469d-9c5a-e69354daa3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:07.374233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901ec48-c1c1-469d-9c5a-e69354daa3b7 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:07.375946 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 683/1371] 10.222.0.75 () {54 vars in 964 bytes} [Thu Jul 28 17:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:07.381225 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e34f5-88aa-418d-b33b-ffbcff7acf41 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:07.381522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e34f5-88aa-418d-b33b-ffbcff7acf41 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:07.381802 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e34f5-88aa-418d-b33b-ffbcff7acf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:07.463141 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-035e34f5-88aa-418d-b33b-ffbcff7acf41 None None] MFA Rules not processed for user `be78ea573a674611807171c76f8003ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:07.464350 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-035e34f5-88aa-418d-b33b-ffbcff7acf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:07.513030 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:07.545164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 689/1372] 10.222.0.75 () {58 vars in 1061 bytes} [Thu Jul 28 17:57:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:07.552815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901ec48-c1c1-469d-9c5a-e69354daa3b7 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:07.554446 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5901ec48-c1c1-469d-9c5a-e69354daa3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:07.669103 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901ec48-c1c1-469d-9c5a-e69354daa3b7 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:07.712690 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:07.755766 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0fc869-2520-434a-9152-0a9b366e3cd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:07.756552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fc869-2520-434a-9152-0a9b366e3cd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:07.756975 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fc869-2520-434a-9152-0a9b366e3cd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:07.757351 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fc869-2520-434a-9152-0a9b366e3cd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:07.759954 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6b0fc869-2520-434a-9152-0a9b366e3cd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:07.890716 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0fc869-2520-434a-9152-0a9b366e3cd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:07.892162 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0fc869-2520-434a-9152-0a9b366e3cd3 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:07.910375 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 684/1373] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:57:08.226884 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63f76d-1b5e-43b8-b413-7291fd8e6687 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:08.227847 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63f76d-1b5e-43b8-b413-7291fd8e6687 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:08.228099 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63f76d-1b5e-43b8-b413-7291fd8e6687 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:08.230715 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 690/1374] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:57:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:57:08.235546 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f41b9-cd2a-4695-b95d-f4d0d69e0c0a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:08.235880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f41b9-cd2a-4695-b95d-f4d0d69e0c0a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:08.236281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f41b9-cd2a-4695-b95d-f4d0d69e0c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:08.309002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-428f41b9-cd2a-4695-b95d-f4d0d69e0c0a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:08.309944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-428f41b9-cd2a-4695-b95d-f4d0d69e0c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:08.331019 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:08.409340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 685/1375] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:08.453021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63f76d-1b5e-43b8-b413-7291fd8e6687 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:08.454694 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fb63f76d-1b5e-43b8-b413-7291fd8e6687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:08.601302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63f76d-1b5e-43b8-b413-7291fd8e6687 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:08.654499 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:08.720521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248f879-e606-459c-bceb-2285e85685dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:08.721185 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248f879-e606-459c-bceb-2285e85685dd service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:08.721468 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248f879-e606-459c-bceb-2285e85685dd service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:08.721742 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248f879-e606-459c-bceb-2285e85685dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:08.723430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4248f879-e606-459c-bceb-2285e85685dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:08.815248 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248f879-e606-459c-bceb-2285e85685dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:08.816924 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248f879-e606-459c-bceb-2285e85685dd service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:08.835333 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 691/1376] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:11.000943 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84f5d9-3085-4bc5-9fa8-cab469c0d666 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:11.001518 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84f5d9-3085-4bc5-9fa8-cab469c0d666 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:11.001612 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84f5d9-3085-4bc5-9fa8-cab469c0d666 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:11.002932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 686/1377] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:11.008409 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ded65b-eafa-4e33-be25-e12834bbe2bb None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:11.008929 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ded65b-eafa-4e33-be25-e12834bbe2bb None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:11.009035 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ded65b-eafa-4e33-be25-e12834bbe2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:11.090696 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-47ded65b-eafa-4e33-be25-e12834bbe2bb None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:11.091916 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-47ded65b-eafa-4e33-be25-e12834bbe2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:11.098806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:11.206723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 692/1378] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:11.251344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84f5d9-3085-4bc5-9fa8-cab469c0d666 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:11.252862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8a84f5d9-3085-4bc5-9fa8-cab469c0d666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:11.404249 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84f5d9-3085-4bc5-9fa8-cab469c0d666 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:11.407990 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:11.535143 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714311e-307f-42f3-bcba-6b9564251e55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:11.535774 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714311e-307f-42f3-bcba-6b9564251e55 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:11.536056 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714311e-307f-42f3-bcba-6b9564251e55 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:11.536333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714311e-307f-42f3-bcba-6b9564251e55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:11.537989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d714311e-307f-42f3-bcba-6b9564251e55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:11.657162 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714311e-307f-42f3-bcba-6b9564251e55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:11.659132 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714311e-307f-42f3-bcba-6b9564251e55 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:11.690077 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 687/1379] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:13.877801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84f1ce-5318-4618-8f9b-a379c6c066c6 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:13.878528 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84f1ce-5318-4618-8f9b-a379c6c066c6 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:13.878528 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84f1ce-5318-4618-8f9b-a379c6c066c6 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:13.879886 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 693/1380] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:13.887478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265ec70-3a4d-4e27-a1c9-cb5dab6388c2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:13.887996 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265ec70-3a4d-4e27-a1c9-cb5dab6388c2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:13.888267 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265ec70-3a4d-4e27-a1c9-cb5dab6388c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:13.901017 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:13.964861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b265ec70-3a4d-4e27-a1c9-cb5dab6388c2 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:13.967104 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b265ec70-3a4d-4e27-a1c9-cb5dab6388c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:14.099107 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 688/1381] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:14.146973 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84f1ce-5318-4618-8f9b-a379c6c066c6 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:14.148492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5d84f1ce-5318-4618-8f9b-a379c6c066c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:14.317870 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:14.329559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84f1ce-5318-4618-8f9b-a379c6c066c6 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:14.458374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97a079-7291-4ed1-a762-4ae6cff25d59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:14.459278 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97a079-7291-4ed1-a762-4ae6cff25d59 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:14.459663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97a079-7291-4ed1-a762-4ae6cff25d59 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:14.460093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97a079-7291-4ed1-a762-4ae6cff25d59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:14.462688 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ff97a079-7291-4ed1-a762-4ae6cff25d59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:14.568871 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97a079-7291-4ed1-a762-4ae6cff25d59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:14.570689 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97a079-7291-4ed1-a762-4ae6cff25d59 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:14.581477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:14.600718 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 694/1382] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:57:16.754714 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0482d8-ce07-4f0f-a3b0-b08698af4503 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:16.755286 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0482d8-ce07-4f0f-a3b0-b08698af4503 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:16.755286 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0482d8-ce07-4f0f-a3b0-b08698af4503 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:16.756765 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 689/1383] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:57:16.763134 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f0970-f22d-44b5-a793-03dbc38b863b None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:16.763607 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f0970-f22d-44b5-a793-03dbc38b863b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:16.763703 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f0970-f22d-44b5-a793-03dbc38b863b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:16.833570 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c22f0970-f22d-44b5-a793-03dbc38b863b None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:16.834804 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c22f0970-f22d-44b5-a793-03dbc38b863b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:16.936428 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 695/1384] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:16.980141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0482d8-ce07-4f0f-a3b0-b08698af4503 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:16.981752 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9a0482d8-ce07-4f0f-a3b0-b08698af4503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:17.077777 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:17.150815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0482d8-ce07-4f0f-a3b0-b08698af4503 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:17.275605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c0f92-d8ef-4e6b-be06-f6aa9da74716 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:17.276237 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c0f92-d8ef-4e6b-be06-f6aa9da74716 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:17.276525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c0f92-d8ef-4e6b-be06-f6aa9da74716 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:17.276841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c0f92-d8ef-4e6b-be06-f6aa9da74716 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:17.278495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-056c0f92-d8ef-4e6b-be06-f6aa9da74716 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:17.329845 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:17.375919 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c0f92-d8ef-4e6b-be06-f6aa9da74716 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:17.378429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c0f92-d8ef-4e6b-be06-f6aa9da74716 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:17.403119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 690/1385] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:19.535403 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e367e5-5321-44a4-b059-dae38b360f4e None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:19.535937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e367e5-5321-44a4-b059-dae38b360f4e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:19.536071 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e367e5-5321-44a4-b059-dae38b360f4e None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:19.537927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 696/1386] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:57:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:19.545688 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586da3d-0d7f-4eb4-90a5-3be08cc51ae8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:19.546350 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586da3d-0d7f-4eb4-90a5-3be08cc51ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:19.546818 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586da3d-0d7f-4eb4-90a5-3be08cc51ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:19.641604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3586da3d-0d7f-4eb4-90a5-3be08cc51ae8 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:19.642983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3586da3d-0d7f-4eb4-90a5-3be08cc51ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:19.755194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 691/1387] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:19.803868 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e367e5-5321-44a4-b059-dae38b360f4e None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:19.805960 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-55e367e5-5321-44a4-b059-dae38b360f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:19.904835 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:19.989451 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e367e5-5321-44a4-b059-dae38b360f4e None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:20.109880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482cd3f-f1d3-4440-93ac-728ad3f62e7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:20.110872 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482cd3f-f1d3-4440-93ac-728ad3f62e7d service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:20.111320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482cd3f-f1d3-4440-93ac-728ad3f62e7d service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:20.111876 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482cd3f-f1d3-4440-93ac-728ad3f62e7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:20.114924 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d482cd3f-f1d3-4440-93ac-728ad3f62e7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:20.157155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:20.213248 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482cd3f-f1d3-4440-93ac-728ad3f62e7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:20.215104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482cd3f-f1d3-4440-93ac-728ad3f62e7d service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:20.238676 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 697/1388] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:22.425156 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ab906-a521-49d8-9335-9a284ce7fd1f None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:22.425720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ab906-a521-49d8-9335-9a284ce7fd1f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:22.425720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ab906-a521-49d8-9335-9a284ce7fd1f None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:22.427120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 692/1389] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:22.432999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b2270-fb55-413c-975b-14bf6dac9e1d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:22.433390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b2270-fb55-413c-975b-14bf6dac9e1d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:22.433562 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b2270-fb55-413c-975b-14bf6dac9e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:22.501530 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-1e0b2270-fb55-413c-975b-14bf6dac9e1d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:22.502747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1e0b2270-fb55-413c-975b-14bf6dac9e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:22.603637 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 698/1390] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:22.647851 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ab906-a521-49d8-9335-9a284ce7fd1f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:22.649934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c25ab906-a521-49d8-9335-9a284ce7fd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:22.681621 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:22.799982 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ab906-a521-49d8-9335-9a284ce7fd1f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:22.903262 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:22.915281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a00134-bdd5-4183-8130-3c3f914a0512 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:22.915910 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a00134-bdd5-4183-8130-3c3f914a0512 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:22.916195 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a00134-bdd5-4183-8130-3c3f914a0512 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:22.916474 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a00134-bdd5-4183-8130-3c3f914a0512 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:22.918206 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c9a00134-bdd5-4183-8130-3c3f914a0512 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:23.009720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a00134-bdd5-4183-8130-3c3f914a0512 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:23.011370 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a00134-bdd5-4183-8130-3c3f914a0512 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:23.030065 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 693/1391] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:23.313361 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2953e-61c0-4217-8d93-21fd00b1d693 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:23.313866 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2953e-61c0-4217-8d93-21fd00b1d693 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:23.314150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2953e-61c0-4217-8d93-21fd00b1d693 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:23.315539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 699/1392] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:57:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:23.321921 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b38948-7380-48b8-b678-025c9b81e9ca None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:23.322210 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b38948-7380-48b8-b678-025c9b81e9ca None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:23.322489 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b38948-7380-48b8-b678-025c9b81e9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:23.399123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-60b38948-7380-48b8-b678-025c9b81e9ca None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:23.400518 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-60b38948-7380-48b8-b678-025c9b81e9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:23.460716 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:23.500617 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 694/1393] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:23.558698 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276e8ab-55af-47c4-89ff-0d5871a15d0d None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:23.559154 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276e8ab-55af-47c4-89ff-0d5871a15d0d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:23.559406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276e8ab-55af-47c4-89ff-0d5871a15d0d None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:23.560864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 700/1394] 10.222.0.75 () {54 vars in 966 bytes} [Thu Jul 28 17:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:23.566227 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9582cd-461c-4ec1-a6e8-be59f940018b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:23.566574 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9582cd-461c-4ec1-a6e8-be59f940018b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:23.566988 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9582cd-461c-4ec1-a6e8-be59f940018b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:23.659334 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fb9582cd-461c-4ec1-a6e8-be59f940018b None None] MFA Rules not processed for user `1837a832a0da4d698984ce62057b81f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:23.660534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fb9582cd-461c-4ec1-a6e8-be59f940018b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:23.737149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 695/1395] 10.222.0.75 () {58 vars in 1063 bytes} [Thu Jul 28 17:57:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:23.745715 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276e8ab-55af-47c4-89ff-0d5871a15d0d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:23.747245 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e276e8ab-55af-47c4-89ff-0d5871a15d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:23.762234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:23.853658 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276e8ab-55af-47c4-89ff-0d5871a15d0d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:23.930124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49354c8f-472c-401d-a0c7-900a941b207d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1837a832a0da4d698984ce62057b81f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:23.930762 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49354c8f-472c-401d-a0c7-900a941b207d service glance] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:23.931059 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49354c8f-472c-401d-a0c7-900a941b207d service glance] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:23.931356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49354c8f-472c-401d-a0c7-900a941b207d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:23.933766 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-49354c8f-472c-401d-a0c7-900a941b207d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:24.002692 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:24.045913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49354c8f-472c-401d-a0c7-900a941b207d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:24.047388 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49354c8f-472c-401d-a0c7-900a941b207d service glance] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:24.066182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 701/1396] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:57:24.938786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead6d32-779b-46f9-b869-aafbe50b21c8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:24.939253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead6d32-779b-46f9-b869-aafbe50b21c8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:24.939361 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead6d32-779b-46f9-b869-aafbe50b21c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:25.017737 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9ead6d32-779b-46f9-b869-aafbe50b21c8 None None] MFA Rules not processed for user `1cbbfdda843a4ab98ff9cf0742513f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:25.018994 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9ead6d32-779b-46f9-b869-aafbe50b21c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:25.027884 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:25.107188 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 696/1397] 10.222.0.75 () {58 vars in 1009 bytes} [Thu Jul 28 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:25.154490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de3e4e-e6c1-4102-93c1-e5ebed36d46f None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:25.154966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de3e4e-e6c1-4102-93c1-e5ebed36d46f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:25.155081 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de3e4e-e6c1-4102-93c1-e5ebed36d46f None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:25.156448 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 702/1398] 10.222.0.75 () {54 vars in 943 bytes} [Thu Jul 28 17:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:25.163046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bedfe-1030-47d7-9e42-93a1fbcf8985 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:25.163334 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bedfe-1030-47d7-9e42-93a1fbcf8985 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:25.163612 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bedfe-1030-47d7-9e42-93a1fbcf8985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:25.246262 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-405bedfe-1030-47d7-9e42-93a1fbcf8985 None None] MFA Rules not processed for user `d77b4fcb974d48a0bda4852c8d304511`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:25.247566 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-405bedfe-1030-47d7-9e42-93a1fbcf8985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:25.276867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45bd0f-075f-48d8-9601-5b5881333347 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:25.277530 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45bd0f-075f-48d8-9601-5b5881333347 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:25.278031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45bd0f-075f-48d8-9601-5b5881333347 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:25.279990 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 703/1399] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:57:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:57:25.285316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9a498-89fd-4d7b-9af5-bdafa9f3e1e2 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:25.285727 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9a498-89fd-4d7b-9af5-bdafa9f3e1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:25.286129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9a498-89fd-4d7b-9af5-bdafa9f3e1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:25.382484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-00c9a498-89fd-4d7b-9af5-bdafa9f3e1e2 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:25.383071 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:25.384623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-00c9a498-89fd-4d7b-9af5-bdafa9f3e1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:25.408086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 697/1400] 10.222.0.75 () {58 vars in 1040 bytes} [Thu Jul 28 17:57:25 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:57:25.418664 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bedfe-1030-47d7-9e42-93a1fbcf8985 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:25.431330 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bedfe-1030-47d7-9e42-93a1fbcf8985 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:25.504877 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 704/1401] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:57:25.545726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9a498-89fd-4d7b-9af5-bdafa9f3e1e2 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:25.546036 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48aa0d9-e4a0-4968-ad4d-c15361fa16d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77b4fcb974d48a0bda4852c8d304511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:25.546666 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aa0d9-e4a0-4968-ad4d-c15361fa16d3 service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:25.546944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aa0d9-e4a0-4968-ad4d-c15361fa16d3 service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:25.547178 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-00c9a498-89fd-4d7b-9af5-bdafa9f3e1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:25.547282 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aa0d9-e4a0-4968-ad4d-c15361fa16d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:25.548917 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f48aa0d9-e4a0-4968-ad4d-c15361fa16d3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:25.575183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:25.636273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48aa0d9-e4a0-4968-ad4d-c15361fa16d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:25.637912 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48aa0d9-e4a0-4968-ad4d-c15361fa16d3 service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:25.646248 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 698/1402] 10.222.0.75 () {60 vars in 1384 bytes} [Thu Jul 28 17:57:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 17:57:25.671223 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9a498-89fd-4d7b-9af5-bdafa9f3e1e2 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:25.792095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0cc73-2fe0-4286-a682-1b456463a7af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:25.792646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0cc73-2fe0-4286-a682-1b456463a7af service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:25.792963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0cc73-2fe0-4286-a682-1b456463a7af service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:25.793244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0cc73-2fe0-4286-a682-1b456463a7af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:25.794884 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-04e0cc73-2fe0-4286-a682-1b456463a7af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:25.812737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:25.884390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0cc73-2fe0-4286-a682-1b456463a7af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:25.886066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0cc73-2fe0-4286-a682-1b456463a7af service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:25.904600 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 705/1403] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:57:28.129999 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0d98b-7572-49b0-b729-3dd5e07ea483 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:28.130647 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0d98b-7572-49b0-b729-3dd5e07ea483 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:28.130647 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0d98b-7572-49b0-b729-3dd5e07ea483 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:28.132224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 699/1404] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:28.140084 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8b312-960f-4f8c-a0ed-82eb742ba5da None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:28.140084 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8b312-960f-4f8c-a0ed-82eb742ba5da None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:28.140084 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8b312-960f-4f8c-a0ed-82eb742ba5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:28.216685 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-cbf8b312-960f-4f8c-a0ed-82eb742ba5da None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:28.217951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-cbf8b312-960f-4f8c-a0ed-82eb742ba5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:28.318018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:28.327327 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 706/1405] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:28.380937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0d98b-7572-49b0-b729-3dd5e07ea483 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:28.382726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-91c0d98b-7572-49b0-b729-3dd5e07ea483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:28.393001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:28.562613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0d98b-7572-49b0-b729-3dd5e07ea483 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:28.657722 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:28.697400 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ab20b-e3a4-4ea7-bf40-802a693dbd73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:28.698135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ab20b-e3a4-4ea7-bf40-802a693dbd73 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:28.698513 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ab20b-e3a4-4ea7-bf40-802a693dbd73 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:28.698861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ab20b-e3a4-4ea7-bf40-802a693dbd73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:28.700670 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dd7ab20b-e3a4-4ea7-bf40-802a693dbd73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:28.802759 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ab20b-e3a4-4ea7-bf40-802a693dbd73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:28.805082 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ab20b-e3a4-4ea7-bf40-802a693dbd73 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:28.823707 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 700/1406] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:57:31.066407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ea74c-92a1-442a-8044-c589cc11e4d1 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:31.066971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ea74c-92a1-442a-8044-c589cc11e4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:31.066971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ea74c-92a1-442a-8044-c589cc11e4d1 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:31.068574 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 707/1407] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:31.073700 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cc185-9bc7-464a-9b71-34acbe637391 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:31.074471 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cc185-9bc7-464a-9b71-34acbe637391 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:31.074756 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cc185-9bc7-464a-9b71-34acbe637391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:31.149595 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-534cc185-9bc7-464a-9b71-34acbe637391 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:31.154188 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-534cc185-9bc7-464a-9b71-34acbe637391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:31.209227 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:31.268807 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 701/1408] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:31.311502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ea74c-92a1-442a-8044-c589cc11e4d1 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:31.313497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1d3ea74c-92a1-442a-8044-c589cc11e4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:31.511421 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ea74c-92a1-442a-8044-c589cc11e4d1 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:31.609954 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:31.664977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4250ca6-26ab-4e53-b3b6-86618f441acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:31.665594 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4250ca6-26ab-4e53-b3b6-86618f441acf service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:31.665880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4250ca6-26ab-4e53-b3b6-86618f441acf service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:31.666156 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4250ca6-26ab-4e53-b3b6-86618f441acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:31.667814 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b4250ca6-26ab-4e53-b3b6-86618f441acf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:31.772364 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4250ca6-26ab-4e53-b3b6-86618f441acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:31.774562 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4250ca6-26ab-4e53-b3b6-86618f441acf service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:31.793713 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 708/1409] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:41.264426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=23 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:41.791249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=64 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:49.417269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5807b-0f27-4fff-a79d-fcf5315e9bae None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:49.417830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5807b-0f27-4fff-a79d-fcf5315e9bae None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:49.417830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5807b-0f27-4fff-a79d-fcf5315e9bae None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:49.420094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 702/1410] 10.222.0.75 () {54 vars in 918 bytes} [Thu Jul 28 17:57:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:49.425000 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d31d75-e30f-400f-a572-2fb224f0429f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:49.425428 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d31d75-e30f-400f-a572-2fb224f0429f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:49.425663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d31d75-e30f-400f-a572-2fb224f0429f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:49.501732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-59d31d75-e30f-400f-a572-2fb224f0429f None None] MFA Rules not processed for user `cff43a72eaef462f86426ad3ceccd3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:49.502963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-59d31d75-e30f-400f-a572-2fb224f0429f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:49.610640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 709/1411] 10.222.0.75 () {58 vars in 1015 bytes} [Thu Jul 28 17:57:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:49.625481 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865683f5-78c5-42f7-b5ce-be48c704a3d0 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:49.625777 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865683f5-78c5-42f7-b5ce-be48c704a3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:49.626061 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865683f5-78c5-42f7-b5ce-be48c704a3d0 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:49.627475 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 703/1412] 10.222.0.75 () {54 vars in 918 bytes} [Thu Jul 28 17:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:49.633183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62a1d0-2c16-445b-99fc-a1d484df9d3c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:49.633475 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62a1d0-2c16-445b-99fc-a1d484df9d3c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:49.633755 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62a1d0-2c16-445b-99fc-a1d484df9d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:49.715923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:49.719874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-dd62a1d0-2c16-445b-99fc-a1d484df9d3c None None] MFA Rules not processed for user `c456a787159844feb7eabfd1e527e46e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:49.721525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-dd62a1d0-2c16-445b-99fc-a1d484df9d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:49.851922 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 710/1413] 10.222.0.75 () {58 vars in 1015 bytes} [Thu Jul 28 17:57:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:52.816619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d8a78-33c2-4f5b-b2b8-89cd32841c93 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:52.827003 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d8a78-33c2-4f5b-b2b8-89cd32841c93 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:52.827003 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d8a78-33c2-4f5b-b2b8-89cd32841c93 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:52.827003 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:52.827301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e5344-d5ac-450e-85ad-98e770bba054 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:52.827301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e5344-d5ac-450e-85ad-98e770bba054 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:52.827301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e5344-d5ac-450e-85ad-98e770bba054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:52.890547 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-457e5344-d5ac-450e-85ad-98e770bba054 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:52.891757 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-457e5344-d5ac-450e-85ad-98e770bba054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:52.946002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:52.988812 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:53.033263 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d8a78-33c2-4f5b-b2b8-89cd32841c93 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:53.035008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a88d8a78-33c2-4f5b-b2b8-89cd32841c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:53.180379 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d8a78-33c2-4f5b-b2b8-89cd32841c93 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:53.254108 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:53.296777 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d7dfe-5cee-4913-bbeb-e8d84c9e088f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:53.297398 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d7dfe-5cee-4913-bbeb-e8d84c9e088f service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:53.297679 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d7dfe-5cee-4913-bbeb-e8d84c9e088f service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:53.297951 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d7dfe-5cee-4913-bbeb-e8d84c9e088f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:53.299603 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bd9d7dfe-5cee-4913-bbeb-e8d84c9e088f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:53.393943 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d7dfe-5cee-4913-bbeb-e8d84c9e088f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:53.395549 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d7dfe-5cee-4913-bbeb-e8d84c9e088f service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:53.413381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 705/1416] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:54.317687 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69d8cd-e8f7-406f-a064-ae4ea31f0e5b None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:54.318251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69d8cd-e8f7-406f-a064-ae4ea31f0e5b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:54.318251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69d8cd-e8f7-406f-a064-ae4ea31f0e5b None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:54.320178 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 17:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:54.325228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b8be7-584b-4dbe-a29b-639e1982f1b5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:54.325660 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b8be7-584b-4dbe-a29b-639e1982f1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:54.325777 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b8be7-584b-4dbe-a29b-639e1982f1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:54.402073 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f80b8be7-584b-4dbe-a29b-639e1982f1b5 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:54.403275 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f80b8be7-584b-4dbe-a29b-639e1982f1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:54.429746 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:54.504575 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 17:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:54.654913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69d8cd-e8f7-406f-a064-ae4ea31f0e5b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:54.656395 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6d69d8cd-e8f7-406f-a064-ae4ea31f0e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:54.809341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69d8cd-e8f7-406f-a064-ae4ea31f0e5b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:54.848741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:54.921170 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe552af-683c-4b6e-ae65-928b8153f3e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:54.921797 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe552af-683c-4b6e-ae65-928b8153f3e0 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:54.922070 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe552af-683c-4b6e-ae65-928b8153f3e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:54.922338 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe552af-683c-4b6e-ae65-928b8153f3e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:54.923982 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-dfe552af-683c-4b6e-ae65-928b8153f3e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:55.020512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe552af-683c-4b6e-ae65-928b8153f3e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:55.022846 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe552af-683c-4b6e-ae65-928b8153f3e0 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:55.043190 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 713/1419] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:55.938554 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4541e0-70d7-44ec-ba55-007dc2658a61 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:55.939090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4541e0-70d7-44ec-ba55-007dc2658a61 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:55.939090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4541e0-70d7-44ec-ba55-007dc2658a61 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:55.940520 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 17:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:55.946025 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b2ef-2215-47fb-aa04-851fcff55236 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:55.946431 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b2ef-2215-47fb-aa04-851fcff55236 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:55.946587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b2ef-2215-47fb-aa04-851fcff55236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:56.000957 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:56.023856 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-3626b2ef-2215-47fb-aa04-851fcff55236 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:56.024973 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3626b2ef-2215-47fb-aa04-851fcff55236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:56.121175 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 17:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:56.272316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4541e0-70d7-44ec-ba55-007dc2658a61 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:56.273961 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-de4541e0-70d7-44ec-ba55-007dc2658a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:56.448488 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4541e0-70d7-44ec-ba55-007dc2658a61 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:56.460970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:56.563095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d8562-a9be-43e4-baa1-5e2a467c9250 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:56.563626 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d8562-a9be-43e4-baa1-5e2a467c9250 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:56.563903 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d8562-a9be-43e4-baa1-5e2a467c9250 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:56.564169 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d8562-a9be-43e4-baa1-5e2a467c9250 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:56.565891 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9d4d8562-a9be-43e4-baa1-5e2a467c9250 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:56.802056 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d8562-a9be-43e4-baa1-5e2a467c9250 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:56.803691 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d8562-a9be-43e4-baa1-5e2a467c9250 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:56.822182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 708/1422] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:57.678136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e55047-0663-484c-9e4d-42c058228b2b None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:57.678692 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e55047-0663-484c-9e4d-42c058228b2b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:57.678692 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e55047-0663-484c-9e4d-42c058228b2b None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:57.680037 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 17:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:57.684882 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75498359-6ff8-411d-84ff-4fe5403a0ce7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:57.685274 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75498359-6ff8-411d-84ff-4fe5403a0ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:57.685438 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75498359-6ff8-411d-84ff-4fe5403a0ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:57.705938 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:57.762562 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-75498359-6ff8-411d-84ff-4fe5403a0ce7 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:57.763773 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-75498359-6ff8-411d-84ff-4fe5403a0ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:57.858485 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 17:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:58.010224 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e55047-0663-484c-9e4d-42c058228b2b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:58.011707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e8e55047-0663-484c-9e4d-42c058228b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:58.121978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:58.159364 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e55047-0663-484c-9e4d-42c058228b2b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:58.269370 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f9f84-2c25-4b21-9226-f0a2de0eaf79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:58.269907 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f9f84-2c25-4b21-9226-f0a2de0eaf79 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:58.270186 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f9f84-2c25-4b21-9226-f0a2de0eaf79 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:58.270452 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f9f84-2c25-4b21-9226-f0a2de0eaf79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:58.272732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9c6f9f84-2c25-4b21-9226-f0a2de0eaf79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:58.350194 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:58.364350 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f9f84-2c25-4b21-9226-f0a2de0eaf79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:58.386587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f9f84-2c25-4b21-9226-f0a2de0eaf79 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:58.386587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 716/1425] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:59.256687 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde5748-5318-42da-b88d-96b8c650aba2 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:59.256687 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde5748-5318-42da-b88d-96b8c650aba2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:59.257352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde5748-5318-42da-b88d-96b8c650aba2 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:59.258440 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 17:57:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:57:59.263459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59afaf-5372-41f6-9bbe-58232e37b759 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:59.263974 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59afaf-5372-41f6-9bbe-58232e37b759 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:59.264084 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59afaf-5372-41f6-9bbe-58232e37b759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:59.340324 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-da59afaf-5372-41f6-9bbe-58232e37b759 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:59.341579 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-da59afaf-5372-41f6-9bbe-58232e37b759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:59.439070 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 17:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:59.590891 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde5748-5318-42da-b88d-96b8c650aba2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:59.592337 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6bde5748-5318-42da-b88d-96b8c650aba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:59.677249 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:59.738982 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde5748-5318-42da-b88d-96b8c650aba2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:59.851040 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0b7fc-b7cc-47a7-ad08-952a8b5e52c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:59.851587 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b7fc-b7cc-47a7-ad08-952a8b5e52c7 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:59.851869 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b7fc-b7cc-47a7-ad08-952a8b5e52c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:59.852172 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b7fc-b7cc-47a7-ad08-952a8b5e52c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:59.853811 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b6b0b7fc-b7cc-47a7-ad08-952a8b5e52c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:59.901319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:59.942631 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0b7fc-b7cc-47a7-ad08-952a8b5e52c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:59.944237 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0b7fc-b7cc-47a7-ad08-952a8b5e52c7 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:59.961956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 711/1428] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:00.821261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a389bfc-1150-43aa-9c8c-041393fc7149 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:00.821971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a389bfc-1150-43aa-9c8c-041393fc7149 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:00.821971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a389bfc-1150-43aa-9c8c-041393fc7149 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:00.823182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 17:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:58:00.828312 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbc17c-0e98-4c7c-aa20-d32dc2b530a0 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:00.828705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbc17c-0e98-4c7c-aa20-d32dc2b530a0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:00.828910 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbc17c-0e98-4c7c-aa20-d32dc2b530a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:00.907348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-48dbc17c-0e98-4c7c-aa20-d32dc2b530a0 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:00.908544 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-48dbc17c-0e98-4c7c-aa20-d32dc2b530a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:01.013377 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 17:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:01.164309 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a389bfc-1150-43aa-9c8c-041393fc7149 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:01.165789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3a389bfc-1150-43aa-9c8c-041393fc7149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:01.214631 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:01.314745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a389bfc-1150-43aa-9c8c-041393fc7149 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:01.428898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c333d49-8e65-47d8-8977-dca1dcb9c245 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:01.429524 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c333d49-8e65-47d8-8977-dca1dcb9c245 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:01.429824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c333d49-8e65-47d8-8977-dca1dcb9c245 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:01.430092 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c333d49-8e65-47d8-8977-dca1dcb9c245 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:01.431702 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1c333d49-8e65-47d8-8977-dca1dcb9c245 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:01.438703 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:01.520957 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c333d49-8e65-47d8-8977-dca1dcb9c245 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:01.523191 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c333d49-8e65-47d8-8977-dca1dcb9c245 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:01.541045 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 719/1431] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:02.412681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd648c9f-786f-4829-9870-a255c5802fb1 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:02.413255 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd648c9f-786f-4829-9870-a255c5802fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:02.413255 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd648c9f-786f-4829-9870-a255c5802fb1 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:02.414651 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 17:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:58:02.419874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588dfa4-bf6f-4213-bec5-ae9b2756e72a None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:02.420356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588dfa4-bf6f-4213-bec5-ae9b2756e72a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:02.420465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588dfa4-bf6f-4213-bec5-ae9b2756e72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:02.496505 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-9588dfa4-bf6f-4213-bec5-ae9b2756e72a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:02.497749 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9588dfa4-bf6f-4213-bec5-ae9b2756e72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:02.567931 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:02.597803 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 17:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:02.749140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd648c9f-786f-4829-9870-a255c5802fb1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:02.750726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fd648c9f-786f-4829-9870-a255c5802fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:02.769639 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:02.898155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd648c9f-786f-4829-9870-a255c5802fb1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:02.985154 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:03.011458 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b184604-84e0-43da-a02c-b031dd2c31f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:03.012069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b184604-84e0-43da-a02c-b031dd2c31f8 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:03.012344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b184604-84e0-43da-a02c-b031dd2c31f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:03.012615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b184604-84e0-43da-a02c-b031dd2c31f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:03.014996 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7b184604-84e0-43da-a02c-b031dd2c31f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:03.101901 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b184604-84e0-43da-a02c-b031dd2c31f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:03.103596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b184604-84e0-43da-a02c-b031dd2c31f8 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:03.121997 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 714/1434] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:04.033615 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc747f81-b1bf-4918-95cc-687a4f6854cf None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:04.034148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc747f81-b1bf-4918-95cc-687a4f6854cf None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:04.034460 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc747f81-b1bf-4918-95cc-687a4f6854cf None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:04.035848 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 17:58:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:58:04.041235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888357d-014a-412b-be45-02b71b458272 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:04.041682 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888357d-014a-412b-be45-02b71b458272 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:04.041781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888357d-014a-412b-be45-02b71b458272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:04.119798 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7888357d-014a-412b-be45-02b71b458272 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:04.121058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7888357d-014a-412b-be45-02b71b458272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:04.162482 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:04.218691 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 17:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:04.370130 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc747f81-b1bf-4918-95cc-687a4f6854cf None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:04.371664 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bc747f81-b1bf-4918-95cc-687a4f6854cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:04.641565 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc747f81-b1bf-4918-95cc-687a4f6854cf None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:04.697012 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:04.755692 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd81d1d-2ae0-4f9b-a7d9-f86b5712985e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:04.756589 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd81d1d-2ae0-4f9b-a7d9-f86b5712985e service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:04.756906 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd81d1d-2ae0-4f9b-a7d9-f86b5712985e service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:04.757180 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd81d1d-2ae0-4f9b-a7d9-f86b5712985e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:04.758813 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0dd81d1d-2ae0-4f9b-a7d9-f86b5712985e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:04.848191 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd81d1d-2ae0-4f9b-a7d9-f86b5712985e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:04.850409 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd81d1d-2ae0-4f9b-a7d9-f86b5712985e service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:04.868586 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 722/1437] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:05.723366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877ca3b-ee23-488a-a5ae-bf4e8256ac90 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:05.723940 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877ca3b-ee23-488a-a5ae-bf4e8256ac90 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:05.723940 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877ca3b-ee23-488a-a5ae-bf4e8256ac90 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:05.725841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 17:58:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:58:05.730599 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964735de-beb8-410f-9c51-636c3120ddd9 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:05.731023 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964735de-beb8-410f-9c51-636c3120ddd9 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:05.731152 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964735de-beb8-410f-9c51-636c3120ddd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:05.806454 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-964735de-beb8-410f-9c51-636c3120ddd9 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:05.807680 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-964735de-beb8-410f-9c51-636c3120ddd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:05.809732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:05.912561 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 17:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:06.064119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877ca3b-ee23-488a-a5ae-bf4e8256ac90 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:06.065659 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b877ca3b-ee23-488a-a5ae-bf4e8256ac90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:06.217576 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877ca3b-ee23-488a-a5ae-bf4e8256ac90 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:06.245488 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:06.332160 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a5b8d-cab3-46ba-9170-7975d428b42f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:06.333031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a5b8d-cab3-46ba-9170-7975d428b42f service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:06.333855 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a5b8d-cab3-46ba-9170-7975d428b42f service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:06.334131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a5b8d-cab3-46ba-9170-7975d428b42f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:06.335786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6a9a5b8d-cab3-46ba-9170-7975d428b42f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:06.426161 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a5b8d-cab3-46ba-9170-7975d428b42f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:06.427787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a5b8d-cab3-46ba-9170-7975d428b42f service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:06.446001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 717/1440] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:08.383564 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ebe73-a0a7-4a53-9b11-72a5b49471ef None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:08.384099 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ebe73-a0a7-4a53-9b11-72a5b49471ef None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:08.384099 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ebe73-a0a7-4a53-9b11-72a5b49471ef None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:08.385566 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:58:08.390845 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e1de5-083a-4306-9d60-d0a7c68f57d1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:08.391239 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e1de5-083a-4306-9d60-d0a7c68f57d1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:08.391405 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e1de5-083a-4306-9d60-d0a7c68f57d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:08.431945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:08.457396 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-171e1de5-083a-4306-9d60-d0a7c68f57d1 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:08.458638 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-171e1de5-083a-4306-9d60-d0a7c68f57d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:08.554327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:08.593128 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ebe73-a0a7-4a53-9b11-72a5b49471ef None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:08.594632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3a6ebe73-a0a7-4a53-9b11-72a5b49471ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:08.702953 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ebe73-a0a7-4a53-9b11-72a5b49471ef None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:08.734281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:08.775269 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119d6a1-f799-40a0-9ca5-b8e89bd7d472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:08.775910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119d6a1-f799-40a0-9ca5-b8e89bd7d472 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:08.776162 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119d6a1-f799-40a0-9ca5-b8e89bd7d472 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:08.776429 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119d6a1-f799-40a0-9ca5-b8e89bd7d472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:08.778076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6119d6a1-f799-40a0-9ca5-b8e89bd7d472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:08.890151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119d6a1-f799-40a0-9ca5-b8e89bd7d472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:08.891581 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119d6a1-f799-40a0-9ca5-b8e89bd7d472 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:08.909445 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 725/1443] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:11.116530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3bea3-6355-4f30-8bab-ec6f982ddcd8 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:11.117118 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3bea3-6355-4f30-8bab-ec6f982ddcd8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:11.117118 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3bea3-6355-4f30-8bab-ec6f982ddcd8 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:11.118470 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:58:11.124073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b664ff3-3f00-4b87-bedc-bcf14e8145f6 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:11.124506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b664ff3-3f00-4b87-bedc-bcf14e8145f6 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:11.124654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b664ff3-3f00-4b87-bedc-bcf14e8145f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:11.190203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-1b664ff3-3f00-4b87-bedc-bcf14e8145f6 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:11.191455 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1b664ff3-3f00-4b87-bedc-bcf14e8145f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:11.204456 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:11.288275 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:11.326597 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3bea3-6355-4f30-8bab-ec6f982ddcd8 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:11.328175 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-97c3bea3-6355-4f30-8bab-ec6f982ddcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:11.434692 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3bea3-6355-4f30-8bab-ec6f982ddcd8 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:11.447190 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:11.508125 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb1a91-3672-4d64-8ac5-6224df307f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:11.508739 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb1a91-3672-4d64-8ac5-6224df307f47 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:11.509046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb1a91-3672-4d64-8ac5-6224df307f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:11.509319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb1a91-3672-4d64-8ac5-6224df307f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:11.510944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0ccb1a91-3672-4d64-8ac5-6224df307f47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:11.618949 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb1a91-3672-4d64-8ac5-6224df307f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:11.620397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb1a91-3672-4d64-8ac5-6224df307f47 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:11.638909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 720/1446] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:14.107247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411a186-5a56-484b-b45e-6f0b9d4b88c5 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:14.107760 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411a186-5a56-484b-b45e-6f0b9d4b88c5 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:14.107760 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411a186-5a56-484b-b45e-6f0b9d4b88c5 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:14.109128 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:58:14.114331 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47ee4b-3527-4f83-9c45-44906bf94267 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:14.114716 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47ee4b-3527-4f83-9c45-44906bf94267 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:14.114894 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47ee4b-3527-4f83-9c45-44906bf94267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:14.163706 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:14.181095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9e47ee4b-3527-4f83-9c45-44906bf94267 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:14.182308 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9e47ee4b-3527-4f83-9c45-44906bf94267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:14.277575 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:14.326726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411a186-5a56-484b-b45e-6f0b9d4b88c5 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:14.328315 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6411a186-5a56-484b-b45e-6f0b9d4b88c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:14.432280 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411a186-5a56-484b-b45e-6f0b9d4b88c5 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:14.472785 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:14.505185 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4964371-2adb-403b-a654-14891bfa8ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:14.506409 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4964371-2adb-403b-a654-14891bfa8ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:14.506889 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4964371-2adb-403b-a654-14891bfa8ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:14.507209 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4964371-2adb-403b-a654-14891bfa8ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:14.509163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c4964371-2adb-403b-a654-14891bfa8ef2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:14.616017 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4964371-2adb-403b-a654-14891bfa8ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:14.617476 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4964371-2adb-403b-a654-14891bfa8ef2 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:14.635955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 728/1449] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:16.769518 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4575dba-d854-4fce-a58e-f3740cb21a80 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:16.770085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4575dba-d854-4fce-a58e-f3740cb21a80 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:16.770085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4575dba-d854-4fce-a58e-f3740cb21a80 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:16.771960 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:58:16.777384 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e29e0-f5c0-41c9-9d7c-86e30e2b0949 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:16.777808 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e29e0-f5c0-41c9-9d7c-86e30e2b0949 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:16.777971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e29e0-f5c0-41c9-9d7c-86e30e2b0949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:16.843350 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-9c9e29e0-f5c0-41c9-9d7c-86e30e2b0949 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:16.844578 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9c9e29e0-f5c0-41c9-9d7c-86e30e2b0949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:16.865585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:16.941333 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:16.980949 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4575dba-d854-4fce-a58e-f3740cb21a80 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:16.982472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a4575dba-d854-4fce-a58e-f3740cb21a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:17.085578 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4575dba-d854-4fce-a58e-f3740cb21a80 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:17.120357 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:17.177583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa31a68-4199-4aba-a00b-5dc17140805b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:17.178199 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa31a68-4199-4aba-a00b-5dc17140805b service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:17.178475 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa31a68-4199-4aba-a00b-5dc17140805b service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:17.178741 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa31a68-4199-4aba-a00b-5dc17140805b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:17.180364 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6fa31a68-4199-4aba-a00b-5dc17140805b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:17.289466 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa31a68-4199-4aba-a00b-5dc17140805b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:17.290913 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa31a68-4199-4aba-a00b-5dc17140805b service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:17.309322 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 723/1452] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:58:19.600382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7f503-4cb9-4a5a-988d-ba193f19f6e7 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:19.600952 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7f503-4cb9-4a5a-988d-ba193f19f6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:19.600952 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7f503-4cb9-4a5a-988d-ba193f19f6e7 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:19.602260 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:58:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:58:19.607542 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d8b20-56cd-4a68-ba2f-1edfa07c3ff4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:19.607919 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d8b20-56cd-4a68-ba2f-1edfa07c3ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:19.608108 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d8b20-56cd-4a68-ba2f-1edfa07c3ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:19.672109 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:19.674785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6b0d8b20-56cd-4a68-ba2f-1edfa07c3ff4 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:19.676014 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6b0d8b20-56cd-4a68-ba2f-1edfa07c3ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:19.774020 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:19.812494 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7f503-4cb9-4a5a-988d-ba193f19f6e7 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:19.814056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1be7f503-4cb9-4a5a-988d-ba193f19f6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:19.919797 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7f503-4cb9-4a5a-988d-ba193f19f6e7 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:19.969239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:19.995303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed21e24-68c9-47bb-8678-6d51bec88c30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:19.995921 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed21e24-68c9-47bb-8678-6d51bec88c30 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:19.996202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed21e24-68c9-47bb-8678-6d51bec88c30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:19.996475 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed21e24-68c9-47bb-8678-6d51bec88c30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:19.998484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8ed21e24-68c9-47bb-8678-6d51bec88c30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:20.109085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed21e24-68c9-47bb-8678-6d51bec88c30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:20.110548 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed21e24-68c9-47bb-8678-6d51bec88c30 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:20.128693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 731/1455] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:22.218612 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45c395-96b5-45f9-ae6e-4eed24d0a8b1 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:22.219151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45c395-96b5-45f9-ae6e-4eed24d0a8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:22.219151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45c395-96b5-45f9-ae6e-4eed24d0a8b1 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:22.220520 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:58:22.225911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45d851-81f0-431f-a7dd-6283ca3c490e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:22.226454 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45d851-81f0-431f-a7dd-6283ca3c490e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:22.226454 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45d851-81f0-431f-a7dd-6283ca3c490e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:22.291587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-bc45d851-81f0-431f-a7dd-6283ca3c490e None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:22.292833 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bc45d851-81f0-431f-a7dd-6283ca3c490e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:22.321733 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:22.400878 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:22.439252 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45c395-96b5-45f9-ae6e-4eed24d0a8b1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:22.440822 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1a45c395-96b5-45f9-ae6e-4eed24d0a8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:22.545217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45c395-96b5-45f9-ae6e-4eed24d0a8b1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:22.573518 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:22.618878 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bd8cf-263a-4591-8603-2da21e0c2a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:22.619502 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bd8cf-263a-4591-8603-2da21e0c2a7b service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:22.619787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bd8cf-263a-4591-8603-2da21e0c2a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:22.620095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bd8cf-263a-4591-8603-2da21e0c2a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:22.621770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-147bd8cf-263a-4591-8603-2da21e0c2a7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:22.742128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bd8cf-263a-4591-8603-2da21e0c2a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:22.743587 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bd8cf-263a-4591-8603-2da21e0c2a7b service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:22.766998 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 726/1458] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:25.119759 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b0e69-41d7-4661-af09-75fb675094aa None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:25.120271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b0e69-41d7-4661-af09-75fb675094aa None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:25.120271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b0e69-41d7-4661-af09-75fb675094aa None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:25.121645 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:58:25.127028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6818f0-1f4e-42a4-9440-53a049e7e422 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:25.127463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6818f0-1f4e-42a4-9440-53a049e7e422 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:25.127586 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6818f0-1f4e-42a4-9440-53a049e7e422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:25.195389 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6a6818f0-1f4e-42a4-9440-53a049e7e422 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:25.196624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6a6818f0-1f4e-42a4-9440-53a049e7e422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:25.205286 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:25.310343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:25.348413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b0e69-41d7-4661-af09-75fb675094aa None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:25.350442 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-102b0e69-41d7-4661-af09-75fb675094aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:25.461262 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b0e69-41d7-4661-af09-75fb675094aa None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:25.516688 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:25.534672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259dbd0-881a-4587-b21c-ae1bdbccffbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:25.535298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259dbd0-881a-4587-b21c-ae1bdbccffbc service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:25.536129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259dbd0-881a-4587-b21c-ae1bdbccffbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:25.536406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259dbd0-881a-4587-b21c-ae1bdbccffbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:25.538057 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1259dbd0-881a-4587-b21c-ae1bdbccffbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:25.643854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259dbd0-881a-4587-b21c-ae1bdbccffbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:25.645915 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259dbd0-881a-4587-b21c-ae1bdbccffbc service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:25.665526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 734/1461] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:27.721743 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210e914-8a40-46e1-83f9-531ede49fa55 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:27.722324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210e914-8a40-46e1-83f9-531ede49fa55 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:27.722324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210e914-8a40-46e1-83f9-531ede49fa55 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:27.724603 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:58:27.730136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b12786-4273-4181-b02d-f633e173d26a None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:27.730567 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b12786-4273-4181-b02d-f633e173d26a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:27.730677 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b12786-4273-4181-b02d-f633e173d26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:27.801581 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-42b12786-4273-4181-b02d-f633e173d26a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:27.802842 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-42b12786-4273-4181-b02d-f633e173d26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:27.840646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:27.898497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:27.936464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210e914-8a40-46e1-83f9-531ede49fa55 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:27.938046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c210e914-8a40-46e1-83f9-531ede49fa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:28.041745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210e914-8a40-46e1-83f9-531ede49fa55 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:28.078201 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:28.114577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2870f9-2b6c-47ee-b3ab-b8d53f7b65bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:28.115194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2870f9-2b6c-47ee-b3ab-b8d53f7b65bd service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:28.115468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2870f9-2b6c-47ee-b3ab-b8d53f7b65bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:28.115735 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2870f9-2b6c-47ee-b3ab-b8d53f7b65bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:28.117452 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4e2870f9-2b6c-47ee-b3ab-b8d53f7b65bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:28.225509 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2870f9-2b6c-47ee-b3ab-b8d53f7b65bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:28.226955 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2870f9-2b6c-47ee-b3ab-b8d53f7b65bd service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:28.245708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 729/1464] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:30.260017 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa8abc-213c-4050-99b0-acafee53751b None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:30.260635 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa8abc-213c-4050-99b0-acafee53751b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:30.260635 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa8abc-213c-4050-99b0-acafee53751b None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:30.262083 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:58:30.267216 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f42597-5298-4750-832b-8c6f7afbfc79 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:30.267673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f42597-5298-4750-832b-8c6f7afbfc79 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:30.267809 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f42597-5298-4750-832b-8c6f7afbfc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:30.333967 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-13f42597-5298-4750-832b-8c6f7afbfc79 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:30.335204 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-13f42597-5298-4750-832b-8c6f7afbfc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:30.355651 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:30.436223 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:30.473129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa8abc-213c-4050-99b0-acafee53751b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:30.474732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-82fa8abc-213c-4050-99b0-acafee53751b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:30.576900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa8abc-213c-4050-99b0-acafee53751b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:30.643367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:30.650007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64084af-ff6a-424f-b34d-52e10da9bd03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:30.650636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64084af-ff6a-424f-b34d-52e10da9bd03 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:30.650923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64084af-ff6a-424f-b34d-52e10da9bd03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:30.651204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64084af-ff6a-424f-b34d-52e10da9bd03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:30.653002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e64084af-ff6a-424f-b34d-52e10da9bd03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:30.762444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64084af-ff6a-424f-b34d-52e10da9bd03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:30.763954 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64084af-ff6a-424f-b34d-52e10da9bd03 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:30.782708 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 737/1467] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:32.809351 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de9ce0-d594-4f41-91c5-c093ace40868 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:32.809949 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de9ce0-d594-4f41-91c5-c093ace40868 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:32.809949 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de9ce0-d594-4f41-91c5-c093ace40868 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:32.811254 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:58:32.817031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb07598-9483-4cb2-a192-3b783124098c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:32.817031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb07598-9483-4cb2-a192-3b783124098c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:32.818198 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb07598-9483-4cb2-a192-3b783124098c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:32.884558 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-1eb07598-9483-4cb2-a192-3b783124098c None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:32.885843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1eb07598-9483-4cb2-a192-3b783124098c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:32.934755 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:32.981062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:33.017964 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de9ce0-d594-4f41-91c5-c093ace40868 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:33.019526 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-73de9ce0-d594-4f41-91c5-c093ace40868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:33.122126 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de9ce0-d594-4f41-91c5-c093ace40868 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:33.170267 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:33.196431 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dac10e-1263-4ddc-9832-0f289170717c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:33.197082 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dac10e-1263-4ddc-9832-0f289170717c service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:33.197363 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dac10e-1263-4ddc-9832-0f289170717c service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:33.197635 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dac10e-1263-4ddc-9832-0f289170717c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:33.199267 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-94dac10e-1263-4ddc-9832-0f289170717c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:33.307806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dac10e-1263-4ddc-9832-0f289170717c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:33.309286 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dac10e-1263-4ddc-9832-0f289170717c service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:33.329873 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 732/1470] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:42.997354 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=22 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:43.327418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=66 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:53.044473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a0dbb-82c0-4bba-a432-6a15564631e5 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:53.045079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a0dbb-82c0-4bba-a432-6a15564631e5 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:53.045079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a0dbb-82c0-4bba-a432-6a15564631e5 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:53.046405 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 739/1471] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:58:53.051647 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8fe85-f170-44f5-a559-f8450cb3309f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:53.055402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8fe85-f170-44f5-a559-f8450cb3309f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:53.055402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8fe85-f170-44f5-a559-f8450cb3309f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:53.131802 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e5c8fe85-f170-44f5-a559-f8450cb3309f None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:53.133052 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e5c8fe85-f170-44f5-a559-f8450cb3309f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:53.230820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 733/1472] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:53.315733 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57d627-bd07-4f1c-983d-d69f5119619a None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:53.316015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57d627-bd07-4f1c-983d-d69f5119619a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:53.316290 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57d627-bd07-4f1c-983d-d69f5119619a None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:53.317683 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 740/1473] 10.222.0.75 () {54 vars in 966 bytes} [Thu Jul 28 17:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:58:53.322534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8996c-444a-473c-b89a-de5b94894407 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:53.322828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8996c-444a-473c-b89a-de5b94894407 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:53.323110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8996c-444a-473c-b89a-de5b94894407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:53.398838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-91a8996c-444a-473c-b89a-de5b94894407 None None] MFA Rules not processed for user `1837a832a0da4d698984ce62057b81f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:53.400058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-91a8996c-444a-473c-b89a-de5b94894407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:53.421233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:53.484002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 734/1474] 10.222.0.75 () {58 vars in 1063 bytes} [Thu Jul 28 17:58:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:53.492401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57d627-bd07-4f1c-983d-d69f5119619a None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:53.493982 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9d57d627-bd07-4f1c-983d-d69f5119619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:53.599964 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57d627-bd07-4f1c-983d-d69f5119619a None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:53.672593 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f75f82-7e0f-47bb-9e37-e94598f48b4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1837a832a0da4d698984ce62057b81f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:53.673241 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f75f82-7e0f-47bb-9e37-e94598f48b4f service glance] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:53.673521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f75f82-7e0f-47bb-9e37-e94598f48b4f service glance] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:53.673795 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f75f82-7e0f-47bb-9e37-e94598f48b4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:53.675941 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-83f75f82-7e0f-47bb-9e37-e94598f48b4f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:53.735354 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:53.791955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f75f82-7e0f-47bb-9e37-e94598f48b4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:53.793449 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f75f82-7e0f-47bb-9e37-e94598f48b4f service glance] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:53.812363 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 741/1475] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:55.914849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5942b-1fd7-4fe8-82d0-e511fed92e16 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:55.915370 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5942b-1fd7-4fe8-82d0-e511fed92e16 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:55.915489 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5942b-1fd7-4fe8-82d0-e511fed92e16 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:55.916919 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 735/1476] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:58:55.922045 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a12f8-d22b-4921-8cfd-f0b561f69671 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:55.922473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a12f8-d22b-4921-8cfd-f0b561f69671 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:55.922587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a12f8-d22b-4921-8cfd-f0b561f69671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:55.988140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e54a12f8-d22b-4921-8cfd-f0b561f69671 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:55.989442 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e54a12f8-d22b-4921-8cfd-f0b561f69671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:56.089444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 742/1477] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:58:56.116527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5942b-1fd7-4fe8-82d0-e511fed92e16 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:56.118203 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9fb5942b-1fd7-4fe8-82d0-e511fed92e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:56.245930 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5942b-1fd7-4fe8-82d0-e511fed92e16 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:56.295759 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:56.341488 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d168dfc-62c5-4569-8614-1a34bd005750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:56.342184 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d168dfc-62c5-4569-8614-1a34bd005750 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:56.342468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d168dfc-62c5-4569-8614-1a34bd005750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:56.342743 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d168dfc-62c5-4569-8614-1a34bd005750 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:56.343483 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d168dfc-62c5-4569-8614-1a34bd005750 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:56.345255 dv-cinder-837543-7-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-7d168dfc-62c5-4569-8614-1a34bd005750 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:58:56.345255 dv-cinder-837543-7-smb devstack@keystone.service[80420]: warnings.warn(msg) Jul 28 17:58:56.345255 dv-cinder-837543-7-smb devstack@keystone.service[80420]: Jul 28 17:58:56.346483 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d168dfc-62c5-4569-8614-1a34bd005750 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:56.366150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 736/1478] 10.222.0.75 () {56 vars in 1108 bytes} [Thu Jul 28 17:58:56 2022] GET /identity/v3/projects => generated 2553 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:58:58.380180 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179317ba-4075-435d-8dfd-74582c96fd65 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:58.380656 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179317ba-4075-435d-8dfd-74582c96fd65 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:58.380777 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179317ba-4075-435d-8dfd-74582c96fd65 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:58.382204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 743/1479] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:58:58.387279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30920e-494b-403d-aebf-5f7ee48357e2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:58.387774 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30920e-494b-403d-aebf-5f7ee48357e2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:58.387868 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30920e-494b-403d-aebf-5f7ee48357e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:58.456254 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3b30920e-494b-403d-aebf-5f7ee48357e2 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:58.457583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3b30920e-494b-403d-aebf-5f7ee48357e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:58.564116 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 737/1480] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:58.607905 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179317ba-4075-435d-8dfd-74582c96fd65 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:58.609474 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-179317ba-4075-435d-8dfd-74582c96fd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:58.620032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:58.755333 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179317ba-4075-435d-8dfd-74582c96fd65 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:58.844545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:58.878029 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed62f1d-62eb-43ce-8a75-127377db64b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:58.878685 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed62f1d-62eb-43ce-8a75-127377db64b6 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:58.879236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed62f1d-62eb-43ce-8a75-127377db64b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:58.879715 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed62f1d-62eb-43ce-8a75-127377db64b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:58.881904 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1ed62f1d-62eb-43ce-8a75-127377db64b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:58.968807 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed62f1d-62eb-43ce-8a75-127377db64b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:58.970542 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed62f1d-62eb-43ce-8a75-127377db64b6 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:58.989616 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 744/1481] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:59:01.200353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7a092-737f-440a-a934-709783763dcf None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:01.201011 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7a092-737f-440a-a934-709783763dcf None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:01.201394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7a092-737f-440a-a934-709783763dcf None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:01.203851 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 738/1482] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:59:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:59:01.210885 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eea3a3-6c13-4308-a91c-f6c02fe2d09c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:01.211404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eea3a3-6c13-4308-a91c-f6c02fe2d09c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:01.211505 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eea3a3-6c13-4308-a91c-f6c02fe2d09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:01.277079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-12eea3a3-6c13-4308-a91c-f6c02fe2d09c None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:59:01.278280 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-12eea3a3-6c13-4308-a91c-f6c02fe2d09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:01.327389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:01.379833 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 745/1483] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:59:01.416735 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7a092-737f-440a-a934-709783763dcf None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:59:01.418361 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-34c7a092-737f-440a-a934-709783763dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:01.442165 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:01.521654 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7a092-737f-440a-a934-709783763dcf None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:59:01.594612 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04815ff9-3fd5-4eb8-a999-95bb8df3e2ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:59:01.595150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04815ff9-3fd5-4eb8-a999-95bb8df3e2ba service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:01.595428 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04815ff9-3fd5-4eb8-a999-95bb8df3e2ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:01.595701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04815ff9-3fd5-4eb8-a999-95bb8df3e2ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:01.598029 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-04815ff9-3fd5-4eb8-a999-95bb8df3e2ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:01.671552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:01.706406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04815ff9-3fd5-4eb8-a999-95bb8df3e2ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:59:01.710543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04815ff9-3fd5-4eb8-a999-95bb8df3e2ba service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:59:01.731527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 739/1484] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:59:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:59:03.796604 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de41d9-6f7c-4c0b-8507-d3963f4a764f None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:03.797204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de41d9-6f7c-4c0b-8507-d3963f4a764f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:03.797204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de41d9-6f7c-4c0b-8507-d3963f4a764f None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:03.798567 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 746/1485] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:59:03.804414 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d0e9e-b3ec-412f-a989-b377aa62d747 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:03.804884 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d0e9e-b3ec-412f-a989-b377aa62d747 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:03.805017 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d0e9e-b3ec-412f-a989-b377aa62d747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:03.871055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0b1d0e9e-b3ec-412f-a989-b377aa62d747 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:59:03.872252 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0b1d0e9e-b3ec-412f-a989-b377aa62d747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:03.970622 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 740/1486] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:59:04.010926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de41d9-6f7c-4c0b-8507-d3963f4a764f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:59:04.012460 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-59de41d9-6f7c-4c0b-8507-d3963f4a764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:04.114111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de41d9-6f7c-4c0b-8507-d3963f4a764f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:59:04.188639 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:04.190946 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4aee4-107f-4abb-b36a-62af4baf9be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:59:04.194019 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4aee4-107f-4abb-b36a-62af4baf9be3 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:04.194019 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4aee4-107f-4abb-b36a-62af4baf9be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:04.194019 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4aee4-107f-4abb-b36a-62af4baf9be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:04.194019 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a6f4aee4-107f-4abb-b36a-62af4baf9be3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:04.302285 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4aee4-107f-4abb-b36a-62af4baf9be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:59:04.303750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4aee4-107f-4abb-b36a-62af4baf9be3 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:59:04.324183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 747/1487] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:59:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:59:06.647771 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1894c-2c75-4c9a-bc19-f6c159933001 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:06.648286 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1894c-2c75-4c9a-bc19-f6c159933001 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:06.648286 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1894c-2c75-4c9a-bc19-f6c159933001 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:06.649812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 741/1488] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:59:06.655267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0088f-ac37-47bc-9871-68d7b2c90b76 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:06.655665 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0088f-ac37-47bc-9871-68d7b2c90b76 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:06.655857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0088f-ac37-47bc-9871-68d7b2c90b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:06.723261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-acc0088f-ac37-47bc-9871-68d7b2c90b76 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:59:06.724494 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-acc0088f-ac37-47bc-9871-68d7b2c90b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:06.781530 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:06.827580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 748/1489] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:59:06.874837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1894c-2c75-4c9a-bc19-f6c159933001 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:59:06.878006 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-47c1894c-2c75-4c9a-bc19-f6c159933001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:06.917926 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:06.999160 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1894c-2c75-4c9a-bc19-f6c159933001 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:59:07.094985 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576b3f3-b4ed-4e97-95f5-7871b8b81a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:59:07.095639 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576b3f3-b4ed-4e97-95f5-7871b8b81a37 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:07.095923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576b3f3-b4ed-4e97-95f5-7871b8b81a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:07.096199 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576b3f3-b4ed-4e97-95f5-7871b8b81a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:07.097940 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1576b3f3-b4ed-4e97-95f5-7871b8b81a37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:07.194481 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:07.224978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576b3f3-b4ed-4e97-95f5-7871b8b81a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:59:07.226575 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576b3f3-b4ed-4e97-95f5-7871b8b81a37 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:59:07.246519 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 742/1490] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:59:09.890185 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651bdc5-57ea-4950-958f-6e8e04618807 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:09.890888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651bdc5-57ea-4950-958f-6e8e04618807 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:09.890888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651bdc5-57ea-4950-958f-6e8e04618807 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:09.892145 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 749/1491] 10.222.0.75 () {54 vars in 926 bytes} [Thu Jul 28 17:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:59:09.900639 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8813a9-d3dc-4ae6-879c-2c7e27aee2e4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:09.901452 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8813a9-d3dc-4ae6-879c-2c7e27aee2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:09.901921 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8813a9-d3dc-4ae6-879c-2c7e27aee2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:09.994892 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0d8813a9-d3dc-4ae6-879c-2c7e27aee2e4 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:59:09.996202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0d8813a9-d3dc-4ae6-879c-2c7e27aee2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:10.112490 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 743/1492] 10.222.0.75 () {58 vars in 1023 bytes} [Thu Jul 28 17:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:59:10.157757 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651bdc5-57ea-4950-958f-6e8e04618807 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:59:10.159350 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6651bdc5-57ea-4950-958f-6e8e04618807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:10.267339 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651bdc5-57ea-4950-958f-6e8e04618807 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:59:10.349252 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63c641-8094-476f-893d-af46f55a52e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:59:10.349890 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63c641-8094-476f-893d-af46f55a52e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:10.350171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63c641-8094-476f-893d-af46f55a52e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:10.350445 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63c641-8094-476f-893d-af46f55a52e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:10.352093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ac63c641-8094-476f-893d-af46f55a52e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:10.362473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:10.474083 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63c641-8094-476f-893d-af46f55a52e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:59:10.475550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63c641-8094-476f-893d-af46f55a52e7 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:59:10.501826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 750/1493] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 17:59:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:59:20.109966 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=82 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:20.495417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=50 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:50.632531 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89084467-5ccd-4169-9eb6-23da4e7f46b6 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:50.633134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89084467-5ccd-4169-9eb6-23da4e7f46b6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:50.633134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89084467-5ccd-4169-9eb6-23da4e7f46b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:50.719317 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-89084467-5ccd-4169-9eb6-23da4e7f46b6 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:50.720599 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-89084467-5ccd-4169-9eb6-23da4e7f46b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:50.816846 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 744/1494] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:50.825273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19656338-4b07-470a-b55d-14d132acb608 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:50.825784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19656338-4b07-470a-b55d-14d132acb608 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:50.825888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19656338-4b07-470a-b55d-14d132acb608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:50.901030 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-19656338-4b07-470a-b55d-14d132acb608 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:50.902153 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-19656338-4b07-470a-b55d-14d132acb608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:50.996335 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 751/1495] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:51.001863 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89084467-5ccd-4169-9eb6-23da4e7f46b6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:51.003135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-89084467-5ccd-4169-9eb6-23da4e7f46b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:51.015458 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89084467-5ccd-4169-9eb6-23da4e7f46b6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:51.082111 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:51.115981 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30680f14-23cd-440a-bc9d-0fa7b69d925b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:51.116592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30680f14-23cd-440a-bc9d-0fa7b69d925b admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:51.116909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30680f14-23cd-440a-bc9d-0fa7b69d925b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:51.117179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30680f14-23cd-440a-bc9d-0fa7b69d925b admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:51.117895 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30680f14-23cd-440a-bc9d-0fa7b69d925b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:00:51.118198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30680f14-23cd-440a-bc9d-0fa7b69d925b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:51.119229 dv-cinder-837543-7-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-30680f14-23cd-440a-bc9d-0fa7b69d925b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:00:51.119229 dv-cinder-837543-7-smb devstack@keystone.service[80420]: warnings.warn(msg) Jul 28 18:00:51.119229 dv-cinder-837543-7-smb devstack@keystone.service[80420]: Jul 28 18:00:51.120110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30680f14-23cd-440a-bc9d-0fa7b69d925b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:51.131830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 745/1496] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:00:51.140829 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19656338-4b07-470a-b55d-14d132acb608 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:51.150031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19656338-4b07-470a-b55d-14d132acb608 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:51.211497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:51.244487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704dd7e7-2a58-4a4e-ad3a-76fa0f5b02fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:51.245152 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dd7e7-2a58-4a4e-ad3a-76fa0f5b02fb admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:51.245436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dd7e7-2a58-4a4e-ad3a-76fa0f5b02fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:51.245715 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dd7e7-2a58-4a4e-ad3a-76fa0f5b02fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:51.246376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704dd7e7-2a58-4a4e-ad3a-76fa0f5b02fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:51.248125 dv-cinder-837543-7-smb devstack@keystone.service[80421]: WARNING py.warnings [None req-704dd7e7-2a58-4a4e-ad3a-76fa0f5b02fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:00:51.248125 dv-cinder-837543-7-smb devstack@keystone.service[80421]: warnings.warn(msg) Jul 28 18:00:51.248125 dv-cinder-837543-7-smb devstack@keystone.service[80421]: Jul 28 18:00:51.250159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704dd7e7-2a58-4a4e-ad3a-76fa0f5b02fb admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:51.380056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 752/1497] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:00:51 2022] POST /identity/v3/projects => generated 377 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:00:51.384198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30680f14-23cd-440a-bc9d-0fa7b69d925b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:51.385804 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-30680f14-23cd-440a-bc9d-0fa7b69d925b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:51.419618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30680f14-23cd-440a-bc9d-0fa7b69d925b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:51.515214 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210cecb-ea0e-49a3-acdb-17969d9f4481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:51.515751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210cecb-ea0e-49a3-acdb-17969d9f4481 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:51.516034 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210cecb-ea0e-49a3-acdb-17969d9f4481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:51.516307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210cecb-ea0e-49a3-acdb-17969d9f4481 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:51.517006 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210cecb-ea0e-49a3-acdb-17969d9f4481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:51.518011 dv-cinder-837543-7-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-d210cecb-ea0e-49a3-acdb-17969d9f4481 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:00:51.518011 dv-cinder-837543-7-smb devstack@keystone.service[80420]: warnings.warn(msg) Jul 28 18:00:51.518011 dv-cinder-837543-7-smb devstack@keystone.service[80420]: Jul 28 18:00:51.519224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210cecb-ea0e-49a3-acdb-17969d9f4481 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:51.621183 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 746/1498] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:00:51 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:00:51.626383 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704dd7e7-2a58-4a4e-ad3a-76fa0f5b02fb admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:51.627995 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-704dd7e7-2a58-4a4e-ad3a-76fa0f5b02fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:51.690512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704dd7e7-2a58-4a4e-ad3a-76fa0f5b02fb admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:51.772767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:51.783544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17882e2f-41aa-46ec-a848-ca1bc83235b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:51.784326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17882e2f-41aa-46ec-a848-ca1bc83235b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:51.784618 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17882e2f-41aa-46ec-a848-ca1bc83235b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:51.784957 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17882e2f-41aa-46ec-a848-ca1bc83235b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:51.785652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17882e2f-41aa-46ec-a848-ca1bc83235b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:51.786690 dv-cinder-837543-7-smb devstack@keystone.service[80421]: WARNING py.warnings [None req-17882e2f-41aa-46ec-a848-ca1bc83235b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:00:51.786690 dv-cinder-837543-7-smb devstack@keystone.service[80421]: warnings.warn(msg) Jul 28 18:00:51.786690 dv-cinder-837543-7-smb devstack@keystone.service[80421]: Jul 28 18:00:51.787576 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17882e2f-41aa-46ec-a848-ca1bc83235b7 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:51.800769 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 753/1499] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:00:51.804890 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210cecb-ea0e-49a3-acdb-17969d9f4481 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:51.807900 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d210cecb-ea0e-49a3-acdb-17969d9f4481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:51.818785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210cecb-ea0e-49a3-acdb-17969d9f4481 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:51.846065 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:51.918156 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087bcec-326b-45a7-bbe3-365cdca1b871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:51.918782 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087bcec-326b-45a7-bbe3-365cdca1b871 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:51.919067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087bcec-326b-45a7-bbe3-365cdca1b871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:51.919339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087bcec-326b-45a7-bbe3-365cdca1b871 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:51.920067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087bcec-326b-45a7-bbe3-365cdca1b871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:51.921701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-c087bcec-326b-45a7-bbe3-365cdca1b871 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:00:51.921701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: warnings.warn(msg) Jul 28 18:00:51.921701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: Jul 28 18:00:51.925356 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087bcec-326b-45a7-bbe3-365cdca1b871 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:51.935072 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 747/1500] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:00:51.939311 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17882e2f-41aa-46ec-a848-ca1bc83235b7 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:51.940897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-17882e2f-41aa-46ec-a848-ca1bc83235b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:51.974659 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17882e2f-41aa-46ec-a848-ca1bc83235b7 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:52.072421 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4512aa8-c934-4130-93a2-86c8fadc37f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:52.073060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4512aa8-c934-4130-93a2-86c8fadc37f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:52.073343 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4512aa8-c934-4130-93a2-86c8fadc37f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:52.073619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4512aa8-c934-4130-93a2-86c8fadc37f1 admin admin] PATH_INFO: `/v3/projects/1345963c46d14444b64bdace9ba89c6a/users/3b5701dfa4974668bfaade1ce79e20cf/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:52.095895 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4512aa8-c934-4130-93a2-86c8fadc37f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1345963c46d14444b64bdace9ba89c6a, user_id=3b5701dfa4974668bfaade1ce79e20cf, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:52.097078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: WARNING py.warnings [None req-f4512aa8-c934-4130-93a2-86c8fadc37f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:00:52.097078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: warnings.warn(msg) Jul 28 18:00:52.097078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: Jul 28 18:00:52.099041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4512aa8-c934-4130-93a2-86c8fadc37f1 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:52.207645 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 754/1501] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:00:51 2022] PUT /identity/v3/projects/1345963c46d14444b64bdace9ba89c6a/users/3b5701dfa4974668bfaade1ce79e20cf/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:00:52.220450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5007f-75dd-4124-9ac5-cb8bbb947d53 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:52.220736 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5007f-75dd-4124-9ac5-cb8bbb947d53 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:52.221047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5007f-75dd-4124-9ac5-cb8bbb947d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:52.276875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-56f5007f-75dd-4124-9ac5-cb8bbb947d53 None None] MFA Rules not processed for user `3b5701dfa4974668bfaade1ce79e20cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:52.278082 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-56f5007f-75dd-4124-9ac5-cb8bbb947d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:52.356042 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 748/1502] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:00:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:52.369017 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da120375-09ee-4233-a135-906371d87471 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:52.369313 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da120375-09ee-4233-a135-906371d87471 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:52.369597 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da120375-09ee-4233-a135-906371d87471 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:52.370967 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 755/1503] 10.222.0.75 () {54 vars in 964 bytes} [Thu Jul 28 18:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:52.376007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6608a88-7e8a-4009-b2b2-ec3528a0d5a1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:52.376318 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6608a88-7e8a-4009-b2b2-ec3528a0d5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:52.376590 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6608a88-7e8a-4009-b2b2-ec3528a0d5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:52.408168 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:52.451190 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f6608a88-7e8a-4009-b2b2-ec3528a0d5a1 None None] MFA Rules not processed for user `be78ea573a674611807171c76f8003ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:52.453026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f6608a88-7e8a-4009-b2b2-ec3528a0d5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:52.526707 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 749/1504] 10.222.0.75 () {58 vars in 1061 bytes} [Thu Jul 28 18:00:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:52.535223 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da120375-09ee-4233-a135-906371d87471 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:52.536718 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-da120375-09ee-4233-a135-906371d87471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:52.586146 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:52.641782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da120375-09ee-4233-a135-906371d87471 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:52.729065 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5db23-219c-4326-9d02-00714b6b8c33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:52.729693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5db23-219c-4326-9d02-00714b6b8c33 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:52.729971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5db23-219c-4326-9d02-00714b6b8c33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:52.730249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5db23-219c-4326-9d02-00714b6b8c33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:52.731881 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-36f5db23-219c-4326-9d02-00714b6b8c33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:52.830234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5db23-219c-4326-9d02-00714b6b8c33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:52.832367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5db23-219c-4326-9d02-00714b6b8c33 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:52.835914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:52.849834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 756/1505] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:52.895462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc73d4-6b17-4222-84da-d3fad711e3e4 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:52.895883 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc73d4-6b17-4222-84da-d3fad711e3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:52.895977 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc73d4-6b17-4222-84da-d3fad711e3e4 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:52.897278 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 750/1506] 10.222.0.75 () {52 vars in 830 bytes} [Thu Jul 28 18:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:52.901123 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5db23-219c-4326-9d02-00714b6b8c33 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:52.902331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-36f5db23-219c-4326-9d02-00714b6b8c33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:52.999507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5db23-219c-4326-9d02-00714b6b8c33 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:53.092548 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0746e-b899-4f72-a0a7-a28a0c582540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:53.093222 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0746e-b899-4f72-a0a7-a28a0c582540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:53.093503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0746e-b899-4f72-a0a7-a28a0c582540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:53.093775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0746e-b899-4f72-a0a7-a28a0c582540 admin admin] PATH_INFO: `/v3/users/3b5701dfa4974668bfaade1ce79e20cf` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:53.105851 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0746e-b899-4f72-a0a7-a28a0c582540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b5701dfa4974668bfaade1ce79e20cf)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:53.106894 dv-cinder-837543-7-smb devstack@keystone.service[80421]: WARNING py.warnings [None req-e4f0746e-b899-4f72-a0a7-a28a0c582540 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:00:53.106894 dv-cinder-837543-7-smb devstack@keystone.service[80421]: warnings.warn(msg) Jul 28 18:00:53.106894 dv-cinder-837543-7-smb devstack@keystone.service[80421]: Jul 28 18:00:53.108666 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0746e-b899-4f72-a0a7-a28a0c582540 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:53.118492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:53.479006 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e4f0746e-b899-4f72-a0a7-a28a0c582540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b5701dfa4974668bfaade1ce79e20cf'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:00:53.534705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e4f0746e-b899-4f72-a0a7-a28a0c582540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b5701dfa4974668bfaade1ce79e20cf'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:00:53.553117 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e4f0746e-b899-4f72-a0a7-a28a0c582540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b5701dfa4974668bfaade1ce79e20cf'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:00:53.566825 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e4f0746e-b899-4f72-a0a7-a28a0c582540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b5701dfa4974668bfaade1ce79e20cf'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:00:53.573679 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e4f0746e-b899-4f72-a0a7-a28a0c582540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b5701dfa4974668bfaade1ce79e20cf'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:00:53.573679 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 757/1507] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:00:52 2022] DELETE /identity/v3/users/3b5701dfa4974668bfaade1ce79e20cf => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:00:53.577504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0abb8-18d3-4b6d-937a-a1bc49fa487d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:53.577802 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0abb8-18d3-4b6d-937a-a1bc49fa487d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:53.578105 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0abb8-18d3-4b6d-937a-a1bc49fa487d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:53.635474 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-08f0abb8-18d3-4b6d-937a-a1bc49fa487d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:53.636639 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-08f0abb8-18d3-4b6d-937a-a1bc49fa487d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:53.715101 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:53.727394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 751/1508] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:53.737745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0746e-b899-4f72-a0a7-a28a0c582540 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:53.739849 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e4f0746e-b899-4f72-a0a7-a28a0c582540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:53.838033 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0746e-b899-4f72-a0a7-a28a0c582540 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:53.893452 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:53.915001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05c82e-cbd7-490b-812a-0876625980e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:53.915766 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05c82e-cbd7-490b-812a-0876625980e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:53.917322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05c82e-cbd7-490b-812a-0876625980e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:53.917322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05c82e-cbd7-490b-812a-0876625980e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:53.918097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2c05c82e-cbd7-490b-812a-0876625980e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:54.032685 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05c82e-cbd7-490b-812a-0876625980e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:54.034182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05c82e-cbd7-490b-812a-0876625980e1 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:54.053887 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 758/1509] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:54.537638 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0abb8-18d3-4b6d-937a-a1bc49fa487d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:54.541201 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-08f0abb8-18d3-4b6d-937a-a1bc49fa487d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:54.550500 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0abb8-18d3-4b6d-937a-a1bc49fa487d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:54.650242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369bc37-f793-4eea-af69-eec02251d768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:54.650913 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369bc37-f793-4eea-af69-eec02251d768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:54.651193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369bc37-f793-4eea-af69-eec02251d768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:54.651464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369bc37-f793-4eea-af69-eec02251d768 admin admin] PATH_INFO: `/v3/projects/1345963c46d14444b64bdace9ba89c6a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:54.662146 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369bc37-f793-4eea-af69-eec02251d768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1345963c46d14444b64bdace9ba89c6a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:54.663203 dv-cinder-837543-7-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-7369bc37-f793-4eea-af69-eec02251d768 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:00:54.663203 dv-cinder-837543-7-smb devstack@keystone.service[80420]: warnings.warn(msg) Jul 28 18:00:54.663203 dv-cinder-837543-7-smb devstack@keystone.service[80420]: Jul 28 18:00:54.664406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369bc37-f793-4eea-af69-eec02251d768 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:54.807497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7369bc37-f793-4eea-af69-eec02251d768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1345963c46d14444b64bdace9ba89c6a', 'request_id': 'req-7369bc37-f793-4eea-af69-eec02251d768'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:00:54.814145 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7369bc37-f793-4eea-af69-eec02251d768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1345963c46d14444b64bdace9ba89c6a', 'request_id': 'req-7369bc37-f793-4eea-af69-eec02251d768'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:00:54.828286 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7369bc37-f793-4eea-af69-eec02251d768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1345963c46d14444b64bdace9ba89c6a', 'request_id': 'req-7369bc37-f793-4eea-af69-eec02251d768'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:00:54.912271 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7369bc37-f793-4eea-af69-eec02251d768 admin admin] The token cache is being invalidate because project 1345963c46d14444b64bdace9ba89c6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:00:54.912578 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7369bc37-f793-4eea-af69-eec02251d768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:00:54.913114 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7369bc37-f793-4eea-af69-eec02251d768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:00:54.914470 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 752/1510] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:00:54 2022] DELETE /identity/v3/projects/1345963c46d14444b64bdace9ba89c6a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:04.051582 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=62 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:04.910235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:54.751502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b2d6b-475c-4f42-8e72-aededbbb06ee None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:54.752009 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b2d6b-475c-4f42-8e72-aededbbb06ee None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:54.752120 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b2d6b-475c-4f42-8e72-aededbbb06ee None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:54.753495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 18:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:02:54.758456 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0746a0-a375-4870-84e2-0e56057babae None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:54.758902 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0746a0-a375-4870-84e2-0e56057babae None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:54.759036 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0746a0-a375-4870-84e2-0e56057babae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:54.840347 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6f0746a0-a375-4870-84e2-0e56057babae None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:54.841597 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6f0746a0-a375-4870-84e2-0e56057babae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:54.949482 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 18:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:55.099775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b2d6b-475c-4f42-8e72-aededbbb06ee None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:55.104375 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f09b2d6b-475c-4f42-8e72-aededbbb06ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:55.221145 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b2d6b-475c-4f42-8e72-aededbbb06ee None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:55.226597 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b02eda-a2ed-4593-b316-786b4d797125 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:55.227217 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b02eda-a2ed-4593-b316-786b4d797125 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:55.227502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b02eda-a2ed-4593-b316-786b4d797125 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:55.227779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b02eda-a2ed-4593-b316-786b4d797125 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:55.236505 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b02eda-a2ed-4593-b316-786b4d797125 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:55.238152 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b02eda-a2ed-4593-b316-786b4d797125 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:55.248419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 760/1513] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:56.069472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb537e9-d698-44e7-b350-5c98c8fe3e3a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:56.070053 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb537e9-d698-44e7-b350-5c98c8fe3e3a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:56.070053 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb537e9-d698-44e7-b350-5c98c8fe3e3a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:56.071430 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 18:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:02:56.077380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282d46c-179a-48b2-a349-abf8d9646923 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:56.078599 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282d46c-179a-48b2-a349-abf8d9646923 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:56.078894 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282d46c-179a-48b2-a349-abf8d9646923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:56.099574 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-5282d46c-179a-48b2-a349-abf8d9646923 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:56.100826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5282d46c-179a-48b2-a349-abf8d9646923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:56.108764 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 18:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:56.258727 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb537e9-d698-44e7-b350-5c98c8fe3e3a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:56.273621 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb537e9-d698-44e7-b350-5c98c8fe3e3a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:56.279101 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca92713-99b6-4753-be3e-a09574e2c0da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:56.279715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca92713-99b6-4753-be3e-a09574e2c0da service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:56.280000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca92713-99b6-4753-be3e-a09574e2c0da service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:56.280281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca92713-99b6-4753-be3e-a09574e2c0da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:56.288424 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca92713-99b6-4753-be3e-a09574e2c0da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:56.290127 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca92713-99b6-4753-be3e-a09574e2c0da service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:56.299507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 755/1516] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:59.079397 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ce190-e19e-4754-9b72-1127bed08b41 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:59.079983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ce190-e19e-4754-9b72-1127bed08b41 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:59.079983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ce190-e19e-4754-9b72-1127bed08b41 None None] PATH_INFO: `/v3` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:59.081290 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 762/1517] 10.222.0.77 () {54 vars in 925 bytes} [Thu Jul 28 18:02:59 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:02:59.088695 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff217d8a-acb8-4c28-838c-531ca1059a84 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:59.089184 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff217d8a-acb8-4c28-838c-531ca1059a84 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:59.089359 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff217d8a-acb8-4c28-838c-531ca1059a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:59.151474 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ff217d8a-acb8-4c28-838c-531ca1059a84 None None] MFA Rules not processed for user `cff43a72eaef462f86426ad3ceccd3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:59.152684 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ff217d8a-acb8-4c28-838c-531ca1059a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:59.169821 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:59.224471 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 756/1518] 10.222.0.77 () {58 vars in 1015 bytes} [Thu Jul 28 18:02:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:03:06.094425 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=56 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:03:07.533957 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988c78c-688c-42b5-9077-08430dc7a339 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:07.534987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988c78c-688c-42b5-9077-08430dc7a339 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:07.534987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988c78c-688c-42b5-9077-08430dc7a339 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:07.536399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 763/1519] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 18:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:03:07.541515 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c59f09-ea43-430b-aff1-e806174599c2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:07.541952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c59f09-ea43-430b-aff1-e806174599c2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:07.542090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c59f09-ea43-430b-aff1-e806174599c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:07.561987 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a1c59f09-ea43-430b-aff1-e806174599c2 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:03:07.563196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a1c59f09-ea43-430b-aff1-e806174599c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:03:07.571319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 757/1520] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 18:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:03:07.726080 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988c78c-688c-42b5-9077-08430dc7a339 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:03:07.740045 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988c78c-688c-42b5-9077-08430dc7a339 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:03:07.746326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6a2cf-24a7-400d-a761-002b532b0157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:03:07.746936 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6a2cf-24a7-400d-a761-002b532b0157 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:07.747218 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6a2cf-24a7-400d-a761-002b532b0157 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:07.747490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6a2cf-24a7-400d-a761-002b532b0157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:07.755694 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6a2cf-24a7-400d-a761-002b532b0157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:03:07.757336 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6a2cf-24a7-400d-a761-002b532b0157 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:03:07.767425 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 764/1521] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:03:08.583804 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccd2ba-f50f-4690-bf7c-917c42d7c5b5 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:08.584366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccd2ba-f50f-4690-bf7c-917c42d7c5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:08.584366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccd2ba-f50f-4690-bf7c-917c42d7c5b5 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:08.585766 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 18:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:03:08.591206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab290b55-1f95-4235-811b-538cc853d4ed None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:08.591614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab290b55-1f95-4235-811b-538cc853d4ed None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:08.591785 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab290b55-1f95-4235-811b-538cc853d4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:08.612092 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-ab290b55-1f95-4235-811b-538cc853d4ed None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:03:08.613240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ab290b55-1f95-4235-811b-538cc853d4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:03:08.621754 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 18:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:03:08.772554 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccd2ba-f50f-4690-bf7c-917c42d7c5b5 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:03:08.787189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccd2ba-f50f-4690-bf7c-917c42d7c5b5 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:03:08.792638 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c01e38-1710-4241-9c5f-327dd5169c40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:03:08.793275 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c01e38-1710-4241-9c5f-327dd5169c40 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:08.793558 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c01e38-1710-4241-9c5f-327dd5169c40 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:08.793836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c01e38-1710-4241-9c5f-327dd5169c40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:08.801818 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c01e38-1710-4241-9c5f-327dd5169c40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:03:08.803423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c01e38-1710-4241-9c5f-327dd5169c40 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:03:08.812773 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 759/1524] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:03:12.501901 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1f908-3742-4d96-b939-35780255478d None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:12.502408 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1f908-3742-4d96-b939-35780255478d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:12.502408 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1f908-3742-4d96-b939-35780255478d None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:12.503733 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 766/1525] 10.222.0.75 () {54 vars in 961 bytes} [Thu Jul 28 18:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:03:12.508671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d73d0-9c9f-47f8-9a48-479661fc59ec None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:12.509212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d73d0-9c9f-47f8-9a48-479661fc59ec None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:12.509322 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d73d0-9c9f-47f8-9a48-479661fc59ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:12.528280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1d5d73d0-9c9f-47f8-9a48-479661fc59ec None None] MFA Rules not processed for user `cff43a72eaef462f86426ad3ceccd3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:03:12.529512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1d5d73d0-9c9f-47f8-9a48-479661fc59ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:03:12.537987 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 760/1526] 10.222.0.75 () {58 vars in 1058 bytes} [Thu Jul 28 18:03:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:03:12.545999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1f908-3742-4d96-b939-35780255478d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:03:12.559914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1f908-3742-4d96-b939-35780255478d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:03:12.564898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e1eb6-ff94-417b-b78f-0fd0ebefa90c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff43a72eaef462f86426ad3ceccd3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:03:12.565507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e1eb6-ff94-417b-b78f-0fd0ebefa90c service placement] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:12.565790 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e1eb6-ff94-417b-b78f-0fd0ebefa90c service placement] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:12.566095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e1eb6-ff94-417b-b78f-0fd0ebefa90c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:12.574270 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e1eb6-ff94-417b-b78f-0fd0ebefa90c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:03:12.575881 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e1eb6-ff94-417b-b78f-0fd0ebefa90c service placement] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:03:12.585392 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 767/1527] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:03:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:03:20.065323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6fffe-a0e5-4b32-bcda-f7a1adfeb913 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:20.065889 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6fffe-a0e5-4b32-bcda-f7a1adfeb913 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:20.065889 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6fffe-a0e5-4b32-bcda-f7a1adfeb913 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:20.067239 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 18:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:03:20.072614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbe921-a4a6-4c00-9f9e-d7b731b16ed8 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:20.073094 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbe921-a4a6-4c00-9f9e-d7b731b16ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:20.073198 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbe921-a4a6-4c00-9f9e-d7b731b16ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:20.093820 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-91dbe921-a4a6-4c00-9f9e-d7b731b16ed8 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:03:20.096624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-91dbe921-a4a6-4c00-9f9e-d7b731b16ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:03:20.107059 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 18:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:03:20.265912 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6fffe-a0e5-4b32-bcda-f7a1adfeb913 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:03:20.281486 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6fffe-a0e5-4b32-bcda-f7a1adfeb913 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:03:20.287161 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1e4d3-5405-4b83-9f4e-bdb6cbb8b1bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:03:20.287775 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1e4d3-5405-4b83-9f4e-bdb6cbb8b1bf service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:20.288059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1e4d3-5405-4b83-9f4e-bdb6cbb8b1bf service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:20.288338 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1e4d3-5405-4b83-9f4e-bdb6cbb8b1bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:20.297740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1e4d3-5405-4b83-9f4e-bdb6cbb8b1bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:03:20.299331 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1e4d3-5405-4b83-9f4e-bdb6cbb8b1bf service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:03:20.309580 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 762/1530] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:03:21.160302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b413700-0f94-477c-8cae-c182d906547c None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:21.160955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b413700-0f94-477c-8cae-c182d906547c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:21.160955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b413700-0f94-477c-8cae-c182d906547c None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:21.162276 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 18:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:03:21.167965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d1f14-9df1-48ba-8590-2550ad7baaed None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:21.168676 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d1f14-9df1-48ba-8590-2550ad7baaed None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:21.168676 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d1f14-9df1-48ba-8590-2550ad7baaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:21.194270 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-308d1f14-9df1-48ba-8590-2550ad7baaed None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:03:21.195488 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-308d1f14-9df1-48ba-8590-2550ad7baaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:03:21.203952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 18:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:03:21.357416 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b413700-0f94-477c-8cae-c182d906547c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:03:21.372717 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b413700-0f94-477c-8cae-c182d906547c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:03:21.378136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6392364-7879-4e54-89b4-b054a1c272cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:03:21.378749 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6392364-7879-4e54-89b4-b054a1c272cb service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:21.379032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6392364-7879-4e54-89b4-b054a1c272cb service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:21.379309 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6392364-7879-4e54-89b4-b054a1c272cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:21.387502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6392364-7879-4e54-89b4-b054a1c272cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:03:21.389168 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6392364-7879-4e54-89b4-b054a1c272cb service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:03:21.398465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 770/1533] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:03:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:03:25.345531 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b10e7-ecf1-419d-9723-909871e9a830 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:25.346183 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b10e7-ecf1-419d-9723-909871e9a830 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:25.346183 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b10e7-ecf1-419d-9723-909871e9a830 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:25.347663 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 18:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:03:25.354089 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757eee01-0476-430f-b97a-24e08378a33e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:25.354605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757eee01-0476-430f-b97a-24e08378a33e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:25.354721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757eee01-0476-430f-b97a-24e08378a33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:25.376013 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-757eee01-0476-430f-b97a-24e08378a33e None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:03:25.377258 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-757eee01-0476-430f-b97a-24e08378a33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:03:25.385204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 18:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:03:25.460966 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b10e7-ecf1-419d-9723-909871e9a830 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:03:25.463221 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-286b10e7-ecf1-419d-9723-909871e9a830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:03:25.541805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b10e7-ecf1-419d-9723-909871e9a830 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:03:25.545474 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ca980-de95-4294-8fb8-f573d37a1623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:03:25.546106 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ca980-de95-4294-8fb8-f573d37a1623 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:25.546391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ca980-de95-4294-8fb8-f573d37a1623 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:25.546673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ca980-de95-4294-8fb8-f573d37a1623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:25.555737 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ca980-de95-4294-8fb8-f573d37a1623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:03:25.557359 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ca980-de95-4294-8fb8-f573d37a1623 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:03:25.566872 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 765/1536] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:03:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:03:27.550678 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d36e0d-5d4d-463a-8c87-ccbb61944c40 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:27.551218 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d36e0d-5d4d-463a-8c87-ccbb61944c40 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:27.551218 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d36e0d-5d4d-463a-8c87-ccbb61944c40 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:27.552598 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 18:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:03:27.557883 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f67b7-f1c5-450f-9adc-4bf65b7370f8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:27.558306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f67b7-f1c5-450f-9adc-4bf65b7370f8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:27.558437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f67b7-f1c5-450f-9adc-4bf65b7370f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:27.578456 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e35f67b7-f1c5-450f-9adc-4bf65b7370f8 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:03:27.579712 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e35f67b7-f1c5-450f-9adc-4bf65b7370f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:03:27.588275 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 18:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:03:27.623782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d36e0d-5d4d-463a-8c87-ccbb61944c40 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:03:27.635142 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d36e0d-5d4d-463a-8c87-ccbb61944c40 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:03:27.638665 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d46af2-df11-4564-b956-7371c41fd8d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:03:27.639277 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d46af2-df11-4564-b956-7371c41fd8d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:27.639556 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d46af2-df11-4564-b956-7371c41fd8d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:27.639828 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d46af2-df11-4564-b956-7371c41fd8d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:27.649635 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d46af2-df11-4564-b956-7371c41fd8d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:03:27.651125 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d46af2-df11-4564-b956-7371c41fd8d6 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:03:27.660550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 773/1539] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:03:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:03:31.225672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9064e-915f-4686-85cd-fa0f9e5c612c None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:31.226320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9064e-915f-4686-85cd-fa0f9e5c612c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:31.226320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9064e-915f-4686-85cd-fa0f9e5c612c None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:31.227587 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 767/1540] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 18:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:03:31.233061 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bedc4-c410-4770-826e-0f12dcbb06d5 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:31.233489 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bedc4-c410-4770-826e-0f12dcbb06d5 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:31.233592 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bedc4-c410-4770-826e-0f12dcbb06d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:31.253312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-491bedc4-c410-4770-826e-0f12dcbb06d5 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:03:31.254677 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-491bedc4-c410-4770-826e-0f12dcbb06d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:03:31.262986 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 774/1541] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 18:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:03:31.571456 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9064e-915f-4686-85cd-fa0f9e5c612c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:03:31.573169 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-13a9064e-915f-4686-85cd-fa0f9e5c612c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:03:31.577260 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=83 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:03:31.651788 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9064e-915f-4686-85cd-fa0f9e5c612c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:03:31.655392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea90e04-2b7f-4632-9d1f-c0d3b477786b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:03:31.656012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea90e04-2b7f-4632-9d1f-c0d3b477786b service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:31.656296 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea90e04-2b7f-4632-9d1f-c0d3b477786b service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:31.656572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea90e04-2b7f-4632-9d1f-c0d3b477786b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:31.665557 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea90e04-2b7f-4632-9d1f-c0d3b477786b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:03:31.667022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea90e04-2b7f-4632-9d1f-c0d3b477786b service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:03:31.676450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 768/1542] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:03:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:03:33.741595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe3004-1014-4848-9e81-81070e728084 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:33.742419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe3004-1014-4848-9e81-81070e728084 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:33.742419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe3004-1014-4848-9e81-81070e728084 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:33.743813 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 775/1543] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 18:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:03:33.748958 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c0b7-fd54-4879-ae5f-7e56d2d0159d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:33.749392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c0b7-fd54-4879-ae5f-7e56d2d0159d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:33.749525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c0b7-fd54-4879-ae5f-7e56d2d0159d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:33.768927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d350c0b7-fd54-4879-ae5f-7e56d2d0159d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:03:33.770136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d350c0b7-fd54-4879-ae5f-7e56d2d0159d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:03:33.778607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 769/1544] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 18:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:03:34.091810 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe3004-1014-4848-9e81-81070e728084 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:03:34.093520 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1dfe3004-1014-4848-9e81-81070e728084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:03:34.106823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe3004-1014-4848-9e81-81070e728084 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:03:34.110373 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916aefc8-567a-4ba5-b69e-757b1f78efbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:03:34.110982 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916aefc8-567a-4ba5-b69e-757b1f78efbe service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:34.111274 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916aefc8-567a-4ba5-b69e-757b1f78efbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:34.111553 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916aefc8-567a-4ba5-b69e-757b1f78efbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:34.120986 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916aefc8-567a-4ba5-b69e-757b1f78efbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:03:34.122506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916aefc8-567a-4ba5-b69e-757b1f78efbe service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:03:34.132255 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 776/1545] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:03:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:03:43.763701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=37 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:03:44.128043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=42 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:24.981330 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f2e44-a3e5-46ce-a6e2-cfbb76a616c7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:24.982019 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f2e44-a3e5-46ce-a6e2-cfbb76a616c7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:24.982019 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f2e44-a3e5-46ce-a6e2-cfbb76a616c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:25.017199 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e55f2e44-a3e5-46ce-a6e2-cfbb76a616c7 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:25.018421 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e55f2e44-a3e5-46ce-a6e2-cfbb76a616c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:25.031830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 770/1546] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:05:25.041417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b2e9d-50ee-43ac-8e45-31e60403d286 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:25.042022 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b2e9d-50ee-43ac-8e45-31e60403d286 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:25.042022 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b2e9d-50ee-43ac-8e45-31e60403d286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:25.071044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6b3b2e9d-50ee-43ac-8e45-31e60403d286 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:25.072279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6b3b2e9d-50ee-43ac-8e45-31e60403d286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:25.085434 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 777/1547] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:05:25.090285 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f2e44-a3e5-46ce-a6e2-cfbb76a616c7 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:25.106804 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f2e44-a3e5-46ce-a6e2-cfbb76a616c7 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:25.115113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39ac14-04ee-4cef-b8aa-0ca9e1c4d231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:25.115794 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39ac14-04ee-4cef-b8aa-0ca9e1c4d231 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:25.116086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39ac14-04ee-4cef-b8aa-0ca9e1c4d231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:25.116363 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39ac14-04ee-4cef-b8aa-0ca9e1c4d231 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:25.117145 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39ac14-04ee-4cef-b8aa-0ca9e1c4d231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:05:25.117454 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39ac14-04ee-4cef-b8aa-0ca9e1c4d231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:25.119109 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39ac14-04ee-4cef-b8aa-0ca9e1c4d231 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:25.145550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 771/1548] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:05:25.153980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b2e9d-50ee-43ac-8e45-31e60403d286 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:25.164124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b2e9d-50ee-43ac-8e45-31e60403d286 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:25.174963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429ba07-b0f3-4094-84c9-a75cba2abac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:25.175669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429ba07-b0f3-4094-84c9-a75cba2abac0 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:25.175956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429ba07-b0f3-4094-84c9-a75cba2abac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:25.176240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429ba07-b0f3-4094-84c9-a75cba2abac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:25.177016 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429ba07-b0f3-4094-84c9-a75cba2abac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:25.179271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429ba07-b0f3-4094-84c9-a75cba2abac0 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:25.396147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a86bce-bf70-4db0-8572-5df50634af3b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:25.396518 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a86bce-bf70-4db0-8572-5df50634af3b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:25.396717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a86bce-bf70-4db0-8572-5df50634af3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:25.434427 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c1a86bce-bf70-4db0-8572-5df50634af3b None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:25.435636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c1a86bce-bf70-4db0-8572-5df50634af3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:25.439125 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 778/1549] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:25 2022] POST /identity/v3/projects => generated 381 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:25.445114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429ba07-b0f3-4094-84c9-a75cba2abac0 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:25.572119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 772/1550] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:05:25.581216 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ae46f-9500-40ad-ae7b-767711845a9f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:25.581556 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ae46f-9500-40ad-ae7b-767711845a9f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:25.581820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ae46f-9500-40ad-ae7b-767711845a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:25.589901 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429ba07-b0f3-4094-84c9-a75cba2abac0 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:25.603248 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613591f8-dd0e-41f0-aa31-b28cf7f8256d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:25.603809 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613591f8-dd0e-41f0-aa31-b28cf7f8256d admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:25.604096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613591f8-dd0e-41f0-aa31-b28cf7f8256d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:25.604374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613591f8-dd0e-41f0-aa31-b28cf7f8256d admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:25.605097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613591f8-dd0e-41f0-aa31-b28cf7f8256d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:25.606148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: WARNING py.warnings [None req-613591f8-dd0e-41f0-aa31-b28cf7f8256d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:05:25.606148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: warnings.warn(msg) Jul 28 18:05:25.606148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: Jul 28 18:05:25.607377 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613591f8-dd0e-41f0-aa31-b28cf7f8256d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:25.613216 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4f0ae46f-9500-40ad-ae7b-767711845a9f None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:25.614716 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4f0ae46f-9500-40ad-ae7b-767711845a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:25.634335 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 773/1551] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:05:25.635336 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04934a7e-490d-4bce-9057-9bc0e6a927d0 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:25.635621 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04934a7e-490d-4bce-9057-9bc0e6a927d0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:25.635896 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04934a7e-490d-4bce-9057-9bc0e6a927d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:25.662334 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-04934a7e-490d-4bce-9057-9bc0e6a927d0 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:25.663551 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-04934a7e-490d-4bce-9057-9bc0e6a927d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:25.679297 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 774/1552] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:25.684970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289b7d4-98e9-4a8e-b990-30f18a8a1a22 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:25.684970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289b7d4-98e9-4a8e-b990-30f18a8a1a22 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:25.684970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289b7d4-98e9-4a8e-b990-30f18a8a1a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:25.705850 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0289b7d4-98e9-4a8e-b990-30f18a8a1a22 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:25.707542 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0289b7d4-98e9-4a8e-b990-30f18a8a1a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:25.732280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 775/1553] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:25.733168 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289b7d4-98e9-4a8e-b990-30f18a8a1a22 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:25.733313 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 779/1554] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:25 2022] POST /identity/v3/users => generated 291 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:05:25.736950 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1946e75-abc1-4cc8-ac86-8819d02d0327 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:25.737249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1946e75-abc1-4cc8-ac86-8819d02d0327 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:25.738066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1946e75-abc1-4cc8-ac86-8819d02d0327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:25.748778 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289b7d4-98e9-4a8e-b990-30f18a8a1a22 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:25.755356 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3447a8-5f58-4be2-80f0-da63efbe6b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:25.755975 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3447a8-5f58-4be2-80f0-da63efbe6b4a admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:25.756255 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3447a8-5f58-4be2-80f0-da63efbe6b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:25.756523 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3447a8-5f58-4be2-80f0-da63efbe6b4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:25.757257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3447a8-5f58-4be2-80f0-da63efbe6b4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:05:25.757562 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3447a8-5f58-4be2-80f0-da63efbe6b4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:25.759148 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3447a8-5f58-4be2-80f0-da63efbe6b4a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:25.763970 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b1946e75-abc1-4cc8-ac86-8819d02d0327 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:25.765335 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b1946e75-abc1-4cc8-ac86-8819d02d0327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:25.771488 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 776/1555] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:05:25.772688 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f817bb8-249e-477d-a596-53ff589aa46d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:25.773000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f817bb8-249e-477d-a596-53ff589aa46d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:25.773274 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f817bb8-249e-477d-a596-53ff589aa46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:25.780706 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 780/1556] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:25.782224 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1946e75-abc1-4cc8-ac86-8819d02d0327 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:25.793424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1946e75-abc1-4cc8-ac86-8819d02d0327 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:25.798808 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4f817bb8-249e-477d-a596-53ff589aa46d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:25.798957 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc11b0-cf99-40a2-9bd9-1f1e2fb43bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:25.799472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc11b0-cf99-40a2-9bd9-1f1e2fb43bde admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:25.799759 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc11b0-cf99-40a2-9bd9-1f1e2fb43bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:25.800039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4f817bb8-249e-477d-a596-53ff589aa46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:25.800825 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc11b0-cf99-40a2-9bd9-1f1e2fb43bde admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:25.801476 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc11b0-cf99-40a2-9bd9-1f1e2fb43bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:25.803043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc11b0-cf99-40a2-9bd9-1f1e2fb43bde admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:25.809426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 777/1557] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:25.810145 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60a275-99fe-4513-bbfd-a7b9aab446a7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:25.810503 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60a275-99fe-4513-bbfd-a7b9aab446a7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:25.810771 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60a275-99fe-4513-bbfd-a7b9aab446a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:25.817468 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 781/1558] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:25.818589 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a961eaa-ff2a-4bc3-842e-ed730657df94 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:25.818881 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a961eaa-ff2a-4bc3-842e-ed730657df94 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:25.819163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a961eaa-ff2a-4bc3-842e-ed730657df94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:25.834396 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4b60a275-99fe-4513-bbfd-a7b9aab446a7 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:25.835565 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4b60a275-99fe-4513-bbfd-a7b9aab446a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:25.846030 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4a961eaa-ff2a-4bc3-842e-ed730657df94 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:25.847856 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4a961eaa-ff2a-4bc3-842e-ed730657df94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:25.859860 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 778/1559] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:25.859860 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6affab-5e51-4172-ac31-9e4f81d06add None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:25.859860 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6affab-5e51-4172-ac31-9e4f81d06add None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:25.859860 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6affab-5e51-4172-ac31-9e4f81d06add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:25.864051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 782/1560] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:25.868984 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a961eaa-ff2a-4bc3-842e-ed730657df94 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:25.883117 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a961eaa-ff2a-4bc3-842e-ed730657df94 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:25.884420 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ed6affab-5e51-4172-ac31-9e4f81d06add None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:25.885692 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ed6affab-5e51-4172-ac31-9e4f81d06add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:25.887960 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac018d-d8c0-4c26-a370-74faf5ef78c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:25.888586 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac018d-d8c0-4c26-a370-74faf5ef78c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:25.888906 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac018d-d8c0-4c26-a370-74faf5ef78c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:25.889177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac018d-d8c0-4c26-a370-74faf5ef78c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:25.889859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac018d-d8c0-4c26-a370-74faf5ef78c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:25.892039 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac018d-d8c0-4c26-a370-74faf5ef78c2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:25.893909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 779/1561] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:25.898171 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890ea71-85af-46c5-8933-fc056bdb211d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:25.898455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890ea71-85af-46c5-8933-fc056bdb211d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:25.898726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890ea71-85af-46c5-8933-fc056bdb211d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:25.918407 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4890ea71-85af-46c5-8933-fc056bdb211d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:25.919653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4890ea71-85af-46c5-8933-fc056bdb211d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:25.928163 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 780/1562] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:25.928954 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890ea71-85af-46c5-8933-fc056bdb211d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:25.938656 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890ea71-85af-46c5-8933-fc056bdb211d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:25.943244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802513b-bc44-42d9-b6ee-a690af44ee54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:25.943828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802513b-bc44-42d9-b6ee-a690af44ee54 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:25.944107 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802513b-bc44-42d9-b6ee-a690af44ee54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:25.944379 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802513b-bc44-42d9-b6ee-a690af44ee54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:25.945131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802513b-bc44-42d9-b6ee-a690af44ee54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:05:25.945432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802513b-bc44-42d9-b6ee-a690af44ee54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:25.947084 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802513b-bc44-42d9-b6ee-a690af44ee54 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:25.958548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 781/1563] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:05:25.959317 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802513b-bc44-42d9-b6ee-a690af44ee54 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:25.968814 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802513b-bc44-42d9-b6ee-a690af44ee54 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:25.973874 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816343cd-214e-415c-aea6-b97df16585eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:25.974579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816343cd-214e-415c-aea6-b97df16585eb admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:25.974862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816343cd-214e-415c-aea6-b97df16585eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:25.975139 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816343cd-214e-415c-aea6-b97df16585eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:25.975811 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816343cd-214e-415c-aea6-b97df16585eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:25.977447 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816343cd-214e-415c-aea6-b97df16585eb admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:25.987519 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 782/1564] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:25.989649 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682c5f6-6341-40ec-897e-ffc32ecd1b73 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:25.989930 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682c5f6-6341-40ec-897e-ffc32ecd1b73 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:25.990204 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682c5f6-6341-40ec-897e-ffc32ecd1b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:26.000536 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 783/1565] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:25 2022] POST /identity/v3/projects => generated 389 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:26.001955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e900b25-944c-4f10-94c3-48f55fe9ce4e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:26.005642 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e900b25-944c-4f10-94c3-48f55fe9ce4e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:26.005642 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e900b25-944c-4f10-94c3-48f55fe9ce4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:26.008825 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3682c5f6-6341-40ec-897e-ffc32ecd1b73 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:26.010021 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3682c5f6-6341-40ec-897e-ffc32ecd1b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:26.027015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-8e900b25-944c-4f10-94c3-48f55fe9ce4e None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:26.028403 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8e900b25-944c-4f10-94c3-48f55fe9ce4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:26.061802 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:26.071828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 783/1566] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:26.073417 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aedc5d-1361-4f1a-897c-b1ab03bc35c8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:26.073861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aedc5d-1361-4f1a-897c-b1ab03bc35c8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:26.074151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aedc5d-1361-4f1a-897c-b1ab03bc35c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:26.096874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 784/1567] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:26.096874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e900b25-944c-4f10-94c3-48f55fe9ce4e None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:26.098026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a0aedc5d-1361-4f1a-897c-b1ab03bc35c8 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:26.098026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a0aedc5d-1361-4f1a-897c-b1ab03bc35c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:26.107692 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 784/1568] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:26.110404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e900b25-944c-4f10-94c3-48f55fe9ce4e None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:26.116589 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1f557-52e9-465b-a7a6-512c1c549ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:26.116777 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aedc5d-1361-4f1a-897c-b1ab03bc35c8 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:26.118071 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1f557-52e9-465b-a7a6-512c1c549ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:26.118453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1f557-52e9-465b-a7a6-512c1c549ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:26.119205 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1f557-52e9-465b-a7a6-512c1c549ca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:26.119950 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1f557-52e9-465b-a7a6-512c1c549ca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:05:26.120360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1f557-52e9-465b-a7a6-512c1c549ca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:26.121985 dv-cinder-837543-7-smb devstack@keystone.service[80421]: WARNING py.warnings [None req-c8e1f557-52e9-465b-a7a6-512c1c549ca5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:05:26.121985 dv-cinder-837543-7-smb devstack@keystone.service[80421]: warnings.warn(msg) Jul 28 18:05:26.121985 dv-cinder-837543-7-smb devstack@keystone.service[80421]: Jul 28 18:05:26.123991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1f557-52e9-465b-a7a6-512c1c549ca5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:26.126699 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aedc5d-1361-4f1a-897c-b1ab03bc35c8 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:26.128570 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:26.131703 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157e720-4c9e-4246-a28f-0c0f4aa3eb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:26.132329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157e720-4c9e-4246-a28f-0c0f4aa3eb6f admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:26.132611 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157e720-4c9e-4246-a28f-0c0f4aa3eb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:26.132944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157e720-4c9e-4246-a28f-0c0f4aa3eb6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:26.133776 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157e720-4c9e-4246-a28f-0c0f4aa3eb6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:05:26.134089 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157e720-4c9e-4246-a28f-0c0f4aa3eb6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:26.135688 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157e720-4c9e-4246-a28f-0c0f4aa3eb6f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:26.140100 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 785/1569] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:05:26.141093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1f557-52e9-465b-a7a6-512c1c549ca5 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:26.149766 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 785/1570] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:05:26.150756 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157e720-4c9e-4246-a28f-0c0f4aa3eb6f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:26.153113 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1f557-52e9-465b-a7a6-512c1c549ca5 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:26.158771 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b15f9-efd2-44e9-b497-89333a08863a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:26.160422 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b15f9-efd2-44e9-b497-89333a08863a admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:26.161417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b15f9-efd2-44e9-b497-89333a08863a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:26.161734 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b15f9-efd2-44e9-b497-89333a08863a admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:26.162509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b15f9-efd2-44e9-b497-89333a08863a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:26.164605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b15f9-efd2-44e9-b497-89333a08863a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:26.172773 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157e720-4c9e-4246-a28f-0c0f4aa3eb6f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:26.177908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5ad9a-4826-4dd1-8a21-3a4b66bad7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:26.179232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5ad9a-4826-4dd1-8a21-3a4b66bad7ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:26.179812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5ad9a-4826-4dd1-8a21-3a4b66bad7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:26.180861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5ad9a-4826-4dd1-8a21-3a4b66bad7ac admin admin] PATH_INFO: `/v3/projects/178d04fd1e3347b8905099b33307adb0/users/a588ed9a46314250b09a209a36ef203d/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:26.198319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5ad9a-4826-4dd1-8a21-3a4b66bad7ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=178d04fd1e3347b8905099b33307adb0, user_id=a588ed9a46314250b09a209a36ef203d, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:26.203149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-49e5ad9a-4826-4dd1-8a21-3a4b66bad7ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:05:26.203149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: warnings.warn(msg) Jul 28 18:05:26.203149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: Jul 28 18:05:26.203149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5ad9a-4826-4dd1-8a21-3a4b66bad7ac admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:26.264590 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 786/1571] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:26 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:26.265722 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b15f9-efd2-44e9-b497-89333a08863a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:26.293824 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 786/1572] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:26 2022] PUT /identity/v3/projects/178d04fd1e3347b8905099b33307adb0/users/a588ed9a46314250b09a209a36ef203d/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:26.294924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5ad9a-4826-4dd1-8a21-3a4b66bad7ac admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:26.343652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b15f9-efd2-44e9-b497-89333a08863a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:26.380290 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5ad9a-4826-4dd1-8a21-3a4b66bad7ac admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:26.385681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1e425-971e-4420-ae03-e274d689d138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:26.386419 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1e425-971e-4420-ae03-e274d689d138 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:26.386702 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1e425-971e-4420-ae03-e274d689d138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:26.386976 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1e425-971e-4420-ae03-e274d689d138 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:26.387682 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1e425-971e-4420-ae03-e274d689d138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:05:26.387984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1e425-971e-4420-ae03-e274d689d138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:26.389906 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1e425-971e-4420-ae03-e274d689d138 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:26.403802 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 787/1573] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:05:26.404478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1e425-971e-4420-ae03-e274d689d138 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:26.414419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d78f85-8583-4550-ab09-e3fc23f851ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:26.415043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d78f85-8583-4550-ab09-e3fc23f851ee admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:26.415167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1e425-971e-4420-ae03-e274d689d138 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:26.415349 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d78f85-8583-4550-ab09-e3fc23f851ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:26.415620 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d78f85-8583-4550-ab09-e3fc23f851ee admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:26.416288 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d78f85-8583-4550-ab09-e3fc23f851ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:26.418254 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d78f85-8583-4550-ab09-e3fc23f851ee admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:26.419752 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ff250-83ef-4814-ad17-8152f46ee322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:26.420362 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ff250-83ef-4814-ad17-8152f46ee322 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:26.420640 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ff250-83ef-4814-ad17-8152f46ee322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:26.420946 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ff250-83ef-4814-ad17-8152f46ee322 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:26.421670 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ff250-83ef-4814-ad17-8152f46ee322 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:05:26.421981 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ff250-83ef-4814-ad17-8152f46ee322 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:26.423554 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ff250-83ef-4814-ad17-8152f46ee322 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:26.436819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 788/1574] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:05:26.443719 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eeaaa5-00e5-4f5b-aed7-7644382fec2c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:26.443719 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eeaaa5-00e5-4f5b-aed7-7644382fec2c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:26.443719 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eeaaa5-00e5-4f5b-aed7-7644382fec2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:26.459344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-04eeaaa5-00e5-4f5b-aed7-7644382fec2c None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:26.460539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-04eeaaa5-00e5-4f5b-aed7-7644382fec2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:26.468477 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 789/1575] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:26.469241 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eeaaa5-00e5-4f5b-aed7-7644382fec2c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:26.478854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eeaaa5-00e5-4f5b-aed7-7644382fec2c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:26.483320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df27d1d-19c0-4ab0-9668-5f03e3aed51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:26.486059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df27d1d-19c0-4ab0-9668-5f03e3aed51e admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:26.486059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df27d1d-19c0-4ab0-9668-5f03e3aed51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:26.486059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df27d1d-19c0-4ab0-9668-5f03e3aed51e admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:26.486059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df27d1d-19c0-4ab0-9668-5f03e3aed51e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:26.486444 dv-cinder-837543-7-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-7df27d1d-19c0-4ab0-9668-5f03e3aed51e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:05:26.486444 dv-cinder-837543-7-smb devstack@keystone.service[80420]: warnings.warn(msg) Jul 28 18:05:26.486444 dv-cinder-837543-7-smb devstack@keystone.service[80420]: Jul 28 18:05:26.487328 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df27d1d-19c0-4ab0-9668-5f03e3aed51e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:26.527204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 787/1576] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:26 2022] POST /identity/v3/users => generated 295 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:26.528104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d78f85-8583-4550-ab09-e3fc23f851ee admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:26.538382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d78f85-8583-4550-ab09-e3fc23f851ee admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:26.543004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddedaa-3eec-4003-b04a-0b8c40f7074c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:26.544909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddedaa-3eec-4003-b04a-0b8c40f7074c admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:26.544909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddedaa-3eec-4003-b04a-0b8c40f7074c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:26.544909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddedaa-3eec-4003-b04a-0b8c40f7074c admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:26.544909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddedaa-3eec-4003-b04a-0b8c40f7074c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:26.546671 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddedaa-3eec-4003-b04a-0b8c40f7074c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:26.577104 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 790/1577] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:26 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:26.577104 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df27d1d-19c0-4ab0-9668-5f03e3aed51e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:26.635752 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 788/1578] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:26 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:26.637144 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106995e-8309-4a65-b2e1-cf02f696f26d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:26.637432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106995e-8309-4a65-b2e1-cf02f696f26d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:26.637707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106995e-8309-4a65-b2e1-cf02f696f26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:26.640135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df27d1d-19c0-4ab0-9668-5f03e3aed51e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:26.649399 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:26.665672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-3106995e-8309-4a65-b2e1-cf02f696f26d None None] MFA Rules not processed for user `a588ed9a46314250b09a209a36ef203d`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:26.666933 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3106995e-8309-4a65-b2e1-cf02f696f26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:26.700438 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd405c45-778a-458e-9972-3e57b9abaec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:26.701095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd405c45-778a-458e-9972-3e57b9abaec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:26.701419 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd405c45-778a-458e-9972-3e57b9abaec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:26.701699 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd405c45-778a-458e-9972-3e57b9abaec9 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:26.702182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:26.702424 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd405c45-778a-458e-9972-3e57b9abaec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:26.704426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd405c45-778a-458e-9972-3e57b9abaec9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:26.733830 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 789/1579] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:26.734662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106995e-8309-4a65-b2e1-cf02f696f26d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:26.745721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106995e-8309-4a65-b2e1-cf02f696f26d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:26.751869 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bd6be-d082-4f73-8c53-49f8ceca9c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:26.752563 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bd6be-d082-4f73-8c53-49f8ceca9c9b admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:26.752806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bd6be-d082-4f73-8c53-49f8ceca9c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:26.753106 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bd6be-d082-4f73-8c53-49f8ceca9c9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:26.753804 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bd6be-d082-4f73-8c53-49f8ceca9c9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:26.755726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bd6be-d082-4f73-8c53-49f8ceca9c9b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:26.785333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 791/1580] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:26 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:26.786158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd405c45-778a-458e-9972-3e57b9abaec9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:26.796418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd405c45-778a-458e-9972-3e57b9abaec9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:26.801824 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91748964-2d6c-4e8c-a459-632ff9d22f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:26.802426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91748964-2d6c-4e8c-a459-632ff9d22f96 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:26.802711 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91748964-2d6c-4e8c-a459-632ff9d22f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:26.802990 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91748964-2d6c-4e8c-a459-632ff9d22f96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:26.803641 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91748964-2d6c-4e8c-a459-632ff9d22f96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:26.805663 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91748964-2d6c-4e8c-a459-632ff9d22f96 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:26.843038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 790/1581] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:26 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:26.843879 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bd6be-d082-4f73-8c53-49f8ceca9c9b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:26.905017 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bd6be-d082-4f73-8c53-49f8ceca9c9b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:26.910176 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019cc29-d9a1-4552-867a-529967e5ca97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:26.910799 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019cc29-d9a1-4552-867a-529967e5ca97 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:26.911083 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019cc29-d9a1-4552-867a-529967e5ca97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:26.911364 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019cc29-d9a1-4552-867a-529967e5ca97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:26.912082 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019cc29-d9a1-4552-867a-529967e5ca97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:05:26.912390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019cc29-d9a1-4552-867a-529967e5ca97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:26.914054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019cc29-d9a1-4552-867a-529967e5ca97 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:26.921412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 792/1582] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:26 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:26.922360 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91748964-2d6c-4e8c-a459-632ff9d22f96 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:26.929599 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 791/1583] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:05:26.929599 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019cc29-d9a1-4552-867a-529967e5ca97 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:26.938523 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019cc29-d9a1-4552-867a-529967e5ca97 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:26.992020 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91748964-2d6c-4e8c-a459-632ff9d22f96 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:26.996244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53200a-6e0d-44c6-b413-3fe4a7c27174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:26.996640 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed56ec-21b3-41fe-8871-9668cf34e7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:26.996925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53200a-6e0d-44c6-b413-3fe4a7c27174 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:26.997210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53200a-6e0d-44c6-b413-3fe4a7c27174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:26.997316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed56ec-21b3-41fe-8871-9668cf34e7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:26.997487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53200a-6e0d-44c6-b413-3fe4a7c27174 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:26.997583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed56ec-21b3-41fe-8871-9668cf34e7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:26.997825 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed56ec-21b3-41fe-8871-9668cf34e7f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:26.998182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53200a-6e0d-44c6-b413-3fe4a7c27174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:26.998524 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed56ec-21b3-41fe-8871-9668cf34e7f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.000113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed56ec-21b3-41fe-8871-9668cf34e7f3 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.000218 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53200a-6e0d-44c6-b413-3fe4a7c27174 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.010309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 793/1584] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:27.011098 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed56ec-21b3-41fe-8871-9668cf34e7f3 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.021434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed56ec-21b3-41fe-8871-9668cf34e7f3 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.031191 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd74b12-01be-4ca3-a632-3bee9c2b5e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.031191 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd74b12-01be-4ca3-a632-3bee9c2b5e8e admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.031191 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd74b12-01be-4ca3-a632-3bee9c2b5e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.031191 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd74b12-01be-4ca3-a632-3bee9c2b5e8e admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.031574 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd74b12-01be-4ca3-a632-3bee9c2b5e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.031574 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd74b12-01be-4ca3-a632-3bee9c2b5e8e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.100037 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 792/1585] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:26 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:27.101346 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcef493-64f8-4aca-a30a-724716abd49a None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.101639 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcef493-64f8-4aca-a30a-724716abd49a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.101920 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcef493-64f8-4aca-a30a-724716abd49a None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.103186 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 793/1586] 10.222.0.75 () {54 vars in 962 bytes} [Thu Jul 28 18:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:05:27.103891 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcef493-64f8-4aca-a30a-724716abd49a None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.117069 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcef493-64f8-4aca-a30a-724716abd49a None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.121889 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670ab25-dbec-4432-bf8a-ed901245f473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.122545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670ab25-dbec-4432-bf8a-ed901245f473 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.123121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670ab25-dbec-4432-bf8a-ed901245f473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.123121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670ab25-dbec-4432-bf8a-ed901245f473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.124167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670ab25-dbec-4432-bf8a-ed901245f473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.125540 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670ab25-dbec-4432-bf8a-ed901245f473 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.131711 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 794/1587] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:27 2022] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:27.131711 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd74b12-01be-4ca3-a632-3bee9c2b5e8e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.140054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 794/1588] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:27.140054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670ab25-dbec-4432-bf8a-ed901245f473 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.141673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd74b12-01be-4ca3-a632-3bee9c2b5e8e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.146900 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bbe8d-b385-454f-9f4a-f762a1ab4be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.147510 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bbe8d-b385-454f-9f4a-f762a1ab4be5 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.147794 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bbe8d-b385-454f-9f4a-f762a1ab4be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.148071 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bbe8d-b385-454f-9f4a-f762a1ab4be5 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.148316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670ab25-dbec-4432-bf8a-ed901245f473 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.148790 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7bbe8d-b385-454f-9f4a-f762a1ab4be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.150720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7bbe8d-b385-454f-9f4a-f762a1ab4be5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.153091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2eac1-a9f2-4c09-b1ff-c8453448d9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.153818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2eac1-a9f2-4c09-b1ff-c8453448d9d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.154109 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2eac1-a9f2-4c09-b1ff-c8453448d9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.154387 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2eac1-a9f2-4c09-b1ff-c8453448d9d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.155107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2eac1-a9f2-4c09-b1ff-c8453448d9d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.157000 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2eac1-a9f2-4c09-b1ff-c8453448d9d1 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.241157 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 795/1589] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:27 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:27.242011 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bbe8d-b385-454f-9f4a-f762a1ab4be5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.251818 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bbe8d-b385-454f-9f4a-f762a1ab4be5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.256926 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8e9ae-2551-4454-a51f-84029e3bf4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.257508 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8e9ae-2551-4454-a51f-84029e3bf4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.260361 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8e9ae-2551-4454-a51f-84029e3bf4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.260361 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8e9ae-2551-4454-a51f-84029e3bf4a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.260361 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8e9ae-2551-4454-a51f-84029e3bf4a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.260634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8e9ae-2551-4454-a51f-84029e3bf4a5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.288417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 795/1590] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:27 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:27.288417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2eac1-a9f2-4c09-b1ff-c8453448d9d1 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.295987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2eac1-a9f2-4c09-b1ff-c8453448d9d1 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.300687 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284179c-e77b-4f23-be43-98ce447b0864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.301334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284179c-e77b-4f23-be43-98ce447b0864 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.301617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284179c-e77b-4f23-be43-98ce447b0864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.301898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284179c-e77b-4f23-be43-98ce447b0864 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.302592 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284179c-e77b-4f23-be43-98ce447b0864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.304217 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284179c-e77b-4f23-be43-98ce447b0864 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.306428 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:27.314904 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 796/1591] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:27.316349 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284179c-e77b-4f23-be43-98ce447b0864 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.325889 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284179c-e77b-4f23-be43-98ce447b0864 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.330473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad821e3-2479-469a-8d9d-b1c90688775f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.331050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad821e3-2479-469a-8d9d-b1c90688775f admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.331385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad821e3-2479-469a-8d9d-b1c90688775f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.332260 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad821e3-2479-469a-8d9d-b1c90688775f admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.332975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad821e3-2479-469a-8d9d-b1c90688775f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.335953 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad821e3-2479-469a-8d9d-b1c90688775f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.345180 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 797/1592] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:27.346572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b08d5-1c84-4e02-808d-0a0ac2a783ec None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.346864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b08d5-1c84-4e02-808d-0a0ac2a783ec None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.347194 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b08d5-1c84-4e02-808d-0a0ac2a783ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.362941 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 796/1593] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:27 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:27.364460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8e9ae-2551-4454-a51f-84029e3bf4a5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.386456 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:27.387310 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-dc3b08d5-1c84-4e02-808d-0a0ac2a783ec None None] MFA Rules not processed for user `c456a787159844feb7eabfd1e527e46e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:27.388612 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-dc3b08d5-1c84-4e02-808d-0a0ac2a783ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:27.429163 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8e9ae-2551-4454-a51f-84029e3bf4a5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.433809 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50556b89-4855-42bd-8ebf-5b5493c575d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.434458 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50556b89-4855-42bd-8ebf-5b5493c575d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.435071 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50556b89-4855-42bd-8ebf-5b5493c575d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.435519 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50556b89-4855-42bd-8ebf-5b5493c575d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.436584 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50556b89-4855-42bd-8ebf-5b5493c575d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.438270 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50556b89-4855-42bd-8ebf-5b5493c575d9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.448846 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 797/1594] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:27.449596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50556b89-4855-42bd-8ebf-5b5493c575d9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.459785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50556b89-4855-42bd-8ebf-5b5493c575d9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.459950 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 798/1595] 10.222.0.75 () {58 vars in 1059 bytes} [Thu Jul 28 18:05:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:27.460707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b08d5-1c84-4e02-808d-0a0ac2a783ec None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.464432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51805a7e-e6c3-4a70-89ad-4666623d6ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.465143 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51805a7e-e6c3-4a70-89ad-4666623d6ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.465419 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51805a7e-e6c3-4a70-89ad-4666623d6ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.465692 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51805a7e-e6c3-4a70-89ad-4666623d6ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.466447 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51805a7e-e6c3-4a70-89ad-4666623d6ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.468011 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51805a7e-e6c3-4a70-89ad-4666623d6ae6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.471182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b08d5-1c84-4e02-808d-0a0ac2a783ec None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.475813 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99776a15-195f-4cab-a390-756414ceaae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.476421 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99776a15-195f-4cab-a390-756414ceaae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.476707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99776a15-195f-4cab-a390-756414ceaae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.477023 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99776a15-195f-4cab-a390-756414ceaae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.477742 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99776a15-195f-4cab-a390-756414ceaae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.478139 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 798/1596] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:27.478928 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51805a7e-e6c3-4a70-89ad-4666623d6ae6 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.479358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99776a15-195f-4cab-a390-756414ceaae6 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.489075 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51805a7e-e6c3-4a70-89ad-4666623d6ae6 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.491885 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 799/1597] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:27.491885 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99776a15-195f-4cab-a390-756414ceaae6 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.493756 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83415e53-0290-4a25-8816-44dd4749e358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.494419 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83415e53-0290-4a25-8816-44dd4749e358 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.494701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83415e53-0290-4a25-8816-44dd4749e358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.494971 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83415e53-0290-4a25-8816-44dd4749e358 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.495905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83415e53-0290-4a25-8816-44dd4749e358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.497534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83415e53-0290-4a25-8816-44dd4749e358 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.501800 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99776a15-195f-4cab-a390-756414ceaae6 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.507135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d2d23-729d-4b07-b691-db8552bb87fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.507802 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d2d23-729d-4b07-b691-db8552bb87fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.508088 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d2d23-729d-4b07-b691-db8552bb87fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.508367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d2d23-729d-4b07-b691-db8552bb87fd admin admin] PATH_INFO: `/v3/projects/a6f352d7ada9490a83075b7fb59c8cec/users/0130232e2fd44fe09dd82a173da0a12d/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.508478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 799/1598] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:27.509336 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83415e53-0290-4a25-8816-44dd4749e358 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.520045 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83415e53-0290-4a25-8816-44dd4749e358 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.525002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34db032-3aea-4491-aba2-15b320551eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.525168 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d2d23-729d-4b07-b691-db8552bb87fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f352d7ada9490a83075b7fb59c8cec, user_id=0130232e2fd44fe09dd82a173da0a12d, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.525655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34db032-3aea-4491-aba2-15b320551eae admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.525945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34db032-3aea-4491-aba2-15b320551eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.526217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34db032-3aea-4491-aba2-15b320551eae admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.526904 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34db032-3aea-4491-aba2-15b320551eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.527875 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d2d23-729d-4b07-b691-db8552bb87fd admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.528501 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34db032-3aea-4491-aba2-15b320551eae admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.539337 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 800/1599] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:27.540129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34db032-3aea-4491-aba2-15b320551eae admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.549593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34db032-3aea-4491-aba2-15b320551eae admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.554206 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357a935-756d-4ff5-b409-26d93ecfbb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.554832 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357a935-756d-4ff5-b409-26d93ecfbb6a admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.555120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357a935-756d-4ff5-b409-26d93ecfbb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.555390 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357a935-756d-4ff5-b409-26d93ecfbb6a admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.556032 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357a935-756d-4ff5-b409-26d93ecfbb6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.557934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357a935-756d-4ff5-b409-26d93ecfbb6a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.607924 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 800/1600] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:27 2022] PUT /identity/v3/projects/a6f352d7ada9490a83075b7fb59c8cec/users/0130232e2fd44fe09dd82a173da0a12d/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:27.608758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d2d23-729d-4b07-b691-db8552bb87fd admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.635067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 801/1601] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:27 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:27.635067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357a935-756d-4ff5-b409-26d93ecfbb6a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.646272 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357a935-756d-4ff5-b409-26d93ecfbb6a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.672871 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d2d23-729d-4b07-b691-db8552bb87fd admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.678183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ce7b7-511d-4cc0-ae60-c150eba61bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.678810 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ce7b7-511d-4cc0-ae60-c150eba61bdd admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.679094 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ce7b7-511d-4cc0-ae60-c150eba61bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.679426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ce7b7-511d-4cc0-ae60-c150eba61bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.680068 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ce7b7-511d-4cc0-ae60-c150eba61bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.681721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ce7b7-511d-4cc0-ae60-c150eba61bdd admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.692465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 801/1602] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:27.693396 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ce7b7-511d-4cc0-ae60-c150eba61bdd admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.702927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ce7b7-511d-4cc0-ae60-c150eba61bdd admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.707515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81202bcd-5531-4d3f-b4a3-80b14bb95260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.708162 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81202bcd-5531-4d3f-b4a3-80b14bb95260 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.708446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81202bcd-5531-4d3f-b4a3-80b14bb95260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.708722 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81202bcd-5531-4d3f-b4a3-80b14bb95260 admin admin] PATH_INFO: `/v3/projects/bd5e8c19707d491f8c5c75d45f0a0c75/users/3a7b60d360154e5a912b165845acf6b3/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.717480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d80de0-a895-43d4-a960-fcefa2036c10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.718114 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d80de0-a895-43d4-a960-fcefa2036c10 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.718443 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d80de0-a895-43d4-a960-fcefa2036c10 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.718722 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d80de0-a895-43d4-a960-fcefa2036c10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.723401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81202bcd-5531-4d3f-b4a3-80b14bb95260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd5e8c19707d491f8c5c75d45f0a0c75, user_id=3a7b60d360154e5a912b165845acf6b3, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.726113 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81202bcd-5531-4d3f-b4a3-80b14bb95260 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.774968 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d80de0-a895-43d4-a960-fcefa2036c10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.776582 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d80de0-a895-43d4-a960-fcefa2036c10 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.785921 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 802/1603] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:27.786780 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d80de0-a895-43d4-a960-fcefa2036c10 service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.791662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:27.796974 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d80de0-a895-43d4-a960-fcefa2036c10 service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.802330 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b2af6-2ecf-40ee-863c-c4042c48f633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.802932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b2af6-2ecf-40ee-863c-c4042c48f633 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.803220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b2af6-2ecf-40ee-863c-c4042c48f633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.803508 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b2af6-2ecf-40ee-863c-c4042c48f633 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.804213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b2af6-2ecf-40ee-863c-c4042c48f633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.805822 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b2af6-2ecf-40ee-863c-c4042c48f633 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.809711 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 802/1604] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:27 2022] PUT /identity/v3/projects/bd5e8c19707d491f8c5c75d45f0a0c75/users/3a7b60d360154e5a912b165845acf6b3/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:27.810654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81202bcd-5531-4d3f-b4a3-80b14bb95260 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.815345 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:27.817437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 803/1605] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:27.818256 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b2af6-2ecf-40ee-863c-c4042c48f633 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.827897 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b2af6-2ecf-40ee-863c-c4042c48f633 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.880744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81202bcd-5531-4d3f-b4a3-80b14bb95260 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.885551 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdc29a-d751-48cb-bc6b-8a55abc1c978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.886178 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdc29a-d751-48cb-bc6b-8a55abc1c978 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.886458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdc29a-d751-48cb-bc6b-8a55abc1c978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.886733 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdc29a-d751-48cb-bc6b-8a55abc1c978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.887430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdc29a-d751-48cb-bc6b-8a55abc1c978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.888277 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a0bf9-25ac-4bc0-a022-a738db497010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.889080 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a0bf9-25ac-4bc0-a022-a738db497010 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.889186 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdc29a-d751-48cb-bc6b-8a55abc1c978 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.889444 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a0bf9-25ac-4bc0-a022-a738db497010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.889842 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a0bf9-25ac-4bc0-a022-a738db497010 admin admin] PATH_INFO: `/v3/projects/22aa9947fe3246a9b4c35e000dabdfe9/users/399d1cc4c30a4cedbae053d3cf7301fa/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.903554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 803/1606] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:27.907704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fae017-8dbc-4d93-9fa4-73e046784608 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.907704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fae017-8dbc-4d93-9fa4-73e046784608 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.907927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a0bf9-25ac-4bc0-a022-a738db497010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22aa9947fe3246a9b4c35e000dabdfe9, user_id=399d1cc4c30a4cedbae053d3cf7301fa, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.908025 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fae017-8dbc-4d93-9fa4-73e046784608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.908103 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a0bf9-25ac-4bc0-a022-a738db497010 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.924910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e1fae017-8dbc-4d93-9fa4-73e046784608 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:27.926703 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e1fae017-8dbc-4d93-9fa4-73e046784608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:27.934605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 804/1607] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:27.935326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fae017-8dbc-4d93-9fa4-73e046784608 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.945289 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fae017-8dbc-4d93-9fa4-73e046784608 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.950062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ba7b9-c248-4325-b31e-68e99349113f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.950664 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ba7b9-c248-4325-b31e-68e99349113f admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.950946 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ba7b9-c248-4325-b31e-68e99349113f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.951222 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ba7b9-c248-4325-b31e-68e99349113f admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.952037 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ba7b9-c248-4325-b31e-68e99349113f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.953578 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ba7b9-c248-4325-b31e-68e99349113f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:27.963538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 805/1608] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:27.964302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ba7b9-c248-4325-b31e-68e99349113f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:27.973635 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ba7b9-c248-4325-b31e-68e99349113f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:27.978717 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa135ce-fdf9-4f5e-a056-1ebf989dde19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:27.981096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa135ce-fdf9-4f5e-a056-1ebf989dde19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:27.981096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa135ce-fdf9-4f5e-a056-1ebf989dde19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:27.981096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa135ce-fdf9-4f5e-a056-1ebf989dde19 admin admin] PATH_INFO: `/v3/projects/4397f912795a45a685ecbb48a776a64a/users/c44e0e03926d4b3cbcd4ee4e0b0a029f/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:27.995828 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa135ce-fdf9-4f5e-a056-1ebf989dde19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4397f912795a45a685ecbb48a776a64a, user_id=c44e0e03926d4b3cbcd4ee4e0b0a029f, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:27.998682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa135ce-fdf9-4f5e-a056-1ebf989dde19 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:28.007176 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 804/1609] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:27 2022] PUT /identity/v3/projects/22aa9947fe3246a9b4c35e000dabdfe9/users/399d1cc4c30a4cedbae053d3cf7301fa/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:28.008596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20defd3-fd17-4278-b4fd-273c242393b0 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:28.008921 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20defd3-fd17-4278-b4fd-273c242393b0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:28.009196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20defd3-fd17-4278-b4fd-273c242393b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:28.029202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d20defd3-fd17-4278-b4fd-273c242393b0 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:28.030497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d20defd3-fd17-4278-b4fd-273c242393b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:28.089074 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 805/1610] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:28.090026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20defd3-fd17-4278-b4fd-273c242393b0 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:28.100264 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20defd3-fd17-4278-b4fd-273c242393b0 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:28.105200 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 806/1611] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:27 2022] PUT /identity/v3/projects/4397f912795a45a685ecbb48a776a64a/users/c44e0e03926d4b3cbcd4ee4e0b0a029f/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:28.106081 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa135ce-fdf9-4f5e-a056-1ebf989dde19 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:28.170922 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750841e-957f-4093-aacd-a97877782cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:28.171163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa135ce-fdf9-4f5e-a056-1ebf989dde19 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:28.171612 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750841e-957f-4093-aacd-a97877782cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:28.171917 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750841e-957f-4093-aacd-a97877782cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:28.172187 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750841e-957f-4093-aacd-a97877782cb8 admin admin] PATH_INFO: `/v3/projects/0092634549c047ec9936926fec4cee98/users/922506341d4a43c4a5f0cf9f610c4b5f/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:28.176230 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb6605-7cc2-475b-a71e-359a362a4770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:28.176937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb6605-7cc2-475b-a71e-359a362a4770 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:28.177228 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb6605-7cc2-475b-a71e-359a362a4770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:28.177637 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb6605-7cc2-475b-a71e-359a362a4770 admin admin] PATH_INFO: `/v3/projects/1314f77629ff46568dc2fae3b7523cd8/users/de40ffb0666c4b1dbaebc3424931a2d7/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:28.186448 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750841e-957f-4093-aacd-a97877782cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0092634549c047ec9936926fec4cee98, user_id=922506341d4a43c4a5f0cf9f610c4b5f, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:28.189083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750841e-957f-4093-aacd-a97877782cb8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:28.193038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb6605-7cc2-475b-a71e-359a362a4770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1314f77629ff46568dc2fae3b7523cd8, user_id=de40ffb0666c4b1dbaebc3424931a2d7, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:28.195936 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb6605-7cc2-475b-a71e-359a362a4770 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:28.254027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:28.259600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 806/1612] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:28 2022] PUT /identity/v3/projects/0092634549c047ec9936926fec4cee98/users/922506341d4a43c4a5f0cf9f610c4b5f/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:28.260414 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750841e-957f-4093-aacd-a97877782cb8 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:28.294012 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 807/1613] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:28 2022] PUT /identity/v3/projects/1314f77629ff46568dc2fae3b7523cd8/users/de40ffb0666c4b1dbaebc3424931a2d7/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:28.297392 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb6605-7cc2-475b-a71e-359a362a4770 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:28.316457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750841e-957f-4093-aacd-a97877782cb8 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:28.342166 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:28.362568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb6605-7cc2-475b-a71e-359a362a4770 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:28.371114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c3750-7b0b-4c63-afa5-975a04db58c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:28.371275 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf739b-cff9-45fe-826e-8027529db43f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:28.371750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c3750-7b0b-4c63-afa5-975a04db58c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:28.371910 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf739b-cff9-45fe-826e-8027529db43f service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:28.372017 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c3750-7b0b-4c63-afa5-975a04db58c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:28.372295 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c3750-7b0b-4c63-afa5-975a04db58c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:28.372389 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf739b-cff9-45fe-826e-8027529db43f service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:28.372605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf739b-cff9-45fe-826e-8027529db43f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:28.373079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c3750-7b0b-4c63-afa5-975a04db58c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:28.374716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c3750-7b0b-4c63-afa5-975a04db58c9 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:28.382971 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf739b-cff9-45fe-826e-8027529db43f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:28.384419 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf739b-cff9-45fe-826e-8027529db43f service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:28.390133 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 808/1614] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:28.390133 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d9ae1-0b65-4cca-8f00-5b368b73fb7e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:28.390133 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d9ae1-0b65-4cca-8f00-5b368b73fb7e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:28.390133 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d9ae1-0b65-4cca-8f00-5b368b73fb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:28.395995 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 807/1615] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:28.397321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30c89d-5af1-49bb-960b-3415915b1daa None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:28.397615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30c89d-5af1-49bb-960b-3415915b1daa None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:28.397893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30c89d-5af1-49bb-960b-3415915b1daa None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:28.399159 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 808/1616] 10.222.0.75 () {54 vars in 912 bytes} [Thu Jul 28 18:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:05:28.399860 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30c89d-5af1-49bb-960b-3415915b1daa None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:28.411144 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30c89d-5af1-49bb-960b-3415915b1daa None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:28.413136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-bc6d9ae1-0b65-4cca-8f00-5b368b73fb7e None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:28.414358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bc6d9ae1-0b65-4cca-8f00-5b368b73fb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:28.415670 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b9564-3ce6-4b97-85dd-2363a79e4a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:28.416092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b9564-3ce6-4b97-85dd-2363a79e4a73 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:28.416376 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b9564-3ce6-4b97-85dd-2363a79e4a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:28.416654 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b9564-3ce6-4b97-85dd-2363a79e4a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:28.422343 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 809/1617] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:28.423571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced5fbb-2b23-4b2f-9f8f-8c37aec78be1 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:28.423862 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced5fbb-2b23-4b2f-9f8f-8c37aec78be1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:28.424148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced5fbb-2b23-4b2f-9f8f-8c37aec78be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:28.433260 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b9564-3ce6-4b97-85dd-2363a79e4a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:28.434768 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b9564-3ce6-4b97-85dd-2363a79e4a73 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:28.446025 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 809/1618] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:28.446934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5c19d-9f0a-40b3-9832-124057f179d8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:28.447225 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5c19d-9f0a-40b3-9832-124057f179d8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:28.447501 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5c19d-9f0a-40b3-9832-124057f179d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:28.454132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-3ced5fbb-2b23-4b2f-9f8f-8c37aec78be1 None None] MFA Rules not processed for user `c44e0e03926d4b3cbcd4ee4e0b0a029f`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:28.455460 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3ced5fbb-2b23-4b2f-9f8f-8c37aec78be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:28.468737 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-5fa5c19d-9f0a-40b3-9832-124057f179d8 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:28.470212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5fa5c19d-9f0a-40b3-9832-124057f179d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:28.481719 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 810/1619] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:28.481719 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eecff8-4740-49c8-aab8-9015850ad31a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:28.481719 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eecff8-4740-49c8-aab8-9015850ad31a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:28.481719 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eecff8-4740-49c8-aab8-9015850ad31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:28.519734 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-83eecff8-4740-49c8-aab8-9015850ad31a None None] MFA Rules not processed for user `de40ffb0666c4b1dbaebc3424931a2d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:28.521367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-83eecff8-4740-49c8-aab8-9015850ad31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:28.552559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 810/1620] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:28.552559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced5fbb-2b23-4b2f-9f8f-8c37aec78be1 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:28.561058 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced5fbb-2b23-4b2f-9f8f-8c37aec78be1 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:28.566143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa7748-4978-4c52-bd8b-f84be649bfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:28.566831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa7748-4978-4c52-bd8b-f84be649bfd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:28.567129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa7748-4978-4c52-bd8b-f84be649bfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:28.567404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa7748-4978-4c52-bd8b-f84be649bfd2 admin admin] PATH_INFO: `/v3/projects/0e56de69b6ea449f9f1855db4be0240f/users/f5f49b5b4f8a4bd69bb43460d90ff1da/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:28.587365 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa7748-4978-4c52-bd8b-f84be649bfd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e56de69b6ea449f9f1855db4be0240f, user_id=f5f49b5b4f8a4bd69bb43460d90ff1da, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:28.590421 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa7748-4978-4c52-bd8b-f84be649bfd2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:28.607351 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 811/1621] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:28.608642 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fad197-98b0-4c74-91c0-3094f48c63a1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:28.608963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fad197-98b0-4c74-91c0-3094f48c63a1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:28.609242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fad197-98b0-4c74-91c0-3094f48c63a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:28.629340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c0fad197-98b0-4c74-91c0-3094f48c63a1 None None] MFA Rules not processed for user `c456a787159844feb7eabfd1e527e46e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:28.630585 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c0fad197-98b0-4c74-91c0-3094f48c63a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:28.651914 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:28.699464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 812/1622] 10.222.0.75 () {58 vars in 1009 bytes} [Thu Jul 28 18:05:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:28.700397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fad197-98b0-4c74-91c0-3094f48c63a1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:28.701796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c0fad197-98b0-4c74-91c0-3094f48c63a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:28.715583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fad197-98b0-4c74-91c0-3094f48c63a1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:28.719607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e065dc-1fa1-4cb4-859e-62c2d5767e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:28.723676 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e065dc-1fa1-4cb4-859e-62c2d5767e78 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:28.723676 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e065dc-1fa1-4cb4-859e-62c2d5767e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:28.723676 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e065dc-1fa1-4cb4-859e-62c2d5767e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:28.730594 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 811/1623] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:28 2022] PUT /identity/v3/projects/0e56de69b6ea449f9f1855db4be0240f/users/f5f49b5b4f8a4bd69bb43460d90ff1da/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:28.731715 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa7748-4978-4c52-bd8b-f84be649bfd2 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:28.733148 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e065dc-1fa1-4cb4-859e-62c2d5767e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:28.734769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e065dc-1fa1-4cb4-859e-62c2d5767e78 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:28.745451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 813/1624] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:28.746766 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e065dc-1fa1-4cb4-859e-62c2d5767e78 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:28.800898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa7748-4978-4c52-bd8b-f84be649bfd2 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:28.807762 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53fb6c-59f0-419c-a91a-646f8c9344bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:28.808571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53fb6c-59f0-419c-a91a-646f8c9344bb service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:28.808984 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53fb6c-59f0-419c-a91a-646f8c9344bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:28.809359 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53fb6c-59f0-419c-a91a-646f8c9344bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:28.833078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e065dc-1fa1-4cb4-859e-62c2d5767e78 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:28.866595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:28.885839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53fb6c-59f0-419c-a91a-646f8c9344bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:28.890144 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53fb6c-59f0-419c-a91a-646f8c9344bb service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:28.902344 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 812/1625] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:28.903613 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53fb6c-59f0-419c-a91a-646f8c9344bb service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:28.910835 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134766f9-0ff6-4d36-bdf5-aa9d2ddd3db6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:28.911648 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134766f9-0ff6-4d36-bdf5-aa9d2ddd3db6 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:28.911992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134766f9-0ff6-4d36-bdf5-aa9d2ddd3db6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:28.912957 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134766f9-0ff6-4d36-bdf5-aa9d2ddd3db6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:28.917778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53fb6c-59f0-419c-a91a-646f8c9344bb service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:28.924887 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2a6d2-23c7-4180-b599-a4a80aae6bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:28.926001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2a6d2-23c7-4180-b599-a4a80aae6bcc admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:28.927047 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2a6d2-23c7-4180-b599-a4a80aae6bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:28.927525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2a6d2-23c7-4180-b599-a4a80aae6bcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:28.928655 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2a6d2-23c7-4180-b599-a4a80aae6bcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:28.931774 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2a6d2-23c7-4180-b599-a4a80aae6bcc admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:28.982216 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134766f9-0ff6-4d36-bdf5-aa9d2ddd3db6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:28.983762 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134766f9-0ff6-4d36-bdf5-aa9d2ddd3db6 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:28.994633 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 814/1626] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:28.995408 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134766f9-0ff6-4d36-bdf5-aa9d2ddd3db6 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:29.009370 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134766f9-0ff6-4d36-bdf5-aa9d2ddd3db6 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:29.012028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbfa73-4958-4e62-a893-8eaa95a3a9c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:29.012738 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbfa73-4958-4e62-a893-8eaa95a3a9c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:29.013281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbfa73-4958-4e62-a893-8eaa95a3a9c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:29.013618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbfa73-4958-4e62-a893-8eaa95a3a9c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:29.029648 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:29.044790 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 813/1627] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:28 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:29.046672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d723f7-eadc-4c8b-a47b-1e7a4cd54ca3 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:29.047038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d723f7-eadc-4c8b-a47b-1e7a4cd54ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:29.047719 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d723f7-eadc-4c8b-a47b-1e7a4cd54ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:29.079821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b9d723f7-eadc-4c8b-a47b-1e7a4cd54ca3 None None] MFA Rules not processed for user `f5f49b5b4f8a4bd69bb43460d90ff1da`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:29.081281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b9d723f7-eadc-4c8b-a47b-1e7a4cd54ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:29.132545 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbfa73-4958-4e62-a893-8eaa95a3a9c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:29.134035 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbfa73-4958-4e62-a893-8eaa95a3a9c0 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:29.163021 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 815/1628] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:29.163976 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbfa73-4958-4e62-a893-8eaa95a3a9c0 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:29.183562 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbfa73-4958-4e62-a893-8eaa95a3a9c0 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:29.233181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 814/1629] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:29.239685 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d723f7-eadc-4c8b-a47b-1e7a4cd54ca3 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:29.351557 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2da226-8f1f-42ae-9277-0fb43b25ea1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:29.352234 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2da226-8f1f-42ae-9277-0fb43b25ea1a admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:29.352510 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2da226-8f1f-42ae-9277-0fb43b25ea1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:29.352812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2da226-8f1f-42ae-9277-0fb43b25ea1a admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:29.353740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2da226-8f1f-42ae-9277-0fb43b25ea1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:29.357745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2da226-8f1f-42ae-9277-0fb43b25ea1a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:29.431953 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d723f7-eadc-4c8b-a47b-1e7a4cd54ca3 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:29.436616 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942115f4-ecfe-4f4a-aa69-e773033afc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:29.437281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942115f4-ecfe-4f4a-aa69-e773033afc40 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:29.437565 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942115f4-ecfe-4f4a-aa69-e773033afc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:29.437843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942115f4-ecfe-4f4a-aa69-e773033afc40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:29.438517 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942115f4-ecfe-4f4a-aa69-e773033afc40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:29.440650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942115f4-ecfe-4f4a-aa69-e773033afc40 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:29.639470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 815/1630] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:29 2022] POST /identity/v3/projects => generated 377 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:05:29.643709 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942115f4-ecfe-4f4a-aa69-e773033afc40 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:29.648981 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 816/1631] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:29 2022] POST /identity/v3/users => generated 297 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:29.662434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2da226-8f1f-42ae-9277-0fb43b25ea1a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:29.683233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2da226-8f1f-42ae-9277-0fb43b25ea1a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:29.795277 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:29.798200 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942115f4-ecfe-4f4a-aa69-e773033afc40 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:29.811607 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a646ec1-f88f-4d84-9725-33b332d3bc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:29.813853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a646ec1-f88f-4d84-9725-33b332d3bc96 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:29.814362 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc174dd4-9118-4e74-b4b5-926bffd96e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:29.814736 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a646ec1-f88f-4d84-9725-33b332d3bc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:29.815144 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a646ec1-f88f-4d84-9725-33b332d3bc96 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:29.815420 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc174dd4-9118-4e74-b4b5-926bffd96e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:29.816359 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc174dd4-9118-4e74-b4b5-926bffd96e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:29.816838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc174dd4-9118-4e74-b4b5-926bffd96e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:29.818036 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc174dd4-9118-4e74-b4b5-926bffd96e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:29.818665 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a646ec1-f88f-4d84-9725-33b332d3bc96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:29.820325 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc174dd4-9118-4e74-b4b5-926bffd96e40 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:29.821388 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a646ec1-f88f-4d84-9725-33b332d3bc96 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:29.847975 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 817/1632] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:29.849590 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc174dd4-9118-4e74-b4b5-926bffd96e40 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:29.870320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc174dd4-9118-4e74-b4b5-926bffd96e40 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:29.882662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f585a4-4616-42f0-b1c9-d8a06cec6c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:29.883596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f585a4-4616-42f0-b1c9-d8a06cec6c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:29.884147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f585a4-4616-42f0-b1c9-d8a06cec6c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:29.884591 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f585a4-4616-42f0-b1c9-d8a06cec6c76 admin admin] PATH_INFO: `/v3/projects/6b2c61d27381459eaf9ef494607083f9/users/76339aef8bfc46c489101b530113ee89/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:29.903014 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f585a4-4616-42f0-b1c9-d8a06cec6c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2c61d27381459eaf9ef494607083f9, user_id=76339aef8bfc46c489101b530113ee89, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:29.906063 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f585a4-4616-42f0-b1c9-d8a06cec6c76 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:29.932060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 816/1633] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:29 2022] POST /identity/v3/users => generated 295 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:29.933193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a646ec1-f88f-4d84-9725-33b332d3bc96 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:29.943893 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a646ec1-f88f-4d84-9725-33b332d3bc96 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:29.948821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e0bc6-ac61-4a81-90d1-2c0444edb6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:29.949115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e0bc6-ac61-4a81-90d1-2c0444edb6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:29.949416 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e0bc6-ac61-4a81-90d1-2c0444edb6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:29.949679 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e0bc6-ac61-4a81-90d1-2c0444edb6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:29.950390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e0bc6-ac61-4a81-90d1-2c0444edb6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:29.952026 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e0bc6-ac61-4a81-90d1-2c0444edb6d8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:29.963125 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 817/1634] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:29.967466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e0bc6-ac61-4a81-90d1-2c0444edb6d8 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:29.977797 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e0bc6-ac61-4a81-90d1-2c0444edb6d8 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:29.982485 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e5037-f278-406d-a004-a9e097732ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:29.983170 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e5037-f278-406d-a004-a9e097732ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:29.983452 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e5037-f278-406d-a004-a9e097732ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:29.989502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e5037-f278-406d-a004-a9e097732ffc admin admin] PATH_INFO: `/v3/projects/4f428cc514e6493db161c16902ebe406/users/ab7cafee13a8494a95f1c43aa2fe11e2/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:29.999622 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e5037-f278-406d-a004-a9e097732ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f428cc514e6493db161c16902ebe406, user_id=ab7cafee13a8494a95f1c43aa2fe11e2, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:30.002361 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e5037-f278-406d-a004-a9e097732ffc admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:30.076454 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 818/1635] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:29 2022] PUT /identity/v3/projects/6b2c61d27381459eaf9ef494607083f9/users/76339aef8bfc46c489101b530113ee89/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:30.078042 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f585a4-4616-42f0-b1c9-d8a06cec6c76 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:30.091960 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:30.181028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 818/1636] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:29 2022] PUT /identity/v3/projects/4f428cc514e6493db161c16902ebe406/users/ab7cafee13a8494a95f1c43aa2fe11e2/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:05:30.182473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e5037-f278-406d-a004-a9e097732ffc admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:30.206523 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f585a4-4616-42f0-b1c9-d8a06cec6c76 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:30.269824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e5037-f278-406d-a004-a9e097732ffc admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:30.286621 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afcba9-c3bb-4b73-844c-e1cee9a90890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:30.287741 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afcba9-c3bb-4b73-844c-e1cee9a90890 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:30.288153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afcba9-c3bb-4b73-844c-e1cee9a90890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:30.289650 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afcba9-c3bb-4b73-844c-e1cee9a90890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:30.290630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afcba9-c3bb-4b73-844c-e1cee9a90890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:30.292130 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448917d2-5d01-435d-851e-624a77a31802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:30.292738 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afcba9-c3bb-4b73-844c-e1cee9a90890 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:30.292916 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448917d2-5d01-435d-851e-624a77a31802 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:30.293081 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448917d2-5d01-435d-851e-624a77a31802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:30.293361 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448917d2-5d01-435d-851e-624a77a31802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:30.294404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448917d2-5d01-435d-851e-624a77a31802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:30.296328 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448917d2-5d01-435d-851e-624a77a31802 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:30.308218 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 819/1637] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:30.308414 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 819/1638] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:30.312848 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448917d2-5d01-435d-851e-624a77a31802 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:30.312993 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afcba9-c3bb-4b73-844c-e1cee9a90890 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:30.324001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afcba9-c3bb-4b73-844c-e1cee9a90890 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:30.324313 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448917d2-5d01-435d-851e-624a77a31802 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:30.330142 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538e571-3e50-4aa8-ad60-757fae6de9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:30.337374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538e571-3e50-4aa8-ad60-757fae6de9bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:30.337374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538e571-3e50-4aa8-ad60-757fae6de9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:30.338534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538e571-3e50-4aa8-ad60-757fae6de9bb admin admin] PATH_INFO: `/v3/projects/4f428cc514e6493db161c16902ebe406/users/ab7cafee13a8494a95f1c43aa2fe11e2/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:30.341535 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cae80-66f5-41a5-986b-c4d40aa24af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:30.344724 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538e571-3e50-4aa8-ad60-757fae6de9bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f428cc514e6493db161c16902ebe406, user_id=ab7cafee13a8494a95f1c43aa2fe11e2, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:30.345726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cae80-66f5-41a5-986b-c4d40aa24af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:30.346182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cae80-66f5-41a5-986b-c4d40aa24af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:30.346571 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cae80-66f5-41a5-986b-c4d40aa24af4 admin admin] PATH_INFO: `/v3/projects/6b2c61d27381459eaf9ef494607083f9/users/76339aef8bfc46c489101b530113ee89/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:30.350520 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538e571-3e50-4aa8-ad60-757fae6de9bb admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:30.351559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cae80-66f5-41a5-986b-c4d40aa24af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2c61d27381459eaf9ef494607083f9, user_id=76339aef8bfc46c489101b530113ee89, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:30.354468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cae80-66f5-41a5-986b-c4d40aa24af4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:30.388900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 820/1639] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:30 2022] PUT /identity/v3/projects/4f428cc514e6493db161c16902ebe406/users/ab7cafee13a8494a95f1c43aa2fe11e2/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:30.389142 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 820/1640] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:30 2022] PUT /identity/v3/projects/6b2c61d27381459eaf9ef494607083f9/users/76339aef8bfc46c489101b530113ee89/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:30.394198 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b43e1-176d-4a5b-b584-26b331168bad None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:30.394664 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b43e1-176d-4a5b-b584-26b331168bad None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:30.395042 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b43e1-176d-4a5b-b584-26b331168bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:30.410103 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525a778-5646-4817-95a3-1eca403be84e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:30.412326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525a778-5646-4817-95a3-1eca403be84e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:30.412326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525a778-5646-4817-95a3-1eca403be84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:30.701464 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-7b2b43e1-176d-4a5b-b584-26b331168bad None None] MFA Rules not processed for user `ab7cafee13a8494a95f1c43aa2fe11e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:30.701464 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7b2b43e1-176d-4a5b-b584-26b331168bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:30.703050 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a525a778-5646-4817-95a3-1eca403be84e None None] MFA Rules not processed for user `76339aef8bfc46c489101b530113ee89`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:30.703050 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a525a778-5646-4817-95a3-1eca403be84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:30.704403 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 821/1641] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:05:30.704403 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b43e1-176d-4a5b-b584-26b331168bad None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:30.705232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 821/1642] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:30.723328 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b43e1-176d-4a5b-b584-26b331168bad None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:30.727867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758cec5-4761-4a46-84ea-6a2cb467edf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:30.728634 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758cec5-4761-4a46-84ea-6a2cb467edf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:30.729060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758cec5-4761-4a46-84ea-6a2cb467edf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:30.729362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758cec5-4761-4a46-84ea-6a2cb467edf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:30.793469 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758cec5-4761-4a46-84ea-6a2cb467edf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:30.794965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758cec5-4761-4a46-84ea-6a2cb467edf4 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:30.820779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 822/1643] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:05:30.883817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525a778-5646-4817-95a3-1eca403be84e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:30.899959 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525a778-5646-4817-95a3-1eca403be84e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:30.905270 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7497ad-d797-446d-8bf8-c1b90e17e79f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:30.910884 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7497ad-d797-446d-8bf8-c1b90e17e79f service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:30.910884 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7497ad-d797-446d-8bf8-c1b90e17e79f service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:30.910884 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7497ad-d797-446d-8bf8-c1b90e17e79f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:30.923288 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7497ad-d797-446d-8bf8-c1b90e17e79f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:30.927610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7497ad-d797-446d-8bf8-c1b90e17e79f service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:30.952159 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 822/1644] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:31.403599 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758cec5-4761-4a46-84ea-6a2cb467edf4 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:31.412713 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758cec5-4761-4a46-84ea-6a2cb467edf4 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:31.433507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffda04b-9e81-4d90-b009-256d96b4a779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:31.434178 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffda04b-9e81-4d90-b009-256d96b4a779 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:31.434472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffda04b-9e81-4d90-b009-256d96b4a779 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:31.434806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffda04b-9e81-4d90-b009-256d96b4a779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:31.567119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:31.573980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894d80e-d4bb-4e98-b542-b78ab36df752 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:31.574625 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894d80e-d4bb-4e98-b542-b78ab36df752 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:31.574625 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894d80e-d4bb-4e98-b542-b78ab36df752 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:31.576478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 823/1645] 10.222.0.75 () {54 vars in 962 bytes} [Thu Jul 28 18:05:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 18:05:31.581929 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffda04b-9e81-4d90-b009-256d96b4a779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:31.583803 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffda04b-9e81-4d90-b009-256d96b4a779 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:31.599589 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 823/1646] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:31.603641 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f70d7f-f237-4d8d-858a-46ad4a9ca006 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:31.607597 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f70d7f-f237-4d8d-858a-46ad4a9ca006 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:31.607987 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f70d7f-f237-4d8d-858a-46ad4a9ca006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:31.659301 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-02f70d7f-f237-4d8d-858a-46ad4a9ca006 None None] MFA Rules not processed for user `c456a787159844feb7eabfd1e527e46e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:31.660715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-02f70d7f-f237-4d8d-858a-46ad4a9ca006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:31.838329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:31.843934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 824/1647] 10.222.0.75 () {58 vars in 1059 bytes} [Thu Jul 28 18:05:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:05:31.851187 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420be68-1063-4ee0-963b-3f48ef5a60a2 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:31.851475 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420be68-1063-4ee0-963b-3f48ef5a60a2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:31.851754 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420be68-1063-4ee0-963b-3f48ef5a60a2 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:31.853973 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 824/1648] 10.222.0.75 () {54 vars in 912 bytes} [Thu Jul 28 18:05:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:05:31.860735 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20fe7d-31b4-4e37-b84d-70ec6453fa5d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:31.873154 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20fe7d-31b4-4e37-b84d-70ec6453fa5d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:31.873154 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20fe7d-31b4-4e37-b84d-70ec6453fa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:31.928258 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-af20fe7d-31b4-4e37-b84d-70ec6453fa5d None None] MFA Rules not processed for user `c456a787159844feb7eabfd1e527e46e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:31.929577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-af20fe7d-31b4-4e37-b84d-70ec6453fa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:31.971195 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 825/1649] 10.222.0.75 () {58 vars in 1009 bytes} [Thu Jul 28 18:05:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:31.978522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420be68-1063-4ee0-963b-3f48ef5a60a2 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:31.997434 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420be68-1063-4ee0-963b-3f48ef5a60a2 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:32.008103 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8a357-f46f-44a7-b2a6-8f33823ca8b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:32.008793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8a357-f46f-44a7-b2a6-8f33823ca8b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:32.009129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8a357-f46f-44a7-b2a6-8f33823ca8b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:32.009413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8a357-f46f-44a7-b2a6-8f33823ca8b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:32.034859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8a357-f46f-44a7-b2a6-8f33823ca8b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:32.037533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8a357-f46f-44a7-b2a6-8f33823ca8b7 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:32.068807 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 825/1650] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:34.746606 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20fe7d-31b4-4e37-b84d-70ec6453fa5d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:34.788110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20fe7d-31b4-4e37-b84d-70ec6453fa5d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:34.796026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fac9f7-b82b-498f-aabe-6fabbc910c8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:34.797615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fac9f7-b82b-498f-aabe-6fabbc910c8f service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:34.797806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fac9f7-b82b-498f-aabe-6fabbc910c8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:34.799013 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fac9f7-b82b-498f-aabe-6fabbc910c8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:34.828039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fac9f7-b82b-498f-aabe-6fabbc910c8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:34.835138 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fac9f7-b82b-498f-aabe-6fabbc910c8f service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:34.870205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 826/1651] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:39.927338 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57de86-5144-43c0-81b9-066b80532a5e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:39.928202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57de86-5144-43c0-81b9-066b80532a5e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:39.929192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57de86-5144-43c0-81b9-066b80532a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:39.972375 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6e57de86-5144-43c0-81b9-066b80532a5e None None] MFA Rules not processed for user `3a7b60d360154e5a912b165845acf6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:39.984780 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6e57de86-5144-43c0-81b9-066b80532a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:40.027977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:40.135437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333bd78-377e-4447-be98-6598536a920a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:40.135437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333bd78-377e-4447-be98-6598536a920a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:40.135437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333bd78-377e-4447-be98-6598536a920a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:40.136381 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 826/1652] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:40.166191 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e333bd78-377e-4447-be98-6598536a920a None None] MFA Rules not processed for user `3a7b60d360154e5a912b165845acf6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:40.173147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e333bd78-377e-4447-be98-6598536a920a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:40.191477 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 827/1653] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:40.211960 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57de86-5144-43c0-81b9-066b80532a5e None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:40.270682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57de86-5144-43c0-81b9-066b80532a5e None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:40.311455 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab927a88-41c7-4987-b437-b840b6b52818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:40.313670 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab927a88-41c7-4987-b437-b840b6b52818 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:40.314194 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab927a88-41c7-4987-b437-b840b6b52818 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:40.314501 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab927a88-41c7-4987-b437-b840b6b52818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:40.341937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab927a88-41c7-4987-b437-b840b6b52818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:40.349446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab927a88-41c7-4987-b437-b840b6b52818 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:40.391882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 827/1654] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:41.599394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20960651-8e22-410e-8a28-c8d3da880651 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:41.600785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20960651-8e22-410e-8a28-c8d3da880651 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:41.601230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20960651-8e22-410e-8a28-c8d3da880651 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:41.603449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 828/1655] 10.222.0.75 () {54 vars in 912 bytes} [Thu Jul 28 18:05:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:05:41.610021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e004fe4-4afb-488f-9bd4-0511feacaf54 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:41.616214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e004fe4-4afb-488f-9bd4-0511feacaf54 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:41.616214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e004fe4-4afb-488f-9bd4-0511feacaf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:41.780589 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-7e004fe4-4afb-488f-9bd4-0511feacaf54 None None] MFA Rules not processed for user `d0e56603b8704cb2b5587313c67254a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:41.785751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7e004fe4-4afb-488f-9bd4-0511feacaf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:42.005607 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 828/1656] 10.222.0.75 () {58 vars in 1009 bytes} [Thu Jul 28 18:05:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:42.044249 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20960651-8e22-410e-8a28-c8d3da880651 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:42.064624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20960651-8e22-410e-8a28-c8d3da880651 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:42.079168 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e21ab5-6e13-4f74-8a37-231b28c7ed14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:42.080625 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e21ab5-6e13-4f74-8a37-231b28c7ed14 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:42.084961 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e21ab5-6e13-4f74-8a37-231b28c7ed14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:42.087146 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e21ab5-6e13-4f74-8a37-231b28c7ed14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:42.119902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e004fe4-4afb-488f-9bd4-0511feacaf54 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:42.124934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e21ab5-6e13-4f74-8a37-231b28c7ed14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:42.126485 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e21ab5-6e13-4f74-8a37-231b28c7ed14 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:42.174742 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 829/1657] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:42.288301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e004fe4-4afb-488f-9bd4-0511feacaf54 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:42.298165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab1c5c-b904-4a90-8a45-bd1f58c37d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:42.298855 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab1c5c-b904-4a90-8a45-bd1f58c37d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:42.299158 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab1c5c-b904-4a90-8a45-bd1f58c37d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:42.299420 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab1c5c-b904-4a90-8a45-bd1f58c37d3d admin admin] PATH_INFO: `/v3/users/a588ed9a46314250b09a209a36ef203d` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:42.300683 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab1c5c-b904-4a90-8a45-bd1f58c37d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a588ed9a46314250b09a209a36ef203d)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:42.303192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab1c5c-b904-4a90-8a45-bd1f58c37d3d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:42.561614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-93ab1c5c-b904-4a90-8a45-bd1f58c37d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a588ed9a46314250b09a209a36ef203d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:42.670392 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-93ab1c5c-b904-4a90-8a45-bd1f58c37d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a588ed9a46314250b09a209a36ef203d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:42.672263 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:42.725276 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-93ab1c5c-b904-4a90-8a45-bd1f58c37d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a588ed9a46314250b09a209a36ef203d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:42.751960 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-93ab1c5c-b904-4a90-8a45-bd1f58c37d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a588ed9a46314250b09a209a36ef203d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:42.756183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-93ab1c5c-b904-4a90-8a45-bd1f58c37d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a588ed9a46314250b09a209a36ef203d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:42.789537 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 829/1658] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:05:42 2022] DELETE /identity/v3/users/a588ed9a46314250b09a209a36ef203d => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:42.795847 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8b64f-45e9-4121-88d9-1df7aa9294ae None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:42.796743 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8b64f-45e9-4121-88d9-1df7aa9294ae None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:42.797221 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8b64f-45e9-4121-88d9-1df7aa9294ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:42.874010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-bbd8b64f-45e9-4121-88d9-1df7aa9294ae None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:42.875246 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bbd8b64f-45e9-4121-88d9-1df7aa9294ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:42.936689 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdb6bf-390e-487d-a3a1-cd9d53a6c4f3 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:42.938384 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdb6bf-390e-487d-a3a1-cd9d53a6c4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:42.938882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdb6bf-390e-487d-a3a1-cd9d53a6c4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:43.014096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b1fdb6bf-390e-487d-a3a1-cd9d53a6c4f3 None None] MFA Rules not processed for user `399d1cc4c30a4cedbae053d3cf7301fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:43.027859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b1fdb6bf-390e-487d-a3a1-cd9d53a6c4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:43.150315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 830/1659] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:43.173237 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8b64f-45e9-4121-88d9-1df7aa9294ae None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:43.174879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bbd8b64f-45e9-4121-88d9-1df7aa9294ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:43.223704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 830/1660] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:43.229594 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdb6bf-390e-487d-a3a1-cd9d53a6c4f3 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:43.239073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b1fdb6bf-390e-487d-a3a1-cd9d53a6c4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:43.321079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdb6bf-390e-487d-a3a1-cd9d53a6c4f3 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:43.337222 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e548f3d-b079-4018-a622-dc6d1bf0f133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:43.338468 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e548f3d-b079-4018-a622-dc6d1bf0f133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:43.341461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e548f3d-b079-4018-a622-dc6d1bf0f133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:43.341884 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e548f3d-b079-4018-a622-dc6d1bf0f133 admin admin] PATH_INFO: `/v3/users/f5f49b5b4f8a4bd69bb43460d90ff1da` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:43.343419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e548f3d-b079-4018-a622-dc6d1bf0f133 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f49b5b4f8a4bd69bb43460d90ff1da)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:43.353189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e548f3d-b079-4018-a622-dc6d1bf0f133 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:43.413989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8b64f-45e9-4121-88d9-1df7aa9294ae None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:43.433133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48e06f-ad8c-4298-b906-4d59e9f8d091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:43.433787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48e06f-ad8c-4298-b906-4d59e9f8d091 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:43.434073 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48e06f-ad8c-4298-b906-4d59e9f8d091 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:43.434356 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48e06f-ad8c-4298-b906-4d59e9f8d091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:43.457989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48e06f-ad8c-4298-b906-4d59e9f8d091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:43.459587 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48e06f-ad8c-4298-b906-4d59e9f8d091 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:43.471387 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:43.491551 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 831/1661] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:05:43.492668 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48e06f-ad8c-4298-b906-4d59e9f8d091 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:43.496244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ae48e06f-ad8c-4298-b906-4d59e9f8d091 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:43.641031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5e548f3d-b079-4018-a622-dc6d1bf0f133 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f49b5b4f8a4bd69bb43460d90ff1da'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:43.727467 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48e06f-ad8c-4298-b906-4d59e9f8d091 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:43.744315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6ea37-37ee-4440-afc9-219bef2a6fd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:43.745057 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5e548f3d-b079-4018-a622-dc6d1bf0f133 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f49b5b4f8a4bd69bb43460d90ff1da'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:43.748833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6ea37-37ee-4440-afc9-219bef2a6fd8 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:43.749340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6ea37-37ee-4440-afc9-219bef2a6fd8 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:43.752024 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6ea37-37ee-4440-afc9-219bef2a6fd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:43.764981 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5e548f3d-b079-4018-a622-dc6d1bf0f133 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f49b5b4f8a4bd69bb43460d90ff1da'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:43.769512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6ea37-37ee-4440-afc9-219bef2a6fd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:43.776792 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6ea37-37ee-4440-afc9-219bef2a6fd8 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:43.793626 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5e548f3d-b079-4018-a622-dc6d1bf0f133 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f49b5b4f8a4bd69bb43460d90ff1da'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:43.795748 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5e548f3d-b079-4018-a622-dc6d1bf0f133 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f49b5b4f8a4bd69bb43460d90ff1da'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:43.809455 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 831/1662] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:05:43 2022] DELETE /identity/v3/users/f5f49b5b4f8a4bd69bb43460d90ff1da => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:05:43.811459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca779bba-0a38-4193-b2af-1a00663850a4 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:43.812155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca779bba-0a38-4193-b2af-1a00663850a4 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:43.812638 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca779bba-0a38-4193-b2af-1a00663850a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:43.828200 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 832/1663] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:43.874860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-ca779bba-0a38-4193-b2af-1a00663850a4 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:43.882333 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ca779bba-0a38-4193-b2af-1a00663850a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:44.131020 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 832/1664] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:05:44.210234 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6ea37-37ee-4440-afc9-219bef2a6fd8 service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:44.221202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6ea37-37ee-4440-afc9-219bef2a6fd8 service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:44.444984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3ae5a-6e1a-4252-8383-413693b1186f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:44.445607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3ae5a-6e1a-4252-8383-413693b1186f service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:44.446110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3ae5a-6e1a-4252-8383-413693b1186f service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:44.446908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3ae5a-6e1a-4252-8383-413693b1186f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:44.466937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:44.510329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e3ae5a-6e1a-4252-8383-413693b1186f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:44.514042 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e3ae5a-6e1a-4252-8383-413693b1186f service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:44.565712 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 833/1665] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:44.669013 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160080ca-b284-4a79-b837-2560145274d5 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:44.669240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160080ca-b284-4a79-b837-2560145274d5 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:44.669552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160080ca-b284-4a79-b837-2560145274d5 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:44.671631 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 833/1666] 10.222.0.75 () {54 vars in 961 bytes} [Thu Jul 28 18:05:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:05:44.678505 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f2d53-cb1e-4593-b619-a01bd37ec7c4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:44.679204 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f2d53-cb1e-4593-b619-a01bd37ec7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:44.679592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f2d53-cb1e-4593-b619-a01bd37ec7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:44.760782 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ca3f2d53-cb1e-4593-b619-a01bd37ec7c4 None None] MFA Rules not processed for user `cff43a72eaef462f86426ad3ceccd3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:44.764534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ca3f2d53-cb1e-4593-b619-a01bd37ec7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:44.932906 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 834/1667] 10.222.0.75 () {58 vars in 1058 bytes} [Thu Jul 28 18:05:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:05:44.941644 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160080ca-b284-4a79-b837-2560145274d5 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:44.973916 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160080ca-b284-4a79-b837-2560145274d5 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:44.977285 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a2473-b15c-40fe-957a-4c68b154ca51 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:44.977584 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a2473-b15c-40fe-957a-4c68b154ca51 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:44.978080 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a2473-b15c-40fe-957a-4c68b154ca51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:44.981712 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947a3a2-2d80-458a-ace0-1ce3e0015fea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff43a72eaef462f86426ad3ceccd3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:44.982508 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947a3a2-2d80-458a-ace0-1ce3e0015fea service placement] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:44.982798 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947a3a2-2d80-458a-ace0-1ce3e0015fea service placement] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:44.983133 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947a3a2-2d80-458a-ace0-1ce3e0015fea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:44.985602 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d947a3a2-2d80-458a-ace0-1ce3e0015fea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:45.004687 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947a3a2-2d80-458a-ace0-1ce3e0015fea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:45.007190 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947a3a2-2d80-458a-ace0-1ce3e0015fea service placement] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:45.021695 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 834/1668] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:45.024834 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f82a2473-b15c-40fe-957a-4c68b154ca51 None None] MFA Rules not processed for user `0130232e2fd44fe09dd82a173da0a12d`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:45.026241 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f82a2473-b15c-40fe-957a-4c68b154ca51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:45.045379 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:45.174882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947a3a2-2d80-458a-ace0-1ce3e0015fea service placement] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:45.180563 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 835/1669] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:45.181425 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d947a3a2-2d80-458a-ace0-1ce3e0015fea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:45.195395 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a2473-b15c-40fe-957a-4c68b154ca51 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:45.197339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f82a2473-b15c-40fe-957a-4c68b154ca51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:45.212439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947a3a2-2d80-458a-ace0-1ce3e0015fea service placement] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:45.224088 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab56c7-dcc6-4758-bd95-d202764a8e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:45.224889 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab56c7-dcc6-4758-bd95-d202764a8e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:45.226018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab56c7-dcc6-4758-bd95-d202764a8e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:45.226368 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab56c7-dcc6-4758-bd95-d202764a8e00 admin admin] PATH_INFO: `/v3/projects/178d04fd1e3347b8905099b33307adb0` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:45.227734 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab56c7-dcc6-4758-bd95-d202764a8e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=178d04fd1e3347b8905099b33307adb0)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:45.229788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: WARNING py.warnings [None req-d4ab56c7-dcc6-4758-bd95-d202764a8e00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:05:45.229788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: warnings.warn(msg) Jul 28 18:05:45.229788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: Jul 28 18:05:45.231730 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab56c7-dcc6-4758-bd95-d202764a8e00 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:45.379487 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a2473-b15c-40fe-957a-4c68b154ca51 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:45.410194 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d4ab56c7-dcc6-4758-bd95-d202764a8e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '178d04fd1e3347b8905099b33307adb0', 'request_id': 'req-d4ab56c7-dcc6-4758-bd95-d202764a8e00'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:45.522082 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f27a5-3205-4b7d-8b9b-7648c795635b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:45.522862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f27a5-3205-4b7d-8b9b-7648c795635b service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:45.523213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f27a5-3205-4b7d-8b9b-7648c795635b service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:45.523615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f27a5-3205-4b7d-8b9b-7648c795635b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:45.574429 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d4ab56c7-dcc6-4758-bd95-d202764a8e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '178d04fd1e3347b8905099b33307adb0', 'request_id': 'req-d4ab56c7-dcc6-4758-bd95-d202764a8e00'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:45.605676 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d4ab56c7-dcc6-4758-bd95-d202764a8e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '178d04fd1e3347b8905099b33307adb0', 'request_id': 'req-d4ab56c7-dcc6-4758-bd95-d202764a8e00'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:45.658618 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d4ab56c7-dcc6-4758-bd95-d202764a8e00 admin admin] The token cache is being invalidate because project 178d04fd1e3347b8905099b33307adb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:05:45.659229 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d4ab56c7-dcc6-4758-bd95-d202764a8e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:45.659740 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d4ab56c7-dcc6-4758-bd95-d202764a8e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:45.664843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 835/1670] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:05:45 2022] DELETE /identity/v3/projects/178d04fd1e3347b8905099b33307adb0 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:45.670647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d19e2-b149-4f5c-9cbc-ed974f1cb8d8 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:45.671702 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d19e2-b149-4f5c-9cbc-ed974f1cb8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:45.672206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d19e2-b149-4f5c-9cbc-ed974f1cb8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:45.688100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f27a5-3205-4b7d-8b9b-7648c795635b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:45.689769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f27a5-3205-4b7d-8b9b-7648c795635b service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:45.734486 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 836/1671] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:45.740551 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-118d19e2-b149-4f5c-9cbc-ed974f1cb8d8 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:45.744155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f27a5-3205-4b7d-8b9b-7648c795635b service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:45.745682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-118d19e2-b149-4f5c-9cbc-ed974f1cb8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:45.747325 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-111f27a5-3205-4b7d-8b9b-7648c795635b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:45.906166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:46.031805 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 836/1672] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:46.039686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25176279-4067-4172-8a3c-5effc4a41228 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:46.040014 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25176279-4067-4172-8a3c-5effc4a41228 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:46.040443 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25176279-4067-4172-8a3c-5effc4a41228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:46.056571 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f27a5-3205-4b7d-8b9b-7648c795635b service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:46.071026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9137d-5399-4389-973b-c70a402aed97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:46.072065 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9137d-5399-4389-973b-c70a402aed97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:46.072065 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9137d-5399-4389-973b-c70a402aed97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:46.072316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9137d-5399-4389-973b-c70a402aed97 admin admin] PATH_INFO: `/v3/projects/0e56de69b6ea449f9f1855db4be0240f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:46.076506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9137d-5399-4389-973b-c70a402aed97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e56de69b6ea449f9f1855db4be0240f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:46.137265 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9137d-5399-4389-973b-c70a402aed97 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:46.146933 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-25176279-4067-4172-8a3c-5effc4a41228 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:46.151378 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-25176279-4067-4172-8a3c-5effc4a41228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:46.180786 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 837/1673] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:46.185381 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25176279-4067-4172-8a3c-5effc4a41228 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:46.235735 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25176279-4067-4172-8a3c-5effc4a41228 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:46.257266 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97dc32a-f078-4b23-ab54-4d67c4804d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:46.260560 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dc32a-f078-4b23-ab54-4d67c4804d97 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:46.260887 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dc32a-f078-4b23-ab54-4d67c4804d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:46.261380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dc32a-f078-4b23-ab54-4d67c4804d97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:46.275409 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97dc32a-f078-4b23-ab54-4d67c4804d97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:05:46.276830 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97dc32a-f078-4b23-ab54-4d67c4804d97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:46.288874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97dc32a-f078-4b23-ab54-4d67c4804d97 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:46.324716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 838/1674] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:05:46.325881 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97dc32a-f078-4b23-ab54-4d67c4804d97 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:46.376139 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97dc32a-f078-4b23-ab54-4d67c4804d97 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:46.412487 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-92c9137d-5399-4389-973b-c70a402aed97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e56de69b6ea449f9f1855db4be0240f', 'request_id': 'req-92c9137d-5399-4389-973b-c70a402aed97'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:46.432358 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-92c9137d-5399-4389-973b-c70a402aed97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e56de69b6ea449f9f1855db4be0240f', 'request_id': 'req-92c9137d-5399-4389-973b-c70a402aed97'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:46.447052 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-92c9137d-5399-4389-973b-c70a402aed97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e56de69b6ea449f9f1855db4be0240f', 'request_id': 'req-92c9137d-5399-4389-973b-c70a402aed97'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:46.585254 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-92c9137d-5399-4389-973b-c70a402aed97 admin admin] The token cache is being invalidate because project 0e56de69b6ea449f9f1855db4be0240f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:05:46.586051 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-92c9137d-5399-4389-973b-c70a402aed97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:46.587561 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-92c9137d-5399-4389-973b-c70a402aed97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:46.603593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 837/1675] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:05:45 2022] DELETE /identity/v3/projects/0e56de69b6ea449f9f1855db4be0240f => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:46.610028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9137d-5399-4389-973b-c70a402aed97 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:46.611372 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:46.618839 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-92c9137d-5399-4389-973b-c70a402aed97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:46.689126 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f033f9a-a453-49c5-8cac-0c2bd82f0771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:46.700445 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f033f9a-a453-49c5-8cac-0c2bd82f0771 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:46.700960 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f033f9a-a453-49c5-8cac-0c2bd82f0771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:46.703050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f033f9a-a453-49c5-8cac-0c2bd82f0771 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:46.704232 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f033f9a-a453-49c5-8cac-0c2bd82f0771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:46.711117 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f033f9a-a453-49c5-8cac-0c2bd82f0771 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:46.888288 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9137d-5399-4389-973b-c70a402aed97 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:46.898164 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064473ff-0324-4052-962d-42ef16d96548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:46.899045 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064473ff-0324-4052-962d-42ef16d96548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:46.899873 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064473ff-0324-4052-962d-42ef16d96548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:46.900218 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064473ff-0324-4052-962d-42ef16d96548 admin admin] PATH_INFO: `/v3/users/ab7cafee13a8494a95f1c43aa2fe11e2` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:46.914754 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064473ff-0324-4052-962d-42ef16d96548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7cafee13a8494a95f1c43aa2fe11e2)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:46.914754 dv-cinder-837543-7-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-064473ff-0324-4052-962d-42ef16d96548 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:05:46.914754 dv-cinder-837543-7-smb devstack@keystone.service[80420]: warnings.warn(msg) Jul 28 18:05:46.914754 dv-cinder-837543-7-smb devstack@keystone.service[80420]: Jul 28 18:05:46.915433 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 839/1676] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:46 2022] POST /identity/v3/projects => generated 403 bytes in 590 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:46.918652 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064473ff-0324-4052-962d-42ef16d96548 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:46.920393 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa494463-7991-4ac3-923d-2d264d7ff239 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:46.923138 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa494463-7991-4ac3-923d-2d264d7ff239 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:46.923717 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa494463-7991-4ac3-923d-2d264d7ff239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:46.989681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:47.009699 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-aa494463-7991-4ac3-923d-2d264d7ff239 None None] MFA Rules not processed for user `922506341d4a43c4a5f0cf9f610c4b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:47.015211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-aa494463-7991-4ac3-923d-2d264d7ff239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:47.110505 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 840/1677] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:47.121150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa494463-7991-4ac3-923d-2d264d7ff239 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:47.125829 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-aa494463-7991-4ac3-923d-2d264d7ff239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:47.239930 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa494463-7991-4ac3-923d-2d264d7ff239 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:47.250482 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc7ecc-b0de-474b-a2e2-c1cd031cc693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:47.251138 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc7ecc-b0de-474b-a2e2-c1cd031cc693 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:47.251421 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc7ecc-b0de-474b-a2e2-c1cd031cc693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:47.251699 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc7ecc-b0de-474b-a2e2-c1cd031cc693 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:47.252661 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc7ecc-b0de-474b-a2e2-c1cd031cc693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:47.261913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc7ecc-b0de-474b-a2e2-c1cd031cc693 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:47.262822 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-064473ff-0324-4052-962d-42ef16d96548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7cafee13a8494a95f1c43aa2fe11e2'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:47.265461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-064473ff-0324-4052-962d-42ef16d96548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7cafee13a8494a95f1c43aa2fe11e2'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:47.343689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-064473ff-0324-4052-962d-42ef16d96548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7cafee13a8494a95f1c43aa2fe11e2'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:47.363356 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-064473ff-0324-4052-962d-42ef16d96548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7cafee13a8494a95f1c43aa2fe11e2'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:47.365178 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-064473ff-0324-4052-962d-42ef16d96548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7cafee13a8494a95f1c43aa2fe11e2'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:47.377696 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 841/1678] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:47 2022] POST /identity/v3/users => generated 302 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:47.377696 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc7ecc-b0de-474b-a2e2-c1cd031cc693 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:47.383735 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-55fc7ecc-b0de-474b-a2e2-c1cd031cc693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:47.528069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 838/1679] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:05:46 2022] DELETE /identity/v3/users/ab7cafee13a8494a95f1c43aa2fe11e2 => generated 0 bytes in 916 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:47.528069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064473ff-0324-4052-962d-42ef16d96548 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:47.534366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-064473ff-0324-4052-962d-42ef16d96548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:47.563746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc7ecc-b0de-474b-a2e2-c1cd031cc693 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:47.766613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064473ff-0324-4052-962d-42ef16d96548 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:47.778871 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc178afc-1e6e-4892-a666-baab1eb419a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:47.779775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc178afc-1e6e-4892-a666-baab1eb419a5 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:47.780095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af7e7a-47b6-45bb-8e78-ccbae7439874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:47.780248 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc178afc-1e6e-4892-a666-baab1eb419a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:47.780413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc178afc-1e6e-4892-a666-baab1eb419a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:47.780822 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af7e7a-47b6-45bb-8e78-ccbae7439874 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:47.781475 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af7e7a-47b6-45bb-8e78-ccbae7439874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:47.781705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af7e7a-47b6-45bb-8e78-ccbae7439874 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:47.784030 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af7e7a-47b6-45bb-8e78-ccbae7439874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:47.786313 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-cc178afc-1e6e-4892-a666-baab1eb419a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:47.786596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af7e7a-47b6-45bb-8e78-ccbae7439874 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:47.815462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 839/1680] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:47.817530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af7e7a-47b6-45bb-8e78-ccbae7439874 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:47.821259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d8af7e7a-47b6-45bb-8e78-ccbae7439874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:47.852410 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af7e7a-47b6-45bb-8e78-ccbae7439874 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:47.859428 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0471d-cb39-4365-847b-6eda4d5c5db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:47.860110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0471d-cb39-4365-847b-6eda4d5c5db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:47.860745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0471d-cb39-4365-847b-6eda4d5c5db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:47.861189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0471d-cb39-4365-847b-6eda4d5c5db2 admin admin] PATH_INFO: `/v3/users/c44e0e03926d4b3cbcd4ee4e0b0a029f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:47.862529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0471d-cb39-4365-847b-6eda4d5c5db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44e0e03926d4b3cbcd4ee4e0b0a029f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:47.865163 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0471d-cb39-4365-847b-6eda4d5c5db2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:47.947831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc178afc-1e6e-4892-a666-baab1eb419a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:47.953465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc178afc-1e6e-4892-a666-baab1eb419a5 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:47.992281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 842/1681] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:48.008377 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc178afc-1e6e-4892-a666-baab1eb419a5 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:48.068846 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc178afc-1e6e-4892-a666-baab1eb419a5 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:48.090686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb47ff7-8117-43ba-b3da-80d3cf01b27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:48.091346 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb47ff7-8117-43ba-b3da-80d3cf01b27e admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:48.091696 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb47ff7-8117-43ba-b3da-80d3cf01b27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:48.092143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb47ff7-8117-43ba-b3da-80d3cf01b27e admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:48.093236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb47ff7-8117-43ba-b3da-80d3cf01b27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:48.096126 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb47ff7-8117-43ba-b3da-80d3cf01b27e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:48.130557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 843/1682] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:48.132480 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb47ff7-8117-43ba-b3da-80d3cf01b27e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:48.138438 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1ab0471d-cb39-4365-847b-6eda4d5c5db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44e0e03926d4b3cbcd4ee4e0b0a029f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:48.139276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1ab0471d-cb39-4365-847b-6eda4d5c5db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44e0e03926d4b3cbcd4ee4e0b0a029f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:48.145683 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb47ff7-8117-43ba-b3da-80d3cf01b27e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:48.151908 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dbfd1-a977-4614-b51c-cdc510818d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:48.154326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dbfd1-a977-4614-b51c-cdc510818d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:48.154326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dbfd1-a977-4614-b51c-cdc510818d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:48.154326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dbfd1-a977-4614-b51c-cdc510818d33 admin admin] PATH_INFO: `/v3/projects/80b4f5e4e47149d8a93068ff74d9fd1a/users/d1a31c94287d46238e29aa89ee8f62de/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:48.171484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1ab0471d-cb39-4365-847b-6eda4d5c5db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44e0e03926d4b3cbcd4ee4e0b0a029f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:48.186121 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1ab0471d-cb39-4365-847b-6eda4d5c5db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44e0e03926d4b3cbcd4ee4e0b0a029f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:48.187034 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1ab0471d-cb39-4365-847b-6eda4d5c5db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44e0e03926d4b3cbcd4ee4e0b0a029f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:48.204332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8dbfd1-a977-4614-b51c-cdc510818d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b4f5e4e47149d8a93068ff74d9fd1a, user_id=d1a31c94287d46238e29aa89ee8f62de, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:48.225626 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8dbfd1-a977-4614-b51c-cdc510818d33 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:48.340684 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 840/1683] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:05:47 2022] DELETE /identity/v3/users/c44e0e03926d4b3cbcd4ee4e0b0a029f => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:48.347886 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b88852-875f-40b1-9644-134278a84fc7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:48.348390 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b88852-875f-40b1-9644-134278a84fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:48.348869 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b88852-875f-40b1-9644-134278a84fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:48.359727 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 844/1684] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:48 2022] PUT /identity/v3/projects/80b4f5e4e47149d8a93068ff74d9fd1a/users/d1a31c94287d46238e29aa89ee8f62de/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:48.370190 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a067ccd-051e-446a-bf2c-0ace8e47ff03 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:48.370483 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a067ccd-051e-446a-bf2c-0ace8e47ff03 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:48.370761 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a067ccd-051e-446a-bf2c-0ace8e47ff03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:48.435376 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-72b88852-875f-40b1-9644-134278a84fc7 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:48.441167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-72b88852-875f-40b1-9644-134278a84fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:48.448286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6a067ccd-051e-446a-bf2c-0ace8e47ff03 None None] MFA Rules not processed for user `d1a31c94287d46238e29aa89ee8f62de`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:48.450619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6a067ccd-051e-446a-bf2c-0ace8e47ff03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:48.564254 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 845/1685] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:48.565682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a067ccd-051e-446a-bf2c-0ace8e47ff03 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:48.575212 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6a067ccd-051e-446a-bf2c-0ace8e47ff03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:48.684217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 841/1686] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:05:48.708893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b88852-875f-40b1-9644-134278a84fc7 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:48.710383 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-72b88852-875f-40b1-9644-134278a84fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:48.819349 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a067ccd-051e-446a-bf2c-0ace8e47ff03 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:48.829726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ae569-4c13-4d4c-9368-d3ef5ff79332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:48.831350 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ae569-4c13-4d4c-9368-d3ef5ff79332 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:48.832478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ae569-4c13-4d4c-9368-d3ef5ff79332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:48.832897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ae569-4c13-4d4c-9368-d3ef5ff79332 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:48.834883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ae569-4c13-4d4c-9368-d3ef5ff79332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:48.840327 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ae569-4c13-4d4c-9368-d3ef5ff79332 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:48.883578 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b88852-875f-40b1-9644-134278a84fc7 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:48.900889 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d439e-1be6-4e9e-b01b-1c2dc079468c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:48.901562 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d439e-1be6-4e9e-b01b-1c2dc079468c service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:48.901851 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d439e-1be6-4e9e-b01b-1c2dc079468c service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:48.902174 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d439e-1be6-4e9e-b01b-1c2dc079468c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:48.930460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d439e-1be6-4e9e-b01b-1c2dc079468c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:48.932019 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d439e-1be6-4e9e-b01b-1c2dc079468c service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:48.945372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 842/1687] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:48.946602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d439e-1be6-4e9e-b01b-1c2dc079468c service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:48.949346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e87d439e-1be6-4e9e-b01b-1c2dc079468c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:48.965392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d439e-1be6-4e9e-b01b-1c2dc079468c service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:48.971989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366a598-fae9-473c-a69d-430b02516551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:48.973496 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366a598-fae9-473c-a69d-430b02516551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:48.973930 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366a598-fae9-473c-a69d-430b02516551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:48.974368 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366a598-fae9-473c-a69d-430b02516551 admin admin] PATH_INFO: `/v3/projects/4f428cc514e6493db161c16902ebe406` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:48.975995 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366a598-fae9-473c-a69d-430b02516551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f428cc514e6493db161c16902ebe406)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:48.978787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366a598-fae9-473c-a69d-430b02516551 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:49.003036 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 846/1688] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:48 2022] POST /identity/v3/projects => generated 405 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:49.012520 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ae569-4c13-4d4c-9368-d3ef5ff79332 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:49.158904 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c366a598-fae9-473c-a69d-430b02516551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f428cc514e6493db161c16902ebe406', 'request_id': 'req-c366a598-fae9-473c-a69d-430b02516551'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:49.176345 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c366a598-fae9-473c-a69d-430b02516551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f428cc514e6493db161c16902ebe406', 'request_id': 'req-c366a598-fae9-473c-a69d-430b02516551'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:49.190467 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c366a598-fae9-473c-a69d-430b02516551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f428cc514e6493db161c16902ebe406', 'request_id': 'req-c366a598-fae9-473c-a69d-430b02516551'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:49.217521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:49.238755 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ae569-4c13-4d4c-9368-d3ef5ff79332 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:49.282704 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c366a598-fae9-473c-a69d-430b02516551 admin admin] The token cache is being invalidate because project 4f428cc514e6493db161c16902ebe406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:05:49.283253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c366a598-fae9-473c-a69d-430b02516551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:49.284308 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c366a598-fae9-473c-a69d-430b02516551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:49.287441 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 843/1689] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:05:48 2022] DELETE /identity/v3/projects/4f428cc514e6493db161c16902ebe406 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:49.297166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc34c11-48fb-478d-bc1d-732360e30216 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:49.300583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc34c11-48fb-478d-bc1d-732360e30216 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:49.301844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc34c11-48fb-478d-bc1d-732360e30216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:49.434775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4014f-7af2-4eb9-b8be-02d6421b6108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:49.435041 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6fc34c11-48fb-478d-bc1d-732360e30216 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:49.435524 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4014f-7af2-4eb9-b8be-02d6421b6108 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:49.435613 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4014f-7af2-4eb9-b8be-02d6421b6108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:49.435860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4014f-7af2-4eb9-b8be-02d6421b6108 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:49.436780 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4014f-7af2-4eb9-b8be-02d6421b6108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:49.443981 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4014f-7af2-4eb9-b8be-02d6421b6108 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:49.444258 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6fc34c11-48fb-478d-bc1d-732360e30216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:49.472803 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 844/1690] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:49.480188 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc34c11-48fb-478d-bc1d-732360e30216 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:49.490917 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6fc34c11-48fb-478d-bc1d-732360e30216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:49.527464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc34c11-48fb-478d-bc1d-732360e30216 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:49.541406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fba043-cc41-4ff6-9b55-2dc2139dc11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:49.542583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fba043-cc41-4ff6-9b55-2dc2139dc11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:49.542880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fba043-cc41-4ff6-9b55-2dc2139dc11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:49.543166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fba043-cc41-4ff6-9b55-2dc2139dc11d admin admin] PATH_INFO: `/v3/users/de40ffb0666c4b1dbaebc3424931a2d7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:49.555973 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fba043-cc41-4ff6-9b55-2dc2139dc11d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de40ffb0666c4b1dbaebc3424931a2d7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:49.559231 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fba043-cc41-4ff6-9b55-2dc2139dc11d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:49.619857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 847/1691] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:49 2022] POST /identity/v3/users => generated 309 bytes in 608 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:49.625388 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c267128-e427-4de8-998c-adeb376b6558 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:49.625731 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c267128-e427-4de8-998c-adeb376b6558 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:49.630218 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c267128-e427-4de8-998c-adeb376b6558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:49.687949 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0c267128-e427-4de8-998c-adeb376b6558 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:49.692424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0c267128-e427-4de8-998c-adeb376b6558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:49.715239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 848/1692] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:49.716683 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c267128-e427-4de8-998c-adeb376b6558 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:49.718410 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0c267128-e427-4de8-998c-adeb376b6558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:49.730829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:49.736082 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c267128-e427-4de8-998c-adeb376b6558 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:49.745024 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb55610-513a-4f2d-8e8f-1827c8d56e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:49.745996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb55610-513a-4f2d-8e8f-1827c8d56e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:49.746479 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb55610-513a-4f2d-8e8f-1827c8d56e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:49.747106 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb55610-513a-4f2d-8e8f-1827c8d56e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:49.748048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb55610-513a-4f2d-8e8f-1827c8d56e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:49.750793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb55610-513a-4f2d-8e8f-1827c8d56e22 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:49.770895 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 849/1693] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:49.772437 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb55610-513a-4f2d-8e8f-1827c8d56e22 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:49.785759 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb55610-513a-4f2d-8e8f-1827c8d56e22 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:49.797831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe1ec5-89d8-46df-a30b-36e83633cfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:49.797831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe1ec5-89d8-46df-a30b-36e83633cfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:49.797831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe1ec5-89d8-46df-a30b-36e83633cfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:49.797831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe1ec5-89d8-46df-a30b-36e83633cfc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:49.799599 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe1ec5-89d8-46df-a30b-36e83633cfc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:05:49.800708 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe1ec5-89d8-46df-a30b-36e83633cfc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:49.804785 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe1ec5-89d8-46df-a30b-36e83633cfc1 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:49.834016 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 850/1694] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:05:49.835107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe1ec5-89d8-46df-a30b-36e83633cfc1 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:49.853333 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe1ec5-89d8-46df-a30b-36e83633cfc1 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:49.863660 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53188b51-aaab-4e74-a441-34c9388ad072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:49.864626 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53188b51-aaab-4e74-a441-34c9388ad072 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:49.864996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53188b51-aaab-4e74-a441-34c9388ad072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:49.865550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53188b51-aaab-4e74-a441-34c9388ad072 admin admin] PATH_INFO: `/v3/projects/3650fab3bda1420f8d23cb269d30be37/users/368002067e954393a62b73a4866df7ce/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:49.892264 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-70fba043-cc41-4ff6-9b55-2dc2139dc11d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de40ffb0666c4b1dbaebc3424931a2d7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:49.896992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-70fba043-cc41-4ff6-9b55-2dc2139dc11d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de40ffb0666c4b1dbaebc3424931a2d7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:49.916132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53188b51-aaab-4e74-a441-34c9388ad072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3650fab3bda1420f8d23cb269d30be37, user_id=368002067e954393a62b73a4866df7ce, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:49.924697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53188b51-aaab-4e74-a441-34c9388ad072 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:49.932769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-70fba043-cc41-4ff6-9b55-2dc2139dc11d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de40ffb0666c4b1dbaebc3424931a2d7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:49.952791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-70fba043-cc41-4ff6-9b55-2dc2139dc11d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de40ffb0666c4b1dbaebc3424931a2d7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:49.953828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-70fba043-cc41-4ff6-9b55-2dc2139dc11d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de40ffb0666c4b1dbaebc3424931a2d7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:50.054963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 845/1695] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:05:49 2022] DELETE /identity/v3/users/de40ffb0666c4b1dbaebc3424931a2d7 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:50.059217 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 851/1696] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:49 2022] PUT /identity/v3/projects/3650fab3bda1420f8d23cb269d30be37/users/368002067e954393a62b73a4866df7ce/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:50.059217 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53188b51-aaab-4e74-a441-34c9388ad072 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:50.061310 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e5189-011e-41a1-ae0a-d02fb7271b56 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:50.061817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e5189-011e-41a1-ae0a-d02fb7271b56 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:50.062426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e5189-011e-41a1-ae0a-d02fb7271b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:50.064978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-53188b51-aaab-4e74-a441-34c9388ad072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:50.125713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2a0e5189-011e-41a1-ae0a-d02fb7271b56 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:50.127368 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2a0e5189-011e-41a1-ae0a-d02fb7271b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:50.227130 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53188b51-aaab-4e74-a441-34c9388ad072 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:50.277422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 846/1697] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:50.278429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e5189-011e-41a1-ae0a-d02fb7271b56 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:50.281596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2a0e5189-011e-41a1-ae0a-d02fb7271b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:50.313352 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d2efa-17b5-47f4-be85-0dc384bbdf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:50.314211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d2efa-17b5-47f4-be85-0dc384bbdf42 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:50.314507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d2efa-17b5-47f4-be85-0dc384bbdf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:50.315363 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d2efa-17b5-47f4-be85-0dc384bbdf42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:50.316872 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d2efa-17b5-47f4-be85-0dc384bbdf42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:50.324333 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d2efa-17b5-47f4-be85-0dc384bbdf42 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:50.324496 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e5189-011e-41a1-ae0a-d02fb7271b56 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:50.334721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34164b-820c-4d5a-a0ee-a66f1ed370a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:50.335664 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34164b-820c-4d5a-a0ee-a66f1ed370a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:50.336128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34164b-820c-4d5a-a0ee-a66f1ed370a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:50.336539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34164b-820c-4d5a-a0ee-a66f1ed370a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:50.337386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34164b-820c-4d5a-a0ee-a66f1ed370a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:50.341671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34164b-820c-4d5a-a0ee-a66f1ed370a6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:50.374851 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 847/1698] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:50.381571 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34164b-820c-4d5a-a0ee-a66f1ed370a6 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:50.413514 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34164b-820c-4d5a-a0ee-a66f1ed370a6 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:50.428880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5471-176a-4c8c-9ff4-8ab110c1135b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:50.429824 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5471-176a-4c8c-9ff4-8ab110c1135b admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:50.432046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5471-176a-4c8c-9ff4-8ab110c1135b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:50.432462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5471-176a-4c8c-9ff4-8ab110c1135b admin admin] PATH_INFO: `/v3/projects/3650fab3bda1420f8d23cb269d30be37/users/368002067e954393a62b73a4866df7ce/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:50.437673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d5471-176a-4c8c-9ff4-8ab110c1135b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3650fab3bda1420f8d23cb269d30be37, user_id=368002067e954393a62b73a4866df7ce, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:50.440729 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d5471-176a-4c8c-9ff4-8ab110c1135b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:50.471284 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 848/1699] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:50 2022] PUT /identity/v3/projects/3650fab3bda1420f8d23cb269d30be37/users/368002067e954393a62b73a4866df7ce/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:50.480841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5471-176a-4c8c-9ff4-8ab110c1135b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:50.482813 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-190d5471-176a-4c8c-9ff4-8ab110c1135b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:50.511645 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 852/1700] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:50 2022] POST /identity/v3/projects => generated 387 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:50.513893 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6f928-efda-4535-9e7f-96736d160b0c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:50.517823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6f928-efda-4535-9e7f-96736d160b0c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:50.518970 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6f928-efda-4535-9e7f-96736d160b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:50.593493 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:50.663075 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-5ee6f928-efda-4535-9e7f-96736d160b0c None None] MFA Rules not processed for user `368002067e954393a62b73a4866df7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:50.667320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5ee6f928-efda-4535-9e7f-96736d160b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:50.725197 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5471-176a-4c8c-9ff4-8ab110c1135b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:50.858394 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 853/1701] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:50 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:50.863554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6f928-efda-4535-9e7f-96736d160b0c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:50.866593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeecdc40-b4a5-4fb7-a9f7-3c20a0e29110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:50.867613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecdc40-b4a5-4fb7-a9f7-3c20a0e29110 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:50.868049 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecdc40-b4a5-4fb7-a9f7-3c20a0e29110 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:50.868488 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecdc40-b4a5-4fb7-a9f7-3c20a0e29110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:50.986979 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6f928-efda-4535-9e7f-96736d160b0c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:50.996736 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeecdc40-b4a5-4fb7-a9f7-3c20a0e29110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:50.998934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e975427-32a7-4c15-8164-99e4f3abc5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:51.001507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeecdc40-b4a5-4fb7-a9f7-3c20a0e29110 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:51.005675 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e975427-32a7-4c15-8164-99e4f3abc5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:51.005675 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e975427-32a7-4c15-8164-99e4f3abc5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:51.005675 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e975427-32a7-4c15-8164-99e4f3abc5a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:51.005675 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e975427-32a7-4c15-8164-99e4f3abc5a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:51.009290 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e975427-32a7-4c15-8164-99e4f3abc5a0 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:51.027195 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 849/1702] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:51.028616 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4294a05-df58-4102-a075-b4b19116c503 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:51.029037 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4294a05-df58-4102-a075-b4b19116c503 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:51.029329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4294a05-df58-4102-a075-b4b19116c503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:51.061385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e4294a05-df58-4102-a075-b4b19116c503 None None] MFA Rules not processed for user `399d1cc4c30a4cedbae053d3cf7301fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:51.062847 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e4294a05-df58-4102-a075-b4b19116c503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:51.166344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 850/1703] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:51.167278 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4294a05-df58-4102-a075-b4b19116c503 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:51.172924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e4294a05-df58-4102-a075-b4b19116c503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:51.178823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 854/1704] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:50 2022] POST /identity/v3/users => generated 294 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:51.178823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e975427-32a7-4c15-8164-99e4f3abc5a0 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:51.184834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4e975427-32a7-4c15-8164-99e4f3abc5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:51.209329 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e975427-32a7-4c15-8164-99e4f3abc5a0 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:51.233213 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68874a-e4da-4956-812e-789a5c65702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:51.233887 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68874a-e4da-4956-812e-789a5c65702b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:51.234173 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68874a-e4da-4956-812e-789a5c65702b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:51.234448 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68874a-e4da-4956-812e-789a5c65702b admin admin] PATH_INFO: `/v3/projects/4397f912795a45a685ecbb48a776a64a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:51.237023 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68874a-e4da-4956-812e-789a5c65702b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4397f912795a45a685ecbb48a776a64a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:51.247604 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68874a-e4da-4956-812e-789a5c65702b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:51.393861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4294a05-df58-4102-a075-b4b19116c503 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:51.433226 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aff57-b96c-4e18-9bae-2d15fc3b1e14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:51.434104 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aff57-b96c-4e18-9bae-2d15fc3b1e14 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:51.436097 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aff57-b96c-4e18-9bae-2d15fc3b1e14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:51.436492 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aff57-b96c-4e18-9bae-2d15fc3b1e14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:51.478481 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534aff57-b96c-4e18-9bae-2d15fc3b1e14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:51.482024 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534aff57-b96c-4e18-9bae-2d15fc3b1e14 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:51.484345 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-fe68874a-e4da-4956-812e-789a5c65702b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4397f912795a45a685ecbb48a776a64a', 'request_id': 'req-fe68874a-e4da-4956-812e-789a5c65702b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:51.524307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 851/1705] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:51 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:51.530928 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aff57-b96c-4e18-9bae-2d15fc3b1e14 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:51.580406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-fe68874a-e4da-4956-812e-789a5c65702b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4397f912795a45a685ecbb48a776a64a', 'request_id': 'req-fe68874a-e4da-4956-812e-789a5c65702b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:51.590356 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aff57-b96c-4e18-9bae-2d15fc3b1e14 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:51.608873 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-fe68874a-e4da-4956-812e-789a5c65702b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4397f912795a45a685ecbb48a776a64a', 'request_id': 'req-fe68874a-e4da-4956-812e-789a5c65702b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:51.619827 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-fe68874a-e4da-4956-812e-789a5c65702b admin admin] The token cache is being invalidate because project 4397f912795a45a685ecbb48a776a64a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:05:51.620566 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-fe68874a-e4da-4956-812e-789a5c65702b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:51.621048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-fe68874a-e4da-4956-812e-789a5c65702b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:51.626385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 855/1706] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:05:51 2022] DELETE /identity/v3/projects/4397f912795a45a685ecbb48a776a64a => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:51.628001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d3b61-ee5f-404a-b828-27602a597ca6 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:51.628300 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d3b61-ee5f-404a-b828-27602a597ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:51.629576 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d3b61-ee5f-404a-b828-27602a597ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:51.767066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-1c8d3b61-ee5f-404a-b828-27602a597ca6 None None] MFA Rules not processed for user `1cbbfdda843a4ab98ff9cf0742513f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:51.768918 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1c8d3b61-ee5f-404a-b828-27602a597ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:51.831886 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623d3ef-bb03-495f-9986-4c2a66456344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:51.845205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623d3ef-bb03-495f-9986-4c2a66456344 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:51.845205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623d3ef-bb03-495f-9986-4c2a66456344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:51.845205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623d3ef-bb03-495f-9986-4c2a66456344 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:51.845205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623d3ef-bb03-495f-9986-4c2a66456344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:51.845205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623d3ef-bb03-495f-9986-4c2a66456344 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:51.877440 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 852/1707] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:51.879667 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a28d7-ddbe-443d-b965-fcb5d0e686b9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:51.881334 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a28d7-ddbe-443d-b965-fcb5d0e686b9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:51.882078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a28d7-ddbe-443d-b965-fcb5d0e686b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:51.909154 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 856/1708] 10.222.0.75 () {58 vars in 1009 bytes} [Thu Jul 28 18:05:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:51.910285 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d3b61-ee5f-404a-b828-27602a597ca6 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:51.912275 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1c8d3b61-ee5f-404a-b828-27602a597ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:51.929844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e88a28d7-ddbe-443d-b965-fcb5d0e686b9 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:51.931087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e88a28d7-ddbe-443d-b965-fcb5d0e686b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:51.931985 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d3b61-ee5f-404a-b828-27602a597ca6 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:51.937940 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6621a-1e56-453f-a040-ac90d8e3be51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:51.941980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6621a-1e56-453f-a040-ac90d8e3be51 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:51.941980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6621a-1e56-453f-a040-ac90d8e3be51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:51.941980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6621a-1e56-453f-a040-ac90d8e3be51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:51.941980 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6621a-1e56-453f-a040-ac90d8e3be51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:51.942276 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6621a-1e56-453f-a040-ac90d8e3be51 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:51.954341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 857/1709] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:51.955235 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6621a-1e56-453f-a040-ac90d8e3be51 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:51.957927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6fe6621a-1e56-453f-a040-ac90d8e3be51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:51.961276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 853/1710] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:51.962173 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a28d7-ddbe-443d-b965-fcb5d0e686b9 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:51.972995 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:51.976198 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6621a-1e56-453f-a040-ac90d8e3be51 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:51.978545 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a28d7-ddbe-443d-b965-fcb5d0e686b9 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:51.982324 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ae5f1-d95a-41c6-8208-dc002f2e3b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:51.983168 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ae5f1-d95a-41c6-8208-dc002f2e3b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:51.983711 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ae5f1-d95a-41c6-8208-dc002f2e3b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:51.984137 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ae5f1-d95a-41c6-8208-dc002f2e3b27 admin admin] PATH_INFO: `/v3/users/d1a31c94287d46238e29aa89ee8f62de` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:51.985772 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ae5f1-d95a-41c6-8208-dc002f2e3b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a31c94287d46238e29aa89ee8f62de)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:51.989410 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ae5f1-d95a-41c6-8208-dc002f2e3b27 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:51.996311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f1e0c-5f8b-4fd3-ade5-332ec9c3710d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:51.997046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f1e0c-5f8b-4fd3-ade5-332ec9c3710d admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:52.000218 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f1e0c-5f8b-4fd3-ade5-332ec9c3710d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:52.000695 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f1e0c-5f8b-4fd3-ade5-332ec9c3710d admin admin] PATH_INFO: `/v3/projects/4d36689c625e4a49a3444fc60d7e8183/users/c49ed89d0e154ba8b3de6e695d464381/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:52.034126 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f1e0c-5f8b-4fd3-ade5-332ec9c3710d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d36689c625e4a49a3444fc60d7e8183, user_id=c49ed89d0e154ba8b3de6e695d464381, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:52.037518 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f1e0c-5f8b-4fd3-ade5-332ec9c3710d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:52.198010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 854/1711] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:51 2022] PUT /identity/v3/projects/4d36689c625e4a49a3444fc60d7e8183/users/c49ed89d0e154ba8b3de6e695d464381/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:52.204036 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d69fb4-a519-4015-9252-e14ff1bc5226 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:52.205801 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d69fb4-a519-4015-9252-e14ff1bc5226 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:52.206317 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d69fb4-a519-4015-9252-e14ff1bc5226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:52.234613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-72d69fb4-a519-4015-9252-e14ff1bc5226 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:52.236224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-72d69fb4-a519-4015-9252-e14ff1bc5226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:52.308890 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 855/1712] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:52.310477 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1dc8b-1a9d-4d52-a41f-d9724c97b540 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:52.310988 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1dc8b-1a9d-4d52-a41f-d9724c97b540 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:52.311380 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1dc8b-1a9d-4d52-a41f-d9724c97b540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:52.356913 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-add1dc8b-1a9d-4d52-a41f-d9724c97b540 None None] MFA Rules not processed for user `c49ed89d0e154ba8b3de6e695d464381`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:52.358465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-add1dc8b-1a9d-4d52-a41f-d9724c97b540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:52.417946 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-618ae5f1-d95a-41c6-8208-dc002f2e3b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a31c94287d46238e29aa89ee8f62de'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:52.508118 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 856/1713] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:52.511039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1dc8b-1a9d-4d52-a41f-d9724c97b540 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:52.514850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-618ae5f1-d95a-41c6-8208-dc002f2e3b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a31c94287d46238e29aa89ee8f62de'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:52.543779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-618ae5f1-d95a-41c6-8208-dc002f2e3b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a31c94287d46238e29aa89ee8f62de'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:52.546303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:52.554067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1dc8b-1a9d-4d52-a41f-d9724c97b540 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:52.565706 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-618ae5f1-d95a-41c6-8208-dc002f2e3b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a31c94287d46238e29aa89ee8f62de'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:52.567250 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-618ae5f1-d95a-41c6-8208-dc002f2e3b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a31c94287d46238e29aa89ee8f62de'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:52.583056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 858/1714] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:05:51 2022] DELETE /identity/v3/users/d1a31c94287d46238e29aa89ee8f62de => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:52.583729 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8e865-e961-4020-892a-80092085db92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:52.585072 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8e865-e961-4020-892a-80092085db92 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:52.585072 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8e865-e961-4020-892a-80092085db92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:52.585499 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8e865-e961-4020-892a-80092085db92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:52.586339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8e865-e961-4020-892a-80092085db92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:05:52.586760 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8e865-e961-4020-892a-80092085db92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:52.588008 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e18d7-3de6-4f22-b59e-b4c9888354b1 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:52.588457 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e18d7-3de6-4f22-b59e-b4c9888354b1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:52.588654 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8e865-e961-4020-892a-80092085db92 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:52.590059 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e18d7-3de6-4f22-b59e-b4c9888354b1 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:52.594467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 859/1715] 10.222.0.75 () {54 vars in 912 bytes} [Thu Jul 28 18:05:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:05:52.596625 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e18d7-3de6-4f22-b59e-b4c9888354b1 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:52.601232 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-314e18d7-3de6-4f22-b59e-b4c9888354b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:52.633201 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 857/1716] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:05:52.633201 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8e865-e961-4020-892a-80092085db92 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:52.635172 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-43c8e865-e961-4020-892a-80092085db92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:52.666379 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8e865-e961-4020-892a-80092085db92 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:52.812302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e18d7-3de6-4f22-b59e-b4c9888354b1 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:52.826847 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24002d-6cf1-4c84-bb15-9c8a46178303 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77b4fcb974d48a0bda4852c8d304511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:52.828112 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24002d-6cf1-4c84-bb15-9c8a46178303 service swift] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:52.828612 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24002d-6cf1-4c84-bb15-9c8a46178303 service swift] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:52.828968 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24002d-6cf1-4c84-bb15-9c8a46178303 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:52.831176 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0e24002d-6cf1-4c84-bb15-9c8a46178303 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:52.848037 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fe827-bb92-44a1-a495-74c91cf89588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:52.848883 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fe827-bb92-44a1-a495-74c91cf89588 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:52.849336 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fe827-bb92-44a1-a495-74c91cf89588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:52.849733 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fe827-bb92-44a1-a495-74c91cf89588 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:52.852791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fe827-bb92-44a1-a495-74c91cf89588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:52.854646 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fe827-bb92-44a1-a495-74c91cf89588 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:52.961612 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24002d-6cf1-4c84-bb15-9c8a46178303 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:52.963729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24002d-6cf1-4c84-bb15-9c8a46178303 service swift] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:52.996931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 858/1717] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:52 2022] POST /identity/v3/projects => generated 385 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:52.996931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bef44-b69a-4e12-8227-42bab4b34062 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:52.999430 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bef44-b69a-4e12-8227-42bab4b34062 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:52.999837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bef44-b69a-4e12-8227-42bab4b34062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:53.009520 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 860/1718] 10.222.0.75 () {60 vars in 1384 bytes} [Thu Jul 28 18:05:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:05:53.014916 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646399b-2db5-42bb-99d2-1622485be7fd None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:53.014916 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646399b-2db5-42bb-99d2-1622485be7fd None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:53.014916 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646399b-2db5-42bb-99d2-1622485be7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:53.056242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-354bef44-b69a-4e12-8227-42bab4b34062 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:53.057728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-354bef44-b69a-4e12-8227-42bab4b34062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:53.063609 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-9646399b-2db5-42bb-99d2-1622485be7fd None None] MFA Rules not processed for user `d0e56603b8704cb2b5587313c67254a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:53.065209 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9646399b-2db5-42bb-99d2-1622485be7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:53.182934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 861/1719] 10.222.0.75 () {58 vars in 1009 bytes} [Thu Jul 28 18:05:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:53.184061 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646399b-2db5-42bb-99d2-1622485be7fd None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:53.188288 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9646399b-2db5-42bb-99d2-1622485be7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:53.294392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 859/1720] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:53.297492 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354bef44-b69a-4e12-8227-42bab4b34062 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:53.304488 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-354bef44-b69a-4e12-8227-42bab4b34062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:53.389489 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354bef44-b69a-4e12-8227-42bab4b34062 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:53.391298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646399b-2db5-42bb-99d2-1622485be7fd None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:53.404546 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff5ae0-9cdc-43bf-9c77-a4a40c499098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:53.405230 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff5ae0-9cdc-43bf-9c77-a4a40c499098 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:53.405518 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff5ae0-9cdc-43bf-9c77-a4a40c499098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:53.407108 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff5ae0-9cdc-43bf-9c77-a4a40c499098 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:53.409136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff5ae0-9cdc-43bf-9c77-a4a40c499098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:53.421123 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff5ae0-9cdc-43bf-9c77-a4a40c499098 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:53.421965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35191d-9923-45c3-8d71-49e6695daf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:53.421965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35191d-9923-45c3-8d71-49e6695daf06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:53.421965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35191d-9923-45c3-8d71-49e6695daf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:53.421965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35191d-9923-45c3-8d71-49e6695daf06 admin admin] PATH_INFO: `/v3/projects/1314f77629ff46568dc2fae3b7523cd8` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:53.428129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35191d-9923-45c3-8d71-49e6695daf06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1314f77629ff46568dc2fae3b7523cd8)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:53.443463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35191d-9923-45c3-8d71-49e6695daf06 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:53.650720 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 862/1721] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:53 2022] POST /identity/v3/projects => generated 363 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:53.667588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff5ae0-9cdc-43bf-9c77-a4a40c499098 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:53.774321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0b35191d-9923-45c3-8d71-49e6695daf06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1314f77629ff46568dc2fae3b7523cd8', 'request_id': 'req-0b35191d-9923-45c3-8d71-49e6695daf06'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:53.784352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0b35191d-9923-45c3-8d71-49e6695daf06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1314f77629ff46568dc2fae3b7523cd8', 'request_id': 'req-0b35191d-9923-45c3-8d71-49e6695daf06'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:53.793576 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff5ae0-9cdc-43bf-9c77-a4a40c499098 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:53.795556 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0b35191d-9923-45c3-8d71-49e6695daf06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1314f77629ff46568dc2fae3b7523cd8', 'request_id': 'req-0b35191d-9923-45c3-8d71-49e6695daf06'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:53.895109 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae5823-bd12-4840-a3f4-038502d29cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:53.896185 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae5823-bd12-4840-a3f4-038502d29cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:53.896547 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae5823-bd12-4840-a3f4-038502d29cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:53.897582 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae5823-bd12-4840-a3f4-038502d29cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:53.898574 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae5823-bd12-4840-a3f4-038502d29cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:53.902040 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae5823-bd12-4840-a3f4-038502d29cf3 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:53.986784 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0b35191d-9923-45c3-8d71-49e6695daf06 admin admin] The token cache is being invalidate because project 1314f77629ff46568dc2fae3b7523cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:05:53.987529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0b35191d-9923-45c3-8d71-49e6695daf06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:53.989351 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0b35191d-9923-45c3-8d71-49e6695daf06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:53.992258 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 860/1722] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:05:53 2022] DELETE /identity/v3/projects/1314f77629ff46568dc2fae3b7523cd8 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:53.994615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35191d-9923-45c3-8d71-49e6695daf06 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:53.997559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0b35191d-9923-45c3-8d71-49e6695daf06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:54.042306 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 863/1723] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:53 2022] POST /identity/v3/users => generated 299 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:54.043378 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae5823-bd12-4840-a3f4-038502d29cf3 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:54.046247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e7ae5823-bd12-4840-a3f4-038502d29cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:54.172581 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:54.193908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35191d-9923-45c3-8d71-49e6695daf06 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:54.204927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b146fff-4652-4d9e-85b8-6fc05b114c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:54.204927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b146fff-4652-4d9e-85b8-6fc05b114c57 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:54.208487 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b146fff-4652-4d9e-85b8-6fc05b114c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:54.208924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b146fff-4652-4d9e-85b8-6fc05b114c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:54.215810 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9b146fff-4652-4d9e-85b8-6fc05b114c57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:54.231859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:54.245873 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae5823-bd12-4840-a3f4-038502d29cf3 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:54.277587 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b146fff-4652-4d9e-85b8-6fc05b114c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:54.283528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b146fff-4652-4d9e-85b8-6fc05b114c57 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:54.285502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f867b-5300-4689-b3de-8114046d1639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:54.306261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f867b-5300-4689-b3de-8114046d1639 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:54.306261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f867b-5300-4689-b3de-8114046d1639 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:54.306261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f867b-5300-4689-b3de-8114046d1639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:54.312722 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-638f867b-5300-4689-b3de-8114046d1639 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:54.329737 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 861/1724] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:54.337009 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b146fff-4652-4d9e-85b8-6fc05b114c57 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:54.337009 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9b146fff-4652-4d9e-85b8-6fc05b114c57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:54.379061 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f867b-5300-4689-b3de-8114046d1639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:54.380886 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f867b-5300-4689-b3de-8114046d1639 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:54.387483 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b146fff-4652-4d9e-85b8-6fc05b114c57 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:54.406263 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd697d7-45f6-4759-8809-fcf3e1742e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:54.408134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd697d7-45f6-4759-8809-fcf3e1742e59 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:54.411232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd697d7-45f6-4759-8809-fcf3e1742e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:54.411789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd697d7-45f6-4759-8809-fcf3e1742e59 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:54.414907 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd697d7-45f6-4759-8809-fcf3e1742e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:54.417381 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 864/1725] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:54.417556 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f867b-5300-4689-b3de-8114046d1639 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:54.422055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd697d7-45f6-4759-8809-fcf3e1742e59 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:54.422715 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-638f867b-5300-4689-b3de-8114046d1639 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:54.505829 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f867b-5300-4689-b3de-8114046d1639 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:54.520086 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72c461-8980-4a8c-9d7c-eed79051ae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:54.520818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72c461-8980-4a8c-9d7c-eed79051ae50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:54.521178 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72c461-8980-4a8c-9d7c-eed79051ae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:54.521465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72c461-8980-4a8c-9d7c-eed79051ae50 admin admin] PATH_INFO: `/v3/users/76339aef8bfc46c489101b530113ee89` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:54.522813 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72c461-8980-4a8c-9d7c-eed79051ae50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76339aef8bfc46c489101b530113ee89)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:54.524878 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72c461-8980-4a8c-9d7c-eed79051ae50 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:54.566931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 862/1726] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:54 2022] POST /identity/v3/users => generated 282 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:54.571484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd697d7-45f6-4759-8809-fcf3e1742e59 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:54.584957 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ddd697d7-45f6-4759-8809-fcf3e1742e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:54.643715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd697d7-45f6-4759-8809-fcf3e1742e59 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:54.668618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdf1ef-62de-4404-aa22-6b299c1c45b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:54.671252 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdf1ef-62de-4404-aa22-6b299c1c45b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:54.673557 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdf1ef-62de-4404-aa22-6b299c1c45b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:54.676455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdf1ef-62de-4404-aa22-6b299c1c45b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:54.679059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdf1ef-62de-4404-aa22-6b299c1c45b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:54.687495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdf1ef-62de-4404-aa22-6b299c1c45b9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:54.744520 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 863/1727] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:54.749909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdf1ef-62de-4404-aa22-6b299c1c45b9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:54.769784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2d72c461-8980-4a8c-9d7c-eed79051ae50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76339aef8bfc46c489101b530113ee89'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:54.799252 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdf1ef-62de-4404-aa22-6b299c1c45b9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:54.851185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad14d8f-abe9-4508-aa2c-50c68b1f3358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:54.851185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad14d8f-abe9-4508-aa2c-50c68b1f3358 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:54.851185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad14d8f-abe9-4508-aa2c-50c68b1f3358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:54.851185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad14d8f-abe9-4508-aa2c-50c68b1f3358 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:54.851838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad14d8f-abe9-4508-aa2c-50c68b1f3358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:54.853586 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad14d8f-abe9-4508-aa2c-50c68b1f3358 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:54.890933 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 864/1728] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:54.892521 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee970f6-fca9-4291-ae32-2a5cd4ee5af2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:54.893008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee970f6-fca9-4291-ae32-2a5cd4ee5af2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:54.893308 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee970f6-fca9-4291-ae32-2a5cd4ee5af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:54.935591 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0ee970f6-fca9-4291-ae32-2a5cd4ee5af2 None None] MFA Rules not processed for user `922506341d4a43c4a5f0cf9f610c4b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:54.937353 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0ee970f6-fca9-4291-ae32-2a5cd4ee5af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:54.944289 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2d72c461-8980-4a8c-9d7c-eed79051ae50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76339aef8bfc46c489101b530113ee89'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:55.011319 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2d72c461-8980-4a8c-9d7c-eed79051ae50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76339aef8bfc46c489101b530113ee89'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:55.048082 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2d72c461-8980-4a8c-9d7c-eed79051ae50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76339aef8bfc46c489101b530113ee89'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:55.053114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2d72c461-8980-4a8c-9d7c-eed79051ae50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76339aef8bfc46c489101b530113ee89'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:55.070973 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 865/1729] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:05:54 2022] DELETE /identity/v3/users/76339aef8bfc46c489101b530113ee89 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:55.078394 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72c461-8980-4a8c-9d7c-eed79051ae50 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:55.080226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2d72c461-8980-4a8c-9d7c-eed79051ae50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:55.105174 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 865/1730] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:55.114916 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e62e1-6b7f-4f80-8043-a43e9b555e58 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:55.116069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e62e1-6b7f-4f80-8043-a43e9b555e58 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:55.116362 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e62e1-6b7f-4f80-8043-a43e9b555e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:55.181821 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b48e62e1-6b7f-4f80-8043-a43e9b555e58 None None] MFA Rules not processed for user `0130232e2fd44fe09dd82a173da0a12d`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:55.186318 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b48e62e1-6b7f-4f80-8043-a43e9b555e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:55.272823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:55.308683 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72c461-8980-4a8c-9d7c-eed79051ae50 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:55.344062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe194c0-a52a-4592-8d28-fb2717f3c4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:55.344811 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe194c0-a52a-4592-8d28-fb2717f3c4bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:55.345104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe194c0-a52a-4592-8d28-fb2717f3c4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:55.351435 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe194c0-a52a-4592-8d28-fb2717f3c4bf admin admin] PATH_INFO: `/v3/projects/823a6c9a6f7246ca8d94b177f72eadc1/users/fc89bce9bc884a9d9b10c3d05a4512a2/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:55.396948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe194c0-a52a-4592-8d28-fb2717f3c4bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=823a6c9a6f7246ca8d94b177f72eadc1, user_id=fc89bce9bc884a9d9b10c3d05a4512a2, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:55.400835 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe194c0-a52a-4592-8d28-fb2717f3c4bf admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:55.451878 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 866/1731] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:55.461462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e62e1-6b7f-4f80-8043-a43e9b555e58 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:55.467389 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b48e62e1-6b7f-4f80-8043-a43e9b555e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:55.508177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 866/1732] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:55 2022] PUT /identity/v3/projects/823a6c9a6f7246ca8d94b177f72eadc1/users/fc89bce9bc884a9d9b10c3d05a4512a2/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:55.509730 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf4a1b-776e-42a9-8f74-91d190892bc1 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:55.510098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf4a1b-776e-42a9-8f74-91d190892bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:55.510451 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf4a1b-776e-42a9-8f74-91d190892bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:55.526689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e62e1-6b7f-4f80-8043-a43e9b555e58 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:55.572669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-bfdf4a1b-776e-42a9-8f74-91d190892bc1 None None] MFA Rules not processed for user `d0e56603b8704cb2b5587313c67254a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:55.572669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bfdf4a1b-776e-42a9-8f74-91d190892bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:55.652508 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f4831-4241-4dc8-ab90-1cb06ebbc421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:55.653360 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f4831-4241-4dc8-ab90-1cb06ebbc421 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:55.653751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f4831-4241-4dc8-ab90-1cb06ebbc421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:55.654342 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f4831-4241-4dc8-ab90-1cb06ebbc421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:55.656059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f4831-4241-4dc8-ab90-1cb06ebbc421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:55.657876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f4831-4241-4dc8-ab90-1cb06ebbc421 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:55.669651 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 867/1733] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:55.670788 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f4831-4241-4dc8-ab90-1cb06ebbc421 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:55.683580 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f4831-4241-4dc8-ab90-1cb06ebbc421 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:55.688723 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937161b9-9c7e-4d1c-9038-fcd6a3778758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:55.690098 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937161b9-9c7e-4d1c-9038-fcd6a3778758 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:55.690624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937161b9-9c7e-4d1c-9038-fcd6a3778758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:55.691863 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937161b9-9c7e-4d1c-9038-fcd6a3778758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:55.692875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937161b9-9c7e-4d1c-9038-fcd6a3778758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:55.694609 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937161b9-9c7e-4d1c-9038-fcd6a3778758 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:55.713634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 868/1734] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:55.713634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937161b9-9c7e-4d1c-9038-fcd6a3778758 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:55.723743 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937161b9-9c7e-4d1c-9038-fcd6a3778758 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:55.734349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ff283-3836-4a63-bb2a-d229984762f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:55.735211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ff283-3836-4a63-bb2a-d229984762f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:55.744099 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ff283-3836-4a63-bb2a-d229984762f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:55.744099 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ff283-3836-4a63-bb2a-d229984762f8 admin admin] PATH_INFO: `/v3/projects/5009d2bc1f37464e96f53414bddb59ff/users/68061684064e48aaab86c43ee16c8eeb/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:55.786179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ff283-3836-4a63-bb2a-d229984762f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5009d2bc1f37464e96f53414bddb59ff, user_id=68061684064e48aaab86c43ee16c8eeb, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:55.792912 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 867/1735] 10.222.0.77 () {58 vars in 1015 bytes} [Thu Jul 28 18:05:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:55.798812 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf4a1b-776e-42a9-8f74-91d190892bc1 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:55.798943 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ff283-3836-4a63-bb2a-d229984762f8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:55.821503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf4a1b-776e-42a9-8f74-91d190892bc1 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:55.877596 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cbeeb-ccc8-4b5b-85a8-e56aecbfbf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:55.883781 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cbeeb-ccc8-4b5b-85a8-e56aecbfbf47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:55.885185 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cbeeb-ccc8-4b5b-85a8-e56aecbfbf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:55.886032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cbeeb-ccc8-4b5b-85a8-e56aecbfbf47 admin admin] PATH_INFO: `/v3/projects/823a6c9a6f7246ca8d94b177f72eadc1/users/fc89bce9bc884a9d9b10c3d05a4512a2/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:55.904149 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cbeeb-ccc8-4b5b-85a8-e56aecbfbf47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=823a6c9a6f7246ca8d94b177f72eadc1, user_id=fc89bce9bc884a9d9b10c3d05a4512a2, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:55.905275 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:55.913072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cbeeb-ccc8-4b5b-85a8-e56aecbfbf47 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:55.926994 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 869/1736] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:55 2022] PUT /identity/v3/projects/5009d2bc1f37464e96f53414bddb59ff/users/68061684064e48aaab86c43ee16c8eeb/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:55.928714 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ff283-3836-4a63-bb2a-d229984762f8 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:55.933933 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-639ff283-3836-4a63-bb2a-d229984762f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:55.965579 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 868/1737] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:55 2022] PUT /identity/v3/projects/823a6c9a6f7246ca8d94b177f72eadc1/users/fc89bce9bc884a9d9b10c3d05a4512a2/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:55.967155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda358f-b3f4-46e6-a9cd-35b70c2a7d33 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:55.969229 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda358f-b3f4-46e6-a9cd-35b70c2a7d33 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:55.969797 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda358f-b3f4-46e6-a9cd-35b70c2a7d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:56.033825 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4dda358f-b3f4-46e6-a9cd-35b70c2a7d33 None None] MFA Rules not processed for user `68061684064e48aaab86c43ee16c8eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:56.037047 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4dda358f-b3f4-46e6-a9cd-35b70c2a7d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:56.078846 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ff283-3836-4a63-bb2a-d229984762f8 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:56.201034 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3541c1-ebc4-42cd-a808-04c23ec08804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:56.202041 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3541c1-ebc4-42cd-a808-04c23ec08804 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:56.202479 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3541c1-ebc4-42cd-a808-04c23ec08804 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:56.202934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3541c1-ebc4-42cd-a808-04c23ec08804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:56.224333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3541c1-ebc4-42cd-a808-04c23ec08804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:56.228708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3541c1-ebc4-42cd-a808-04c23ec08804 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:56.241714 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 869/1738] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:56.245830 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb9f6c-702a-4374-9906-0d4135b708c8 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:56.246142 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb9f6c-702a-4374-9906-0d4135b708c8 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:56.246449 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb9f6c-702a-4374-9906-0d4135b708c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:56.258187 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 870/1739] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:56.270459 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3541c1-ebc4-42cd-a808-04c23ec08804 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:56.270459 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cd3541c1-ebc4-42cd-a808-04c23ec08804 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:56.380127 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-9bbb9f6c-702a-4374-9906-0d4135b708c8 None None] MFA Rules not processed for user `fc89bce9bc884a9d9b10c3d05a4512a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:56.386750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9bbb9f6c-702a-4374-9906-0d4135b708c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:56.460029 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3541c1-ebc4-42cd-a808-04c23ec08804 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:56.475707 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:56.481909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326f1cf-cc0c-4546-80f6-e084b291d580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:56.481909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326f1cf-cc0c-4546-80f6-e084b291d580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:56.481909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326f1cf-cc0c-4546-80f6-e084b291d580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:56.481909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326f1cf-cc0c-4546-80f6-e084b291d580 admin admin] PATH_INFO: `/v3/projects/80b4f5e4e47149d8a93068ff74d9fd1a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:56.482205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326f1cf-cc0c-4546-80f6-e084b291d580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80b4f5e4e47149d8a93068ff74d9fd1a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:56.483472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326f1cf-cc0c-4546-80f6-e084b291d580 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:56.558966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:56.658273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 870/1740] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:56.660416 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb9f6c-702a-4374-9906-0d4135b708c8 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:56.671421 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3326f1cf-cc0c-4546-80f6-e084b291d580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80b4f5e4e47149d8a93068ff74d9fd1a', 'request_id': 'req-3326f1cf-cc0c-4546-80f6-e084b291d580'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:56.682038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3326f1cf-cc0c-4546-80f6-e084b291d580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80b4f5e4e47149d8a93068ff74d9fd1a', 'request_id': 'req-3326f1cf-cc0c-4546-80f6-e084b291d580'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:56.691087 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb9f6c-702a-4374-9906-0d4135b708c8 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:56.707392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3326f1cf-cc0c-4546-80f6-e084b291d580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80b4f5e4e47149d8a93068ff74d9fd1a', 'request_id': 'req-3326f1cf-cc0c-4546-80f6-e084b291d580'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:56.794413 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3326f1cf-cc0c-4546-80f6-e084b291d580 admin admin] The token cache is being invalidate because project 80b4f5e4e47149d8a93068ff74d9fd1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:05:56.795057 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3326f1cf-cc0c-4546-80f6-e084b291d580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:56.796120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3326f1cf-cc0c-4546-80f6-e084b291d580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:56.799450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 871/1741] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:05:56 2022] DELETE /identity/v3/projects/80b4f5e4e47149d8a93068ff74d9fd1a => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:56.801871 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326f1cf-cc0c-4546-80f6-e084b291d580 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:56.809356 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3326f1cf-cc0c-4546-80f6-e084b291d580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:56.822971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a761b-bdaa-420e-8a8c-1cf262bd9d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:56.825149 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a761b-bdaa-420e-8a8c-1cf262bd9d42 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:56.825623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a761b-bdaa-420e-8a8c-1cf262bd9d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:56.826478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a761b-bdaa-420e-8a8c-1cf262bd9d42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:56.829047 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a761b-bdaa-420e-8a8c-1cf262bd9d42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:56.837165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a761b-bdaa-420e-8a8c-1cf262bd9d42 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:56.952948 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326f1cf-cc0c-4546-80f6-e084b291d580 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:56.974080 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a48763-bc1a-46b7-b340-0ba248f81697 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:56.975210 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a48763-bc1a-46b7-b340-0ba248f81697 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:56.975728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a48763-bc1a-46b7-b340-0ba248f81697 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:56.976245 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a48763-bc1a-46b7-b340-0ba248f81697 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:56.992710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c8a48763-bc1a-46b7-b340-0ba248f81697 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:56.997192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 871/1742] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:56 2022] POST /identity/v3/projects => generated 365 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:57.007942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a761b-bdaa-420e-8a8c-1cf262bd9d42 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:57.013133 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-911a761b-bdaa-420e-8a8c-1cf262bd9d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:57.183392 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a761b-bdaa-420e-8a8c-1cf262bd9d42 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:57.207942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b45d7c-7eb5-4795-9ccd-1d1de74234e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:57.213542 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b45d7c-7eb5-4795-9ccd-1d1de74234e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:57.214048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b45d7c-7eb5-4795-9ccd-1d1de74234e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:57.214343 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b45d7c-7eb5-4795-9ccd-1d1de74234e7 admin admin] PATH_INFO: `/v3/users/368002067e954393a62b73a4866df7ce` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:57.216727 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b45d7c-7eb5-4795-9ccd-1d1de74234e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=368002067e954393a62b73a4866df7ce)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:57.220588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b45d7c-7eb5-4795-9ccd-1d1de74234e7 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:57.227132 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a48763-bc1a-46b7-b340-0ba248f81697 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:57.230272 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a48763-bc1a-46b7-b340-0ba248f81697 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:57.269911 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 872/1743] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:57.270779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a48763-bc1a-46b7-b340-0ba248f81697 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:57.275610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c8a48763-bc1a-46b7-b340-0ba248f81697 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:57.292427 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a48763-bc1a-46b7-b340-0ba248f81697 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:57.299067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73897383-bd02-4ab8-a047-a348100223f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:57.299786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73897383-bd02-4ab8-a047-a348100223f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:57.300075 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73897383-bd02-4ab8-a047-a348100223f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:57.300372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73897383-bd02-4ab8-a047-a348100223f9 admin admin] PATH_INFO: `/v3/projects/6b2c61d27381459eaf9ef494607083f9` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:57.301608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73897383-bd02-4ab8-a047-a348100223f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b2c61d27381459eaf9ef494607083f9)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:57.303617 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73897383-bd02-4ab8-a047-a348100223f9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:57.402762 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:57.494369 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d3b45d7c-7eb5-4795-9ccd-1d1de74234e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '368002067e954393a62b73a4866df7ce'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:57.553310 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-73897383-bd02-4ab8-a047-a348100223f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b2c61d27381459eaf9ef494607083f9', 'request_id': 'req-73897383-bd02-4ab8-a047-a348100223f9'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:57.570382 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-73897383-bd02-4ab8-a047-a348100223f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b2c61d27381459eaf9ef494607083f9', 'request_id': 'req-73897383-bd02-4ab8-a047-a348100223f9'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:57.590863 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d3b45d7c-7eb5-4795-9ccd-1d1de74234e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '368002067e954393a62b73a4866df7ce'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:57.626146 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-73897383-bd02-4ab8-a047-a348100223f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b2c61d27381459eaf9ef494607083f9', 'request_id': 'req-73897383-bd02-4ab8-a047-a348100223f9'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:57.627389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d3b45d7c-7eb5-4795-9ccd-1d1de74234e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '368002067e954393a62b73a4866df7ce'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:57.650156 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d3b45d7c-7eb5-4795-9ccd-1d1de74234e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '368002067e954393a62b73a4866df7ce'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:57.653070 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d3b45d7c-7eb5-4795-9ccd-1d1de74234e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '368002067e954393a62b73a4866df7ce'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:57.684545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 872/1744] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:05:57 2022] DELETE /identity/v3/users/368002067e954393a62b73a4866df7ce => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:57.685627 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b45d7c-7eb5-4795-9ccd-1d1de74234e7 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:57.692622 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d3b45d7c-7eb5-4795-9ccd-1d1de74234e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:57.717367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-73897383-bd02-4ab8-a047-a348100223f9 admin admin] The token cache is being invalidate because project 6b2c61d27381459eaf9ef494607083f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:05:57.728029 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-73897383-bd02-4ab8-a047-a348100223f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:57.728029 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-73897383-bd02-4ab8-a047-a348100223f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:57.728029 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 873/1745] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:05:57 2022] DELETE /identity/v3/projects/6b2c61d27381459eaf9ef494607083f9 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:57.728029 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73897383-bd02-4ab8-a047-a348100223f9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:57.734433 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-73897383-bd02-4ab8-a047-a348100223f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:57.899070 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b45d7c-7eb5-4795-9ccd-1d1de74234e7 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:57.915330 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6162d6f-8ff7-4aa2-a7b5-b7e9705b6f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:57.917417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6162d6f-8ff7-4aa2-a7b5-b7e9705b6f41 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:57.919050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6162d6f-8ff7-4aa2-a7b5-b7e9705b6f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:57.919348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6162d6f-8ff7-4aa2-a7b5-b7e9705b6f41 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:57.920443 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6162d6f-8ff7-4aa2-a7b5-b7e9705b6f41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:57.922524 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6162d6f-8ff7-4aa2-a7b5-b7e9705b6f41 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:57.926692 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73897383-bd02-4ab8-a047-a348100223f9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:57.935654 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97083f-e1fe-41b9-a7db-1b388c2db190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:57.940639 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97083f-e1fe-41b9-a7db-1b388c2db190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:57.941102 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97083f-e1fe-41b9-a7db-1b388c2db190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:57.941346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97083f-e1fe-41b9-a7db-1b388c2db190 admin admin] PATH_INFO: `/v3/users/c49ed89d0e154ba8b3de6e695d464381` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:57.942723 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97083f-e1fe-41b9-a7db-1b388c2db190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c49ed89d0e154ba8b3de6e695d464381)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:57.944696 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97083f-e1fe-41b9-a7db-1b388c2db190 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:58.054139 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 873/1746] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:57 2022] POST /identity/v3/users => generated 289 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:58.055317 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620148d1-73ba-4708-b06b-57e73f40704c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:58.055608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620148d1-73ba-4708-b06b-57e73f40704c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:58.055893 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620148d1-73ba-4708-b06b-57e73f40704c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:58.102271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-620148d1-73ba-4708-b06b-57e73f40704c None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:58.103542 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-620148d1-73ba-4708-b06b-57e73f40704c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:58.185207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 874/1747] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:58.185207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620148d1-73ba-4708-b06b-57e73f40704c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:58.186366 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-620148d1-73ba-4708-b06b-57e73f40704c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:58.224846 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620148d1-73ba-4708-b06b-57e73f40704c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:58.235001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6aa156-4170-4fc3-9b8f-7372809e58b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:58.235650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6aa156-4170-4fc3-9b8f-7372809e58b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:58.236146 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6aa156-4170-4fc3-9b8f-7372809e58b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:58.236611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6aa156-4170-4fc3-9b8f-7372809e58b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:58.251554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6aa156-4170-4fc3-9b8f-7372809e58b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:58.253284 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6aa156-4170-4fc3-9b8f-7372809e58b0 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:58.288115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:58.290837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6c97083f-e1fe-41b9-a7db-1b388c2db190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c49ed89d0e154ba8b3de6e695d464381'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:58.294373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6c97083f-e1fe-41b9-a7db-1b388c2db190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c49ed89d0e154ba8b3de6e695d464381'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:58.311292 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 875/1748] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:58.316897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4973007-7ca6-4e13-a627-aead384e6b74 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:58.317187 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4973007-7ca6-4e13-a627-aead384e6b74 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:58.319633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4973007-7ca6-4e13-a627-aead384e6b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:58.349861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6c97083f-e1fe-41b9-a7db-1b388c2db190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c49ed89d0e154ba8b3de6e695d464381'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:58.373357 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6c97083f-e1fe-41b9-a7db-1b388c2db190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c49ed89d0e154ba8b3de6e695d464381'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:58.374613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6c97083f-e1fe-41b9-a7db-1b388c2db190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c49ed89d0e154ba8b3de6e695d464381'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:58.404853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d4973007-7ca6-4e13-a627-aead384e6b74 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:58.413587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d4973007-7ca6-4e13-a627-aead384e6b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:58.446053 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 876/1749] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:58.446053 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4973007-7ca6-4e13-a627-aead384e6b74 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:58.446053 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d4973007-7ca6-4e13-a627-aead384e6b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:58.483849 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4973007-7ca6-4e13-a627-aead384e6b74 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:58.511091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bc435-933d-48a2-9dcf-b2893d67f837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:58.523102 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc435-933d-48a2-9dcf-b2893d67f837 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:58.525209 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc435-933d-48a2-9dcf-b2893d67f837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:58.526313 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc435-933d-48a2-9dcf-b2893d67f837 admin admin] PATH_INFO: `/v3/projects/3ef1bf92582f4e9a87db275185949279/users/d023b65687464981a6bd382bc2eb0619/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:58.546715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 874/1750] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:05:57 2022] DELETE /identity/v3/users/c49ed89d0e154ba8b3de6e695d464381 => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:58.548793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97083f-e1fe-41b9-a7db-1b388c2db190 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:58.633326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bc435-933d-48a2-9dcf-b2893d67f837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef1bf92582f4e9a87db275185949279, user_id=d023b65687464981a6bd382bc2eb0619, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:58.651410 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bc435-933d-48a2-9dcf-b2893d67f837 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:58.754257 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 877/1751] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:58 2022] PUT /identity/v3/projects/3ef1bf92582f4e9a87db275185949279/users/d023b65687464981a6bd382bc2eb0619/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:58.756689 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607aaad-d8af-48d1-acb5-5bd70afcb266 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:58.761617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607aaad-d8af-48d1-acb5-5bd70afcb266 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:58.762079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607aaad-d8af-48d1-acb5-5bd70afcb266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:58.852477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-8607aaad-d8af-48d1-acb5-5bd70afcb266 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:58.856344 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8607aaad-d8af-48d1-acb5-5bd70afcb266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:58.861347 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97083f-e1fe-41b9-a7db-1b388c2db190 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:58.999367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87146958-d679-42c2-b9c1-1ea3f18e1d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:59.001149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87146958-d679-42c2-b9c1-1ea3f18e1d56 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:59.002538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87146958-d679-42c2-b9c1-1ea3f18e1d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:59.016202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87146958-d679-42c2-b9c1-1ea3f18e1d56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:59.020567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87146958-d679-42c2-b9c1-1ea3f18e1d56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:05:59.021234 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87146958-d679-42c2-b9c1-1ea3f18e1d56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:59.024512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87146958-d679-42c2-b9c1-1ea3f18e1d56 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:59.048228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 875/1752] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 500 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:05:59.052486 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87146958-d679-42c2-b9c1-1ea3f18e1d56 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:59.077586 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87146958-d679-42c2-b9c1-1ea3f18e1d56 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:59.100193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 878/1753] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:59.100193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607aaad-d8af-48d1-acb5-5bd70afcb266 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:59.124119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6d9a0-a323-4877-b2b1-f3b7e9e697d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:59.128483 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6d9a0-a323-4877-b2b1-f3b7e9e697d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:59.128483 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6d9a0-a323-4877-b2b1-f3b7e9e697d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:59.128483 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6d9a0-a323-4877-b2b1-f3b7e9e697d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:59.128483 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6d9a0-a323-4877-b2b1-f3b7e9e697d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:59.128892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607aaad-d8af-48d1-acb5-5bd70afcb266 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:59.128967 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6d9a0-a323-4877-b2b1-f3b7e9e697d2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:59.140814 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2debef7-cccc-4782-98b7-23de074c3035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:59.141563 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2debef7-cccc-4782-98b7-23de074c3035 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:59.141888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2debef7-cccc-4782-98b7-23de074c3035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:59.144825 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2debef7-cccc-4782-98b7-23de074c3035 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:59.147967 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2debef7-cccc-4782-98b7-23de074c3035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:59.153288 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2debef7-cccc-4782-98b7-23de074c3035 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:59.164129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 876/1754] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:59.164129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6d9a0-a323-4877-b2b1-f3b7e9e697d2 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:59.165549 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-89f6d9a0-a323-4877-b2b1-f3b7e9e697d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:59.317473 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6d9a0-a323-4877-b2b1-f3b7e9e697d2 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:59.324007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa26589-d9dc-4696-a785-8efd551b2054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:59.324654 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa26589-d9dc-4696-a785-8efd551b2054 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:59.324978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa26589-d9dc-4696-a785-8efd551b2054 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:59.325399 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa26589-d9dc-4696-a785-8efd551b2054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:59.379521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 879/1755] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:59 2022] POST /identity/v3/projects => generated 373 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:59.379521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2debef7-cccc-4782-98b7-23de074c3035 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:59.379776 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa26589-d9dc-4696-a785-8efd551b2054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:59.379776 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa26589-d9dc-4696-a785-8efd551b2054 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:59.409420 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 877/1756] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:59.410900 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa26589-d9dc-4696-a785-8efd551b2054 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:59.431404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-daa26589-d9dc-4696-a785-8efd551b2054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:59.519577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa26589-d9dc-4696-a785-8efd551b2054 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:59.563021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2debef7-cccc-4782-98b7-23de074c3035 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:59.579827 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1d77c-a534-46b7-a731-c6e7be49b220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:59.581340 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1d77c-a534-46b7-a731-c6e7be49b220 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:59.581860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1d77c-a534-46b7-a731-c6e7be49b220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:59.582335 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1d77c-a534-46b7-a731-c6e7be49b220 admin admin] PATH_INFO: `/v3/projects/3ef1bf92582f4e9a87db275185949279/users/d023b65687464981a6bd382bc2eb0619/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:59.590921 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1d77c-a534-46b7-a731-c6e7be49b220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef1bf92582f4e9a87db275185949279, user_id=d023b65687464981a6bd382bc2eb0619, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:59.599326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1d77c-a534-46b7-a731-c6e7be49b220 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:59.642069 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 880/1757] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:59 2022] PUT /identity/v3/projects/3ef1bf92582f4e9a87db275185949279/users/d023b65687464981a6bd382bc2eb0619/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:59.643814 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1d77c-a534-46b7-a731-c6e7be49b220 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:59.729839 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aeac54-344b-4c67-8c04-3accdc54735b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:59.730500 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aeac54-344b-4c67-8c04-3accdc54735b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:59.730777 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aeac54-344b-4c67-8c04-3accdc54735b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:59.731064 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aeac54-344b-4c67-8c04-3accdc54735b admin admin] PATH_INFO: `/v3/projects/3650fab3bda1420f8d23cb269d30be37` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:59.739466 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aeac54-344b-4c67-8c04-3accdc54735b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3650fab3bda1420f8d23cb269d30be37)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:59.740396 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aeac54-344b-4c67-8c04-3accdc54735b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:59.804689 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1d77c-a534-46b7-a731-c6e7be49b220 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:59.810320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44e49b-22e7-4abf-a261-75271383346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:59.811534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44e49b-22e7-4abf-a261-75271383346a admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:59.815823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44e49b-22e7-4abf-a261-75271383346a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:59.815823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44e49b-22e7-4abf-a261-75271383346a admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:59.815823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44e49b-22e7-4abf-a261-75271383346a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:59.815823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44e49b-22e7-4abf-a261-75271383346a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:59.919200 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 881/1758] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:59 2022] POST /identity/v3/users => generated 287 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:59.920100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-13aeac54-344b-4c67-8c04-3accdc54735b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3650fab3bda1420f8d23cb269d30be37', 'request_id': 'req-13aeac54-344b-4c67-8c04-3accdc54735b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:59.920538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645f351-8256-42c1-9aec-32079f985146 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:59.921035 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645f351-8256-42c1-9aec-32079f985146 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:59.921318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645f351-8256-42c1-9aec-32079f985146 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:59.926840 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 882/1759] 10.222.0.75 () {54 vars in 921 bytes} [Thu Jul 28 18:05:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:05:59.928941 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03ada0-b7bf-43bc-a1a6-14da57f0e27d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:59.929637 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-13aeac54-344b-4c67-8c04-3accdc54735b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3650fab3bda1420f8d23cb269d30be37', 'request_id': 'req-13aeac54-344b-4c67-8c04-3accdc54735b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:59.933611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03ada0-b7bf-43bc-a1a6-14da57f0e27d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:59.933941 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03ada0-b7bf-43bc-a1a6-14da57f0e27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:59.940480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-13aeac54-344b-4c67-8c04-3accdc54735b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3650fab3bda1420f8d23cb269d30be37', 'request_id': 'req-13aeac54-344b-4c67-8c04-3accdc54735b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:59.982358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-9b03ada0-b7bf-43bc-a1a6-14da57f0e27d None None] MFA Rules not processed for user `d023b65687464981a6bd382bc2eb0619`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:59.983731 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9b03ada0-b7bf-43bc-a1a6-14da57f0e27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:00.024420 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:00.103113 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 883/1760] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:05:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:00.103113 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03ada0-b7bf-43bc-a1a6-14da57f0e27d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:00.181296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03ada0-b7bf-43bc-a1a6-14da57f0e27d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:00.187248 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97d5e1-ebe2-495b-9ef4-e9b7fa3459bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:00.187887 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97d5e1-ebe2-495b-9ef4-e9b7fa3459bc admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:00.188171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97d5e1-ebe2-495b-9ef4-e9b7fa3459bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:00.188449 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97d5e1-ebe2-495b-9ef4-e9b7fa3459bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:00.189177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97d5e1-ebe2-495b-9ef4-e9b7fa3459bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:00.190862 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97d5e1-ebe2-495b-9ef4-e9b7fa3459bc admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:00.204398 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 884/1761] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:00.206887 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199776c-4a1e-419e-8b99-590d81285977 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:00.207665 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199776c-4a1e-419e-8b99-590d81285977 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:00.208297 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199776c-4a1e-419e-8b99-590d81285977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:00.230198 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4199776c-4a1e-419e-8b99-590d81285977 None None] MFA Rules not processed for user `c456a787159844feb7eabfd1e527e46e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:00.231954 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4199776c-4a1e-419e-8b99-590d81285977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:00.271867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-13aeac54-344b-4c67-8c04-3accdc54735b admin admin] The token cache is being invalidate because project 3650fab3bda1420f8d23cb269d30be37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:00.291992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-13aeac54-344b-4c67-8c04-3accdc54735b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:00.291992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-13aeac54-344b-4c67-8c04-3accdc54735b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:00.291992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 878/1762] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:05:59 2022] DELETE /identity/v3/projects/3650fab3bda1420f8d23cb269d30be37 => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:00.291992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aeac54-344b-4c67-8c04-3accdc54735b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:00.291992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-13aeac54-344b-4c67-8c04-3accdc54735b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:00.333059 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 885/1763] 10.222.0.75 () {58 vars in 1018 bytes} [Thu Jul 28 18:06:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:00.334385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199776c-4a1e-419e-8b99-590d81285977 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:00.335911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4199776c-4a1e-419e-8b99-590d81285977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:00.361623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199776c-4a1e-419e-8b99-590d81285977 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:00.370578 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f02a14-7efb-428b-807a-4dd2a7d1d6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:00.371904 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f02a14-7efb-428b-807a-4dd2a7d1d6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:00.372390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f02a14-7efb-428b-807a-4dd2a7d1d6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:00.372899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f02a14-7efb-428b-807a-4dd2a7d1d6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:00.373810 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f02a14-7efb-428b-807a-4dd2a7d1d6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:00.375850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f02a14-7efb-428b-807a-4dd2a7d1d6b2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:00.388284 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 886/1764] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:00.396430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e149a-a154-41a8-b9a1-416716bca8e0 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:00.396430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e149a-a154-41a8-b9a1-416716bca8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:00.396430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e149a-a154-41a8-b9a1-416716bca8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:00.399719 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aeac54-344b-4c67-8c04-3accdc54735b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:00.405054 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33406e3c-8994-41df-8442-dfe60ebba738 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:00.405738 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33406e3c-8994-41df-8442-dfe60ebba738 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:00.406081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33406e3c-8994-41df-8442-dfe60ebba738 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:00.406381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33406e3c-8994-41df-8442-dfe60ebba738 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:00.411627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-33406e3c-8994-41df-8442-dfe60ebba738 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:00.413452 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-cc1e149a-a154-41a8-b9a1-416716bca8e0 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:00.414879 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-cc1e149a-a154-41a8-b9a1-416716bca8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:00.424983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 887/1765] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:00.426442 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e149a-a154-41a8-b9a1-416716bca8e0 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:00.432202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33406e3c-8994-41df-8442-dfe60ebba738 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:00.432380 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33406e3c-8994-41df-8442-dfe60ebba738 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:00.437042 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-cc1e149a-a154-41a8-b9a1-416716bca8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:00.447478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 879/1766] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:00.448565 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33406e3c-8994-41df-8442-dfe60ebba738 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:00.459522 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33406e3c-8994-41df-8442-dfe60ebba738 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:00.460900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e149a-a154-41a8-b9a1-416716bca8e0 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:00.466291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9470a-20e2-4b27-b213-4a1228b1657a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:00.466996 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9470a-20e2-4b27-b213-4a1228b1657a admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:00.467293 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9470a-20e2-4b27-b213-4a1228b1657a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:00.467571 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9470a-20e2-4b27-b213-4a1228b1657a admin admin] PATH_INFO: `/v3/projects/76e2503460814b859a69c9325c6025db/users/8e3b83abf666402c97a130508a07a755/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:00.469115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982afb7-32f0-4cd1-863f-01daa04ccb40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:00.470071 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982afb7-32f0-4cd1-863f-01daa04ccb40 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:00.470443 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982afb7-32f0-4cd1-863f-01daa04ccb40 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:00.476195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982afb7-32f0-4cd1-863f-01daa04ccb40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:00.494588 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9470a-20e2-4b27-b213-4a1228b1657a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e2503460814b859a69c9325c6025db, user_id=8e3b83abf666402c97a130508a07a755, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:00.497619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9470a-20e2-4b27-b213-4a1228b1657a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:00.501123 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982afb7-32f0-4cd1-863f-01daa04ccb40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:00.505274 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982afb7-32f0-4cd1-863f-01daa04ccb40 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:00.521984 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 888/1767] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:00.523813 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc984d-1827-4190-b7b0-d30f30f1d5ce None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:00.524228 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc984d-1827-4190-b7b0-d30f30f1d5ce None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:00.524580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc984d-1827-4190-b7b0-d30f30f1d5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:00.554495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-70cc984d-1827-4190-b7b0-d30f30f1d5ce None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:00.558461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-70cc984d-1827-4190-b7b0-d30f30f1d5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:00.571246 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 889/1768] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:00.592413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc984d-1827-4190-b7b0-d30f30f1d5ce None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:00.616472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc984d-1827-4190-b7b0-d30f30f1d5ce None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:00.624034 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f9f02-171b-4189-90cd-bc52ac93ebc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:00.625044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f9f02-171b-4189-90cd-bc52ac93ebc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:00.625562 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f9f02-171b-4189-90cd-bc52ac93ebc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:00.625841 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f9f02-171b-4189-90cd-bc52ac93ebc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:00.629579 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f9f02-171b-4189-90cd-bc52ac93ebc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:06:00.629920 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f9f02-171b-4189-90cd-bc52ac93ebc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:00.631626 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f9f02-171b-4189-90cd-bc52ac93ebc2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:00.652152 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 890/1769] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:06:00.654968 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f9f02-171b-4189-90cd-bc52ac93ebc2 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:00.675930 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f9f02-171b-4189-90cd-bc52ac93ebc2 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:00.681601 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145517d0-b13f-4c8b-a37f-500cfbcd2097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:00.682607 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145517d0-b13f-4c8b-a37f-500cfbcd2097 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:00.683314 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145517d0-b13f-4c8b-a37f-500cfbcd2097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:00.683314 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145517d0-b13f-4c8b-a37f-500cfbcd2097 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:00.684052 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145517d0-b13f-4c8b-a37f-500cfbcd2097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:00.691731 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145517d0-b13f-4c8b-a37f-500cfbcd2097 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:00.992296 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 880/1770] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:00 2022] PUT /identity/v3/projects/76e2503460814b859a69c9325c6025db/users/8e3b83abf666402c97a130508a07a755/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:00.998612 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 891/1771] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:00 2022] POST /identity/v3/projects => generated 399 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:00.999422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9470a-20e2-4b27-b213-4a1228b1657a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:01.002600 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700927bb-a4ac-46fb-a848-161525dce712 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:01.003083 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700927bb-a4ac-46fb-a848-161525dce712 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:01.004122 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700927bb-a4ac-46fb-a848-161525dce712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:01.051394 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-700927bb-a4ac-46fb-a848-161525dce712 None None] MFA Rules not processed for user `8e3b83abf666402c97a130508a07a755`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:01.056006 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-700927bb-a4ac-46fb-a848-161525dce712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:01.198607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9470a-20e2-4b27-b213-4a1228b1657a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:01.228182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 892/1772] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:01.229528 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700927bb-a4ac-46fb-a848-161525dce712 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:01.265917 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:01.316994 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700927bb-a4ac-46fb-a848-161525dce712 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:01.321975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb38381-4459-420c-913a-843031feaa62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:01.322756 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb38381-4459-420c-913a-843031feaa62 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:01.323056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb38381-4459-420c-913a-843031feaa62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:01.323403 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb38381-4459-420c-913a-843031feaa62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:01.325549 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4fb38381-4459-420c-913a-843031feaa62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:01.373553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1e290-ef18-42c9-9efa-70c7a3539ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:01.374228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1e290-ef18-42c9-9efa-70c7a3539ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:01.374514 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1e290-ef18-42c9-9efa-70c7a3539ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:01.374794 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1e290-ef18-42c9-9efa-70c7a3539ef4 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:01.375955 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1e290-ef18-42c9-9efa-70c7a3539ef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:01.378232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1e290-ef18-42c9-9efa-70c7a3539ef4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:01.410235 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb38381-4459-420c-913a-843031feaa62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:01.411861 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb38381-4459-420c-913a-843031feaa62 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:01.423702 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 893/1773] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:01 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:01.424942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb38381-4459-420c-913a-843031feaa62 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:01.438205 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb38381-4459-420c-913a-843031feaa62 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:01.443508 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea76ecf-7975-487c-8aba-d6705709f285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:01.444359 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea76ecf-7975-487c-8aba-d6705709f285 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:01.444657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea76ecf-7975-487c-8aba-d6705709f285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:01.445030 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea76ecf-7975-487c-8aba-d6705709f285 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:01.446171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea76ecf-7975-487c-8aba-d6705709f285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:01.448138 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea76ecf-7975-487c-8aba-d6705709f285 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:01.615127 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 894/1774] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:01 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:01.625669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea76ecf-7975-487c-8aba-d6705709f285 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:01.710134 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea76ecf-7975-487c-8aba-d6705709f285 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:01.720244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f6b62-bb04-4a8e-8e86-04c5f075ef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:01.726367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f6b62-bb04-4a8e-8e86-04c5f075ef00 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:01.726671 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f6b62-bb04-4a8e-8e86-04c5f075ef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:01.726960 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f6b62-bb04-4a8e-8e86-04c5f075ef00 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:01.727684 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f6b62-bb04-4a8e-8e86-04c5f075ef00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:01.733985 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f6b62-bb04-4a8e-8e86-04c5f075ef00 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:01.784065 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 881/1775] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:00 2022] POST /identity/v3/users => generated 300 bytes in 785 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:01.785435 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1e290-ef18-42c9-9efa-70c7a3539ef4 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:01.787183 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9fe1e290-ef18-42c9-9efa-70c7a3539ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:01.816645 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1e290-ef18-42c9-9efa-70c7a3539ef4 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:01.821738 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cdc7f-eb3a-4ccd-ad14-5a0247fcd60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:01.822397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cdc7f-eb3a-4ccd-ad14-5a0247fcd60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:01.822681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cdc7f-eb3a-4ccd-ad14-5a0247fcd60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:01.822957 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cdc7f-eb3a-4ccd-ad14-5a0247fcd60e admin admin] PATH_INFO: `/v3/projects/4d36689c625e4a49a3444fc60d7e8183` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:01.824413 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cdc7f-eb3a-4ccd-ad14-5a0247fcd60e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d36689c625e4a49a3444fc60d7e8183)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:01.826342 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cdc7f-eb3a-4ccd-ad14-5a0247fcd60e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:01.865025 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 895/1776] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:01 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:01.865025 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f6b62-bb04-4a8e-8e86-04c5f075ef00 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:01.874640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f6b62-bb04-4a8e-8e86-04c5f075ef00 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:01.882875 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fec4a-774a-4c10-b2e8-f287f86dda42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:01.883646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fec4a-774a-4c10-b2e8-f287f86dda42 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:01.884000 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fec4a-774a-4c10-b2e8-f287f86dda42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:01.884415 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fec4a-774a-4c10-b2e8-f287f86dda42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:01.885237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fec4a-774a-4c10-b2e8-f287f86dda42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:01.893394 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fec4a-774a-4c10-b2e8-f287f86dda42 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:01.898385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 896/1777] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:01.899461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fec4a-774a-4c10-b2e8-f287f86dda42 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:01.910668 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fec4a-774a-4c10-b2e8-f287f86dda42 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:01.915894 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c2936-7fee-46b9-852f-ad94cc3dd588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:01.916617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c2936-7fee-46b9-852f-ad94cc3dd588 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:01.916998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c2936-7fee-46b9-852f-ad94cc3dd588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:01.917345 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c2936-7fee-46b9-852f-ad94cc3dd588 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:01.918119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c2936-7fee-46b9-852f-ad94cc3dd588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:01.919831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c2936-7fee-46b9-852f-ad94cc3dd588 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:01.931384 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 897/1778] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:01.932218 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c2936-7fee-46b9-852f-ad94cc3dd588 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:01.941814 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c2936-7fee-46b9-852f-ad94cc3dd588 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:01.946482 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0ab5f-9e84-4f11-abf4-e46bf714af61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:01.947064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0ab5f-9e84-4f11-abf4-e46bf714af61 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:01.947346 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0ab5f-9e84-4f11-abf4-e46bf714af61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:01.947622 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0ab5f-9e84-4f11-abf4-e46bf714af61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:01.948293 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0ab5f-9e84-4f11-abf4-e46bf714af61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:01.949921 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0ab5f-9e84-4f11-abf4-e46bf714af61 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:01.962317 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 898/1779] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:01.964842 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0ab5f-9e84-4f11-abf4-e46bf714af61 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:01.973390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0ab5f-9e84-4f11-abf4-e46bf714af61 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:01.978373 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f5ce2-c9e7-4321-83a8-5f628be382ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:01.979137 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f5ce2-c9e7-4321-83a8-5f628be382ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:01.979468 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f5ce2-c9e7-4321-83a8-5f628be382ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:01.979741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f5ce2-c9e7-4321-83a8-5f628be382ee admin admin] PATH_INFO: `/v3/projects/ede3d98fb447480cbd2e4602379560de/users/6eb25d0065704fee8713fc77cc6366aa/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:01.995826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f5ce2-c9e7-4321-83a8-5f628be382ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede3d98fb447480cbd2e4602379560de, user_id=6eb25d0065704fee8713fc77cc6366aa, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:01.998565 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f5ce2-c9e7-4321-83a8-5f628be382ee admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:02.083135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 899/1780] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:01 2022] PUT /identity/v3/projects/ede3d98fb447480cbd2e4602379560de/users/6eb25d0065704fee8713fc77cc6366aa/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:02.083999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f5ce2-c9e7-4321-83a8-5f628be382ee admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:02.110583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-358cdc7f-eb3a-4ccd-ad14-5a0247fcd60e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d36689c625e4a49a3444fc60d7e8183', 'request_id': 'req-358cdc7f-eb3a-4ccd-ad14-5a0247fcd60e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:02.122705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-358cdc7f-eb3a-4ccd-ad14-5a0247fcd60e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d36689c625e4a49a3444fc60d7e8183', 'request_id': 'req-358cdc7f-eb3a-4ccd-ad14-5a0247fcd60e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:02.131711 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-358cdc7f-eb3a-4ccd-ad14-5a0247fcd60e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d36689c625e4a49a3444fc60d7e8183', 'request_id': 'req-358cdc7f-eb3a-4ccd-ad14-5a0247fcd60e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:02.183158 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f5ce2-c9e7-4321-83a8-5f628be382ee admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:02.254771 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-358cdc7f-eb3a-4ccd-ad14-5a0247fcd60e admin admin] The token cache is being invalidate because project 4d36689c625e4a49a3444fc60d7e8183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:02.255134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-358cdc7f-eb3a-4ccd-ad14-5a0247fcd60e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:02.257121 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-358cdc7f-eb3a-4ccd-ad14-5a0247fcd60e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:02.261422 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 882/1781] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:01 2022] DELETE /identity/v3/projects/4d36689c625e4a49a3444fc60d7e8183 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:02.262329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cdc7f-eb3a-4ccd-ad14-5a0247fcd60e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:02.265757 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-358cdc7f-eb3a-4ccd-ad14-5a0247fcd60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:02.309401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ac64a-0aa8-498d-affa-ff490dbfbe27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:02.316202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ac64a-0aa8-498d-affa-ff490dbfbe27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:02.316202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ac64a-0aa8-498d-affa-ff490dbfbe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:02.316202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ac64a-0aa8-498d-affa-ff490dbfbe27 admin admin] PATH_INFO: `/v3/projects/bf67bff6af364e1cb5299a47a0422822/users/18a7a787dee142738bdcb2eeadbb7fbf/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:02.333054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ac64a-0aa8-498d-affa-ff490dbfbe27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf67bff6af364e1cb5299a47a0422822, user_id=18a7a787dee142738bdcb2eeadbb7fbf, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:02.333054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ac64a-0aa8-498d-affa-ff490dbfbe27 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:02.402756 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cdc7f-eb3a-4ccd-ad14-5a0247fcd60e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:02.412101 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46c9b4-21f3-4950-bc3f-3df758d7751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:02.413813 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46c9b4-21f3-4950-bc3f-3df758d7751b admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:02.414256 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46c9b4-21f3-4950-bc3f-3df758d7751b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:02.414926 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46c9b4-21f3-4950-bc3f-3df758d7751b admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:02.416001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46c9b4-21f3-4950-bc3f-3df758d7751b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:02.417987 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46c9b4-21f3-4950-bc3f-3df758d7751b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:02.431485 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 883/1782] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:02.437742 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46c9b4-21f3-4950-bc3f-3df758d7751b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:02.438502 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fe46c9b4-21f3-4950-bc3f-3df758d7751b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:02.452552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46c9b4-21f3-4950-bc3f-3df758d7751b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:02.458337 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a643d-06f9-490b-ba95-044bb3a90d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:02.459080 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a643d-06f9-490b-ba95-044bb3a90d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:02.459464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a643d-06f9-490b-ba95-044bb3a90d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:02.459821 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a643d-06f9-490b-ba95-044bb3a90d7c admin admin] PATH_INFO: `/v3/users/fc89bce9bc884a9d9b10c3d05a4512a2` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:02.461139 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a643d-06f9-490b-ba95-044bb3a90d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc89bce9bc884a9d9b10c3d05a4512a2)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:02.464638 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a643d-06f9-490b-ba95-044bb3a90d7c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:02.517444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 900/1783] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:02 2022] PUT /identity/v3/projects/bf67bff6af364e1cb5299a47a0422822/users/18a7a787dee142738bdcb2eeadbb7fbf/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:02.518421 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ac64a-0aa8-498d-affa-ff490dbfbe27 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:02.593360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ac64a-0aa8-498d-affa-ff490dbfbe27 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:02.599039 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0e194-e3fe-4855-8adf-381b3b0b269b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:02.599749 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0e194-e3fe-4855-8adf-381b3b0b269b admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:02.600035 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0e194-e3fe-4855-8adf-381b3b0b269b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:02.600308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0e194-e3fe-4855-8adf-381b3b0b269b admin admin] PATH_INFO: `/v3/projects/ede3d98fb447480cbd2e4602379560de/users/6eb25d0065704fee8713fc77cc6366aa/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:02.609909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0e194-e3fe-4855-8adf-381b3b0b269b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede3d98fb447480cbd2e4602379560de, user_id=6eb25d0065704fee8713fc77cc6366aa, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:02.612874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0e194-e3fe-4855-8adf-381b3b0b269b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:02.631286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 901/1784] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:02 2022] PUT /identity/v3/projects/ede3d98fb447480cbd2e4602379560de/users/6eb25d0065704fee8713fc77cc6366aa/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:02.637132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2e97e-e8c5-4bd2-8e35-15fbc0a32d37 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:02.637132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2e97e-e8c5-4bd2-8e35-15fbc0a32d37 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:02.637132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2e97e-e8c5-4bd2-8e35-15fbc0a32d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:02.672893 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-fcd2e97e-e8c5-4bd2-8e35-15fbc0a32d37 None None] MFA Rules not processed for user `18a7a787dee142738bdcb2eeadbb7fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:02.672893 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fcd2e97e-e8c5-4bd2-8e35-15fbc0a32d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:02.759925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 902/1785] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:02.761463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f644e76-19bc-4e5a-877f-928309c35f52 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:02.761789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f644e76-19bc-4e5a-877f-928309c35f52 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:02.762135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f644e76-19bc-4e5a-877f-928309c35f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:02.766672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-914a643d-06f9-490b-ba95-044bb3a90d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc89bce9bc884a9d9b10c3d05a4512a2'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:02.767417 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-914a643d-06f9-490b-ba95-044bb3a90d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc89bce9bc884a9d9b10c3d05a4512a2'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:02.794501 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-914a643d-06f9-490b-ba95-044bb3a90d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc89bce9bc884a9d9b10c3d05a4512a2'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:02.802842 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-7f644e76-19bc-4e5a-877f-928309c35f52 None None] MFA Rules not processed for user `6eb25d0065704fee8713fc77cc6366aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:02.804227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7f644e76-19bc-4e5a-877f-928309c35f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:02.806980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-914a643d-06f9-490b-ba95-044bb3a90d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc89bce9bc884a9d9b10c3d05a4512a2'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:02.807958 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-914a643d-06f9-490b-ba95-044bb3a90d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc89bce9bc884a9d9b10c3d05a4512a2'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:02.883923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 884/1786] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:02 2022] DELETE /identity/v3/users/fc89bce9bc884a9d9b10c3d05a4512a2 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:02.884843 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a643d-06f9-490b-ba95-044bb3a90d7c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:02.886362 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-914a643d-06f9-490b-ba95-044bb3a90d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:02.890695 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 903/1787] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:02.917482 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f644e76-19bc-4e5a-877f-928309c35f52 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:02.919207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7f644e76-19bc-4e5a-877f-928309c35f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:02.973004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a643d-06f9-490b-ba95-044bb3a90d7c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:02.978105 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c4d80-bd26-4449-a780-df0195b9f473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:02.978860 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c4d80-bd26-4449-a780-df0195b9f473 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:02.979286 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c4d80-bd26-4449-a780-df0195b9f473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:02.979703 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c4d80-bd26-4449-a780-df0195b9f473 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:02.980440 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c4d80-bd26-4449-a780-df0195b9f473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:02.982770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c4d80-bd26-4449-a780-df0195b9f473 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:03.027243 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f644e76-19bc-4e5a-877f-928309c35f52 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:03.084094 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514de96d-f9af-45d7-9e1b-b9f1523c9af5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:03.084733 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514de96d-f9af-45d7-9e1b-b9f1523c9af5 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:03.085044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514de96d-f9af-45d7-9e1b-b9f1523c9af5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:03.085322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514de96d-f9af-45d7-9e1b-b9f1523c9af5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:03.104531 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 885/1788] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:02 2022] POST /identity/v3/projects => generated 401 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:03.105543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c4d80-bd26-4449-a780-df0195b9f473 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:03.137828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:03.167990 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514de96d-f9af-45d7-9e1b-b9f1523c9af5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:03.170021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514de96d-f9af-45d7-9e1b-b9f1523c9af5 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:03.204900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 904/1789] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:03.230657 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c4d80-bd26-4449-a780-df0195b9f473 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:03.237491 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a615f5-4b0d-4991-b3ea-05a150163dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:03.237792 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a615f5-4b0d-4991-b3ea-05a150163dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:03.245576 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a615f5-4b0d-4991-b3ea-05a150163dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:03.245576 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a615f5-4b0d-4991-b3ea-05a150163dc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:03.246320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a615f5-4b0d-4991-b3ea-05a150163dc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:03.248477 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a615f5-4b0d-4991-b3ea-05a150163dc8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:03.393746 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 886/1790] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:03 2022] POST /identity/v3/users => generated 307 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:03.402090 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514de96d-f9af-45d7-9e1b-b9f1523c9af5 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:03.415332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514de96d-f9af-45d7-9e1b-b9f1523c9af5 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:03.436446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30038fd9-bb08-428e-9f25-a79169f68afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:03.437137 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30038fd9-bb08-428e-9f25-a79169f68afd admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:03.437419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30038fd9-bb08-428e-9f25-a79169f68afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:03.437693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30038fd9-bb08-428e-9f25-a79169f68afd admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:03.438443 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30038fd9-bb08-428e-9f25-a79169f68afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:03.440100 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30038fd9-bb08-428e-9f25-a79169f68afd admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:03.456253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 905/1791] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:03.457557 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a615f5-4b0d-4991-b3ea-05a150163dc8 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:03.470767 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a615f5-4b0d-4991-b3ea-05a150163dc8 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:03.480997 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7f76f-2042-49ef-a47a-b9fafac279bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:03.481898 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7f76f-2042-49ef-a47a-b9fafac279bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:03.482360 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7f76f-2042-49ef-a47a-b9fafac279bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:03.483066 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7f76f-2042-49ef-a47a-b9fafac279bd admin admin] PATH_INFO: `/v3/projects/2891706e63ee4a9eb350d304f4be5053/users/1ddc7f8049f44a7ab005f40d7a33780d/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:03.514215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7f76f-2042-49ef-a47a-b9fafac279bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2891706e63ee4a9eb350d304f4be5053, user_id=1ddc7f8049f44a7ab005f40d7a33780d, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:03.519055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7f76f-2042-49ef-a47a-b9fafac279bd admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:03.576247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30038fd9-bb08-428e-9f25-a79169f68afd admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:03.578688 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-30038fd9-bb08-428e-9f25-a79169f68afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:03.598158 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30038fd9-bb08-428e-9f25-a79169f68afd admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:03.618355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e54141-b951-4bc6-813b-e03ea8f4547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:03.622699 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e54141-b951-4bc6-813b-e03ea8f4547d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:03.622699 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e54141-b951-4bc6-813b-e03ea8f4547d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:03.622699 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e54141-b951-4bc6-813b-e03ea8f4547d admin admin] PATH_INFO: `/v3/projects/823a6c9a6f7246ca8d94b177f72eadc1` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:03.622699 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e54141-b951-4bc6-813b-e03ea8f4547d admin admin] RBAC: Authorizing `identity:delete_project(project_id=823a6c9a6f7246ca8d94b177f72eadc1)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:03.624111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e54141-b951-4bc6-813b-e03ea8f4547d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:03.659607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 887/1792] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:03 2022] PUT /identity/v3/projects/2891706e63ee4a9eb350d304f4be5053/users/1ddc7f8049f44a7ab005f40d7a33780d/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:03.664100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7f76f-2042-49ef-a47a-b9fafac279bd admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:03.799287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7f76f-2042-49ef-a47a-b9fafac279bd admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:03.804527 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-79e54141-b951-4bc6-813b-e03ea8f4547d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '823a6c9a6f7246ca8d94b177f72eadc1', 'request_id': 'req-79e54141-b951-4bc6-813b-e03ea8f4547d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:03.895468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da172652-47d3-40e7-a391-66b279cd3254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:03.896313 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da172652-47d3-40e7-a391-66b279cd3254 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:03.896495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da172652-47d3-40e7-a391-66b279cd3254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:03.896848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da172652-47d3-40e7-a391-66b279cd3254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:03.898140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da172652-47d3-40e7-a391-66b279cd3254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:03.899592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da172652-47d3-40e7-a391-66b279cd3254 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:03.913563 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 888/1793] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:03.918007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da172652-47d3-40e7-a391-66b279cd3254 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:03.919498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-79e54141-b951-4bc6-813b-e03ea8f4547d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '823a6c9a6f7246ca8d94b177f72eadc1', 'request_id': 'req-79e54141-b951-4bc6-813b-e03ea8f4547d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:03.926148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-79e54141-b951-4bc6-813b-e03ea8f4547d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '823a6c9a6f7246ca8d94b177f72eadc1', 'request_id': 'req-79e54141-b951-4bc6-813b-e03ea8f4547d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:03.930047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da172652-47d3-40e7-a391-66b279cd3254 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:03.937323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e664a98-243b-44bb-b9a1-249ee5634016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:03.938046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e664a98-243b-44bb-b9a1-249ee5634016 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:03.938410 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e664a98-243b-44bb-b9a1-249ee5634016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:03.938804 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e664a98-243b-44bb-b9a1-249ee5634016 admin admin] PATH_INFO: `/v3/projects/2891706e63ee4a9eb350d304f4be5053/users/1ddc7f8049f44a7ab005f40d7a33780d/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:03.939083 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-79e54141-b951-4bc6-813b-e03ea8f4547d admin admin] The token cache is being invalidate because project 823a6c9a6f7246ca8d94b177f72eadc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:03.939472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-79e54141-b951-4bc6-813b-e03ea8f4547d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:03.940297 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-79e54141-b951-4bc6-813b-e03ea8f4547d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:03.941790 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e664a98-243b-44bb-b9a1-249ee5634016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2891706e63ee4a9eb350d304f4be5053, user_id=1ddc7f8049f44a7ab005f40d7a33780d, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:03.945857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 906/1794] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:03 2022] DELETE /identity/v3/projects/823a6c9a6f7246ca8d94b177f72eadc1 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:03.946000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e664a98-243b-44bb-b9a1-249ee5634016 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:03.947536 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa10dc-7da1-48fb-887d-d85db125e3ac None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:03.947825 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa10dc-7da1-48fb-887d-d85db125e3ac None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:03.948105 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa10dc-7da1-48fb-887d-d85db125e3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:03.971699 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 889/1795] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:03 2022] PUT /identity/v3/projects/2891706e63ee4a9eb350d304f4be5053/users/1ddc7f8049f44a7ab005f40d7a33780d/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:03.982389 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154cad7-54ca-4b2d-9f3a-eb242037ac87 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:03.982707 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154cad7-54ca-4b2d-9f3a-eb242037ac87 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:03.983272 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154cad7-54ca-4b2d-9f3a-eb242037ac87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:03.987412 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c3aa10dc-7da1-48fb-887d-d85db125e3ac None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:03.989953 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c3aa10dc-7da1-48fb-887d-d85db125e3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:04.036538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6154cad7-54ca-4b2d-9f3a-eb242037ac87 None None] MFA Rules not processed for user `1ddc7f8049f44a7ab005f40d7a33780d`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:04.036538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6154cad7-54ca-4b2d-9f3a-eb242037ac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:04.131704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 907/1796] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:04.140113 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c99413-2029-441a-9e61-30e6daa4b7df None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:04.140316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c99413-2029-441a-9e61-30e6daa4b7df None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:04.140487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c99413-2029-441a-9e61-30e6daa4b7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:04.165003 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 890/1797] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:03 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:04.176028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-20c99413-2029-441a-9e61-30e6daa4b7df None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:04.176028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-20c99413-2029-441a-9e61-30e6daa4b7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:04.183978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154cad7-54ca-4b2d-9f3a-eb242037ac87 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:04.184452 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 908/1798] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:04.185515 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6154cad7-54ca-4b2d-9f3a-eb242037ac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:04.189175 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c99413-2029-441a-9e61-30e6daa4b7df None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:04.208337 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c99413-2029-441a-9e61-30e6daa4b7df None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:04.222078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908dbda-dab4-4dad-86d7-26d83a995368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:04.222078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908dbda-dab4-4dad-86d7-26d83a995368 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:04.222078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908dbda-dab4-4dad-86d7-26d83a995368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:04.222078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908dbda-dab4-4dad-86d7-26d83a995368 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:04.223478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908dbda-dab4-4dad-86d7-26d83a995368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:06:04.223478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908dbda-dab4-4dad-86d7-26d83a995368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:04.224875 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908dbda-dab4-4dad-86d7-26d83a995368 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:04.246127 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 909/1799] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:06:04.250717 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908dbda-dab4-4dad-86d7-26d83a995368 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:04.261495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908dbda-dab4-4dad-86d7-26d83a995368 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:04.272306 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3086ca-d098-4562-af33-ad372102779e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:04.273473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3086ca-d098-4562-af33-ad372102779e admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:04.273917 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3086ca-d098-4562-af33-ad372102779e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:04.274346 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3086ca-d098-4562-af33-ad372102779e admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:04.275029 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3086ca-d098-4562-af33-ad372102779e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:04.277168 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3086ca-d098-4562-af33-ad372102779e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:04.280259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154cad7-54ca-4b2d-9f3a-eb242037ac87 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:04.285016 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dd858-910b-434a-ac3f-0c26d4d63d42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:04.285788 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dd858-910b-434a-ac3f-0c26d4d63d42 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:04.285917 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dd858-910b-434a-ac3f-0c26d4d63d42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:04.286195 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dd858-910b-434a-ac3f-0c26d4d63d42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:04.296200 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dd858-910b-434a-ac3f-0c26d4d63d42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:04.298063 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dd858-910b-434a-ac3f-0c26d4d63d42 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:04.310304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 891/1800] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:04 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:06:04.476522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 910/1801] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:04 2022] POST /identity/v3/projects => generated 379 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:04.476871 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dd858-910b-434a-ac3f-0c26d4d63d42 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:04.488487 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dd858-910b-434a-ac3f-0c26d4d63d42 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:04.578547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1245d7-08d6-4498-99c3-c5567e080935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:04.580782 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1245d7-08d6-4498-99c3-c5567e080935 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:04.581231 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1245d7-08d6-4498-99c3-c5567e080935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:04.581703 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1245d7-08d6-4498-99c3-c5567e080935 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:04.583006 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1245d7-08d6-4498-99c3-c5567e080935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:04.585765 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1245d7-08d6-4498-99c3-c5567e080935 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:04.748239 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 892/1802] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:04 2022] POST /identity/v3/users => generated 290 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:04.752318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3086ca-d098-4562-af33-ad372102779e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:04.764320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3086ca-d098-4562-af33-ad372102779e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:04.769734 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5e939-7de0-48ad-972a-16fad51539f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:04.770412 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5e939-7de0-48ad-972a-16fad51539f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:04.770699 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5e939-7de0-48ad-972a-16fad51539f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:04.771051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5e939-7de0-48ad-972a-16fad51539f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:04.771772 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5e939-7de0-48ad-972a-16fad51539f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:04.773570 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5e939-7de0-48ad-972a-16fad51539f6 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:04.791353 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 911/1803] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:04.795373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1245d7-08d6-4498-99c3-c5567e080935 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:04.818073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5e939-7de0-48ad-972a-16fad51539f6 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:04.820075 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-37d5e939-7de0-48ad-972a-16fad51539f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:04.828429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1245d7-08d6-4498-99c3-c5567e080935 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:04.846725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66744cd-cb5a-4d12-bd6d-c1edd3f74b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:04.846725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66744cd-cb5a-4d12-bd6d-c1edd3f74b58 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:04.846725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66744cd-cb5a-4d12-bd6d-c1edd3f74b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:04.846725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66744cd-cb5a-4d12-bd6d-c1edd3f74b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:04.856726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66744cd-cb5a-4d12-bd6d-c1edd3f74b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:04.860200 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66744cd-cb5a-4d12-bd6d-c1edd3f74b58 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:04.868342 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:04.876537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 893/1804] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:04.880275 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66744cd-cb5a-4d12-bd6d-c1edd3f74b58 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:04.891316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66744cd-cb5a-4d12-bd6d-c1edd3f74b58 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:04.896645 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf09268-602d-4740-84ab-876958817d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:04.897401 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf09268-602d-4740-84ab-876958817d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:04.897749 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf09268-602d-4740-84ab-876958817d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:04.898033 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf09268-602d-4740-84ab-876958817d31 admin admin] PATH_INFO: `/v3/projects/27c03616cb40498ebc9a8491312f5c4f/users/e216281f15924e079506fc2d716b24e4/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:04.929058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf09268-602d-4740-84ab-876958817d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27c03616cb40498ebc9a8491312f5c4f, user_id=e216281f15924e079506fc2d716b24e4, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:04.936321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf09268-602d-4740-84ab-876958817d31 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:04.954850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5e939-7de0-48ad-972a-16fad51539f6 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:04.960545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55747005-c71f-4833-9f84-58133004c3e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:04.961816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55747005-c71f-4833-9f84-58133004c3e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:04.962125 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55747005-c71f-4833-9f84-58133004c3e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:04.962561 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55747005-c71f-4833-9f84-58133004c3e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:04.973948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-55747005-c71f-4833-9f84-58133004c3e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:05.036943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55747005-c71f-4833-9f84-58133004c3e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:05.038426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55747005-c71f-4833-9f84-58133004c3e1 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:05.048077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 912/1805] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:05.048963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 894/1806] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:04 2022] PUT /identity/v3/projects/27c03616cb40498ebc9a8491312f5c4f/users/e216281f15924e079506fc2d716b24e4/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:05.059635 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb7177-d069-4b74-8d19-0e52df5b3af2 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:05.059924 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb7177-d069-4b74-8d19-0e52df5b3af2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:05.060204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb7177-d069-4b74-8d19-0e52df5b3af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:05.084285 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf09268-602d-4740-84ab-876958817d31 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:05.086417 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9bf09268-602d-4740-84ab-876958817d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:05.090322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d1bb7177-d069-4b74-8d19-0e52df5b3af2 None None] MFA Rules not processed for user `e216281f15924e079506fc2d716b24e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:05.091597 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d1bb7177-d069-4b74-8d19-0e52df5b3af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:05.151984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:05.164298 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf09268-602d-4740-84ab-876958817d31 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:05.170296 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da5235-a56a-49e7-b2b7-378ee200ea68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:05.170951 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da5235-a56a-49e7-b2b7-378ee200ea68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:05.171429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da5235-a56a-49e7-b2b7-378ee200ea68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:05.172017 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da5235-a56a-49e7-b2b7-378ee200ea68 admin admin] PATH_INFO: `/v3/users/8e3b83abf666402c97a130508a07a755` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:05.173599 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da5235-a56a-49e7-b2b7-378ee200ea68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e3b83abf666402c97a130508a07a755)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:05.176371 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da5235-a56a-49e7-b2b7-378ee200ea68 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:05.196292 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 913/1807] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:05.200876 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb7177-d069-4b74-8d19-0e52df5b3af2 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:05.210550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb7177-d069-4b74-8d19-0e52df5b3af2 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:05.215504 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af30f25-82c6-4573-901b-4e0bd36a00f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:05.216293 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af30f25-82c6-4573-901b-4e0bd36a00f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:05.216575 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af30f25-82c6-4573-901b-4e0bd36a00f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:05.217010 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af30f25-82c6-4573-901b-4e0bd36a00f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:05.217688 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af30f25-82c6-4573-901b-4e0bd36a00f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:05.219801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af30f25-82c6-4573-901b-4e0bd36a00f8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:05.362039 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 914/1808] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:05 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:05.364006 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af30f25-82c6-4573-901b-4e0bd36a00f8 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:05.426173 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af30f25-82c6-4573-901b-4e0bd36a00f8 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:05.430847 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f45a8-5c60-4c96-9c25-00a6679ffd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:05.431469 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f45a8-5c60-4c96-9c25-00a6679ffd53 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:05.431751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f45a8-5c60-4c96-9c25-00a6679ffd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:05.432023 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f45a8-5c60-4c96-9c25-00a6679ffd53 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:05.432685 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f45a8-5c60-4c96-9c25-00a6679ffd53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:05.434667 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f45a8-5c60-4c96-9c25-00a6679ffd53 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:05.479462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-11da5235-a56a-49e7-b2b7-378ee200ea68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e3b83abf666402c97a130508a07a755'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:05.480085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-11da5235-a56a-49e7-b2b7-378ee200ea68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e3b83abf666402c97a130508a07a755'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:05.493172 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-11da5235-a56a-49e7-b2b7-378ee200ea68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e3b83abf666402c97a130508a07a755'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:05.500097 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-11da5235-a56a-49e7-b2b7-378ee200ea68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e3b83abf666402c97a130508a07a755'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:05.500799 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-11da5235-a56a-49e7-b2b7-378ee200ea68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e3b83abf666402c97a130508a07a755'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:05.558194 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 915/1809] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:05 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:05.562078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f45a8-5c60-4c96-9c25-00a6679ffd53 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:05.563820 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-800f45a8-5c60-4c96-9c25-00a6679ffd53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:05.576015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f45a8-5c60-4c96-9c25-00a6679ffd53 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:05.580945 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d92e9f-f1e8-4330-9566-da44a8ba9b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:05.581558 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d92e9f-f1e8-4330-9566-da44a8ba9b3f admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:05.581845 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d92e9f-f1e8-4330-9566-da44a8ba9b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:05.582127 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d92e9f-f1e8-4330-9566-da44a8ba9b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:05.582858 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d92e9f-f1e8-4330-9566-da44a8ba9b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:05.584476 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d92e9f-f1e8-4330-9566-da44a8ba9b3f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:05.600550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 916/1810] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:06:05.601428 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d92e9f-f1e8-4330-9566-da44a8ba9b3f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:05.611787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d92e9f-f1e8-4330-9566-da44a8ba9b3f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:05.617881 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11337d6-396f-40b1-a886-9354f0e2a11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:05.618662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11337d6-396f-40b1-a886-9354f0e2a11b admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:05.618949 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11337d6-396f-40b1-a886-9354f0e2a11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:05.619320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11337d6-396f-40b1-a886-9354f0e2a11b admin admin] PATH_INFO: `/v3/projects/bbabfd7025be4da5bd8adba12b997690/users/a3a718584c764bdbb2d3418df4b3376a/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:05.636077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11337d6-396f-40b1-a886-9354f0e2a11b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbabfd7025be4da5bd8adba12b997690, user_id=a3a718584c764bdbb2d3418df4b3376a, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:05.638827 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11337d6-396f-40b1-a886-9354f0e2a11b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:05.699971 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 895/1811] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:05 2022] DELETE /identity/v3/users/8e3b83abf666402c97a130508a07a755 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:05.704338 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e89e74-77f7-45b4-8aad-80568c639227 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:05.704634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e89e74-77f7-45b4-8aad-80568c639227 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:05.704956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e89e74-77f7-45b4-8aad-80568c639227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:05.718326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 917/1812] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:05 2022] PUT /identity/v3/projects/bbabfd7025be4da5bd8adba12b997690/users/a3a718584c764bdbb2d3418df4b3376a/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:05.723674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11337d6-396f-40b1-a886-9354f0e2a11b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:05.725374 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-35e89e74-77f7-45b4-8aad-80568c639227 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:05.726589 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-35e89e74-77f7-45b4-8aad-80568c639227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:05.787926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11337d6-396f-40b1-a886-9354f0e2a11b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:05.793217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 896/1813] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:05.796189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53bdc2-ad20-4d31-8c32-c1a39490c13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:05.797430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53bdc2-ad20-4d31-8c32-c1a39490c13c admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:05.797430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53bdc2-ad20-4d31-8c32-c1a39490c13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:05.797724 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53bdc2-ad20-4d31-8c32-c1a39490c13c admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:05.798445 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53bdc2-ad20-4d31-8c32-c1a39490c13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:05.800096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53bdc2-ad20-4d31-8c32-c1a39490c13c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:05.805751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e89e74-77f7-45b4-8aad-80568c639227 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:05.807437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-35e89e74-77f7-45b4-8aad-80568c639227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:05.812400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 918/1814] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:06:05.816035 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53bdc2-ad20-4d31-8c32-c1a39490c13c admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:05.826207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53bdc2-ad20-4d31-8c32-c1a39490c13c admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:05.831061 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5546a1-de69-4987-9ab8-fc4ed451045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:05.831793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5546a1-de69-4987-9ab8-fc4ed451045a admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:05.832117 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5546a1-de69-4987-9ab8-fc4ed451045a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:05.832397 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5546a1-de69-4987-9ab8-fc4ed451045a admin admin] PATH_INFO: `/v3/projects/bbabfd7025be4da5bd8adba12b997690/users/a3a718584c764bdbb2d3418df4b3376a/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:05.834737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5546a1-de69-4987-9ab8-fc4ed451045a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbabfd7025be4da5bd8adba12b997690, user_id=a3a718584c764bdbb2d3418df4b3376a, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:05.837499 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5546a1-de69-4987-9ab8-fc4ed451045a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:05.849108 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 919/1815] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:05 2022] PUT /identity/v3/projects/bbabfd7025be4da5bd8adba12b997690/users/a3a718584c764bdbb2d3418df4b3376a/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:05.862083 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3613d-7b27-4c46-9d16-cf72bdd263fa None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:05.862375 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3613d-7b27-4c46-9d16-cf72bdd263fa None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:05.862658 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3613d-7b27-4c46-9d16-cf72bdd263fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:05.886520 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e89e74-77f7-45b4-8aad-80568c639227 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:05.891968 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-9df3613d-7b27-4c46-9d16-cf72bdd263fa None None] MFA Rules not processed for user `a3a718584c764bdbb2d3418df4b3376a`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:05.893305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9df3613d-7b27-4c46-9d16-cf72bdd263fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:05.935387 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a17c5-e9af-4a94-9a67-c2bb64fc4b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:05.935387 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a17c5-e9af-4a94-9a67-c2bb64fc4b81 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:05.935611 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a17c5-e9af-4a94-9a67-c2bb64fc4b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:05.935937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a17c5-e9af-4a94-9a67-c2bb64fc4b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:06.018813 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a17c5-e9af-4a94-9a67-c2bb64fc4b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:06.020419 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a17c5-e9af-4a94-9a67-c2bb64fc4b81 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:06.031399 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 897/1816] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:06.073352 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 920/1817] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:06.086469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a17c5-e9af-4a94-9a67-c2bb64fc4b81 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:06.088903 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e55a17c5-e9af-4a94-9a67-c2bb64fc4b81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:06.152445 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a17c5-e9af-4a94-9a67-c2bb64fc4b81 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:06.156145 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467d62f-b549-4dfa-b056-52a8bd054360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:06.156776 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467d62f-b549-4dfa-b056-52a8bd054360 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:06.157061 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467d62f-b549-4dfa-b056-52a8bd054360 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:06.157332 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467d62f-b549-4dfa-b056-52a8bd054360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:06.167028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467d62f-b549-4dfa-b056-52a8bd054360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:06.168460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467d62f-b549-4dfa-b056-52a8bd054360 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:06.178148 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 898/1818] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:06.490538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3613d-7b27-4c46-9d16-cf72bdd263fa None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:06.492149 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9df3613d-7b27-4c46-9d16-cf72bdd263fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:06.509469 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3613d-7b27-4c46-9d16-cf72bdd263fa None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:06.516916 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a044d03-876e-4a40-b2c3-5ea5fc29d789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:06.518280 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a044d03-876e-4a40-b2c3-5ea5fc29d789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:06.518656 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a044d03-876e-4a40-b2c3-5ea5fc29d789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:06.519118 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a044d03-876e-4a40-b2c3-5ea5fc29d789 admin admin] PATH_INFO: `/v3/projects/76e2503460814b859a69c9325c6025db` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:06.521503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a044d03-876e-4a40-b2c3-5ea5fc29d789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e2503460814b859a69c9325c6025db)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:06.524642 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a044d03-876e-4a40-b2c3-5ea5fc29d789 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:06.652884 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-1a044d03-876e-4a40-b2c3-5ea5fc29d789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e2503460814b859a69c9325c6025db', 'request_id': 'req-1a044d03-876e-4a40-b2c3-5ea5fc29d789'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:06.726950 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-1a044d03-876e-4a40-b2c3-5ea5fc29d789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e2503460814b859a69c9325c6025db', 'request_id': 'req-1a044d03-876e-4a40-b2c3-5ea5fc29d789'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:06.733747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-1a044d03-876e-4a40-b2c3-5ea5fc29d789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e2503460814b859a69c9325c6025db', 'request_id': 'req-1a044d03-876e-4a40-b2c3-5ea5fc29d789'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:06.747143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-1a044d03-876e-4a40-b2c3-5ea5fc29d789 admin admin] The token cache is being invalidate because project 76e2503460814b859a69c9325c6025db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:06.747438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-1a044d03-876e-4a40-b2c3-5ea5fc29d789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:06.748112 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-1a044d03-876e-4a40-b2c3-5ea5fc29d789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:06.750003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 921/1819] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:06 2022] DELETE /identity/v3/projects/76e2503460814b859a69c9325c6025db => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:06.754755 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467d62f-b549-4dfa-b056-52a8bd054360 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:06.769030 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467d62f-b549-4dfa-b056-52a8bd054360 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:06.827982 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627006e-d685-48f5-bd6d-dfbef1d1a475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:06.828643 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627006e-d685-48f5-bd6d-dfbef1d1a475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:06.828959 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627006e-d685-48f5-bd6d-dfbef1d1a475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:06.829247 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627006e-d685-48f5-bd6d-dfbef1d1a475 admin admin] PATH_INFO: `/v3/users/6eb25d0065704fee8713fc77cc6366aa` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:06.830432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627006e-d685-48f5-bd6d-dfbef1d1a475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb25d0065704fee8713fc77cc6366aa)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:06.832389 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627006e-d685-48f5-bd6d-dfbef1d1a475 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:07.072294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3627006e-d685-48f5-bd6d-dfbef1d1a475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb25d0065704fee8713fc77cc6366aa'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:07.073319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3627006e-d685-48f5-bd6d-dfbef1d1a475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb25d0065704fee8713fc77cc6366aa'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:07.084634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3627006e-d685-48f5-bd6d-dfbef1d1a475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb25d0065704fee8713fc77cc6366aa'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:07.091355 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3627006e-d685-48f5-bd6d-dfbef1d1a475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb25d0065704fee8713fc77cc6366aa'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:07.099157 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3627006e-d685-48f5-bd6d-dfbef1d1a475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb25d0065704fee8713fc77cc6366aa'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:07.223967 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 899/1820] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:06 2022] DELETE /identity/v3/users/6eb25d0065704fee8713fc77cc6366aa => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:07.243560 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:07.440229 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a044d03-876e-4a40-b2c3-5ea5fc29d789 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:07.441734 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1a044d03-876e-4a40-b2c3-5ea5fc29d789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:07.511752 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a044d03-876e-4a40-b2c3-5ea5fc29d789 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:07.580257 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c8aa5-279c-403e-a702-b6f4074f93d6 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3a718584c764bdbb2d3418df4b3376a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbabfd7025be4da5bd8adba12b997690', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:07.580829 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c8aa5-279c-403e-a702-b6f4074f93d6 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:07.581189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c8aa5-279c-403e-a702-b6f4074f93d6 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:07.583049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c8aa5-279c-403e-a702-b6f4074f93d6 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:07.583049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c8aa5-279c-403e-a702-b6f4074f93d6 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:06:07.583361 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c8aa5-279c-403e-a702-b6f4074f93d6 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:07.585235 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c8aa5-279c-403e-a702-b6f4074f93d6 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:07.602234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 922/1821] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:06:07.603836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627006e-d685-48f5-bd6d-dfbef1d1a475 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:07.605450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3627006e-d685-48f5-bd6d-dfbef1d1a475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:07.625082 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627006e-d685-48f5-bd6d-dfbef1d1a475 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:07.632109 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43498e19-999c-43fb-a4e6-a4c3b6b08f38 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3a718584c764bdbb2d3418df4b3376a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbabfd7025be4da5bd8adba12b997690', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:07.633168 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43498e19-999c-43fb-a4e6-a4c3b6b08f38 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:07.633691 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43498e19-999c-43fb-a4e6-a4c3b6b08f38 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:07.634305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43498e19-999c-43fb-a4e6-a4c3b6b08f38 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:07.635337 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43498e19-999c-43fb-a4e6-a4c3b6b08f38 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:07.637819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43498e19-999c-43fb-a4e6-a4c3b6b08f38 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:07.815712 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c8aa5-279c-403e-a702-b6f4074f93d6 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:07.817524 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2c8c8aa5-279c-403e-a702-b6f4074f93d6 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:07.828871 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 900/1822] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:07 2022] POST /identity/v3/projects => generated 354 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:07.828871 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43498e19-999c-43fb-a4e6-a4c3b6b08f38 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:07.923408 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43498e19-999c-43fb-a4e6-a4c3b6b08f38 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:07.930575 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cc7d3-7a37-4b65-914f-23b63dd9a2e4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3a718584c764bdbb2d3418df4b3376a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbabfd7025be4da5bd8adba12b997690', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:07.931506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cc7d3-7a37-4b65-914f-23b63dd9a2e4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:07.931938 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cc7d3-7a37-4b65-914f-23b63dd9a2e4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:07.932401 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cc7d3-7a37-4b65-914f-23b63dd9a2e4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:07.933149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cc7d3-7a37-4b65-914f-23b63dd9a2e4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:06:07.933606 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cc7d3-7a37-4b65-914f-23b63dd9a2e4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:07.935628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cc7d3-7a37-4b65-914f-23b63dd9a2e4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:07.952671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 901/1823] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:06:07.960697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c8aa5-279c-403e-a702-b6f4074f93d6 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:08.036165 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cc7d3-7a37-4b65-914f-23b63dd9a2e4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:08.049713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cc7d3-7a37-4b65-914f-23b63dd9a2e4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:08.059693 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671223f6-4e8a-4a7c-a31a-3b9e1b209fe4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3a718584c764bdbb2d3418df4b3376a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbabfd7025be4da5bd8adba12b997690', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:08.060821 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671223f6-4e8a-4a7c-a31a-3b9e1b209fe4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:08.061120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671223f6-4e8a-4a7c-a31a-3b9e1b209fe4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:08.062879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671223f6-4e8a-4a7c-a31a-3b9e1b209fe4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] PATH_INFO: `/v3/projects/59d300596cb0440f994f07b1d020745f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:08.065245 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671223f6-4e8a-4a7c-a31a-3b9e1b209fe4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] RBAC: Authorizing `identity:delete_project(project_id=59d300596cb0440f994f07b1d020745f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:08.068546 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671223f6-4e8a-4a7c-a31a-3b9e1b209fe4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:08.079984 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ad455-031e-4098-8c28-eca517d9abd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:08.080535 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:08.081153 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ad455-031e-4098-8c28-eca517d9abd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:08.081153 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ad455-031e-4098-8c28-eca517d9abd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:08.081593 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ad455-031e-4098-8c28-eca517d9abd5 admin admin] PATH_INFO: `/v3/projects/ede3d98fb447480cbd2e4602379560de` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:08.082994 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ad455-031e-4098-8c28-eca517d9abd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ede3d98fb447480cbd2e4602379560de)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:08.085147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ad455-031e-4098-8c28-eca517d9abd5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:08.261520 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-671223f6-4e8a-4a7c-a31a-3b9e1b209fe4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59d300596cb0440f994f07b1d020745f', 'request_id': 'req-671223f6-4e8a-4a7c-a31a-3b9e1b209fe4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:08.261650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-723ad455-031e-4098-8c28-eca517d9abd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ede3d98fb447480cbd2e4602379560de', 'request_id': 'req-723ad455-031e-4098-8c28-eca517d9abd5'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:08.262079 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-671223f6-4e8a-4a7c-a31a-3b9e1b209fe4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59d300596cb0440f994f07b1d020745f', 'request_id': 'req-671223f6-4e8a-4a7c-a31a-3b9e1b209fe4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:08.269711 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-671223f6-4e8a-4a7c-a31a-3b9e1b209fe4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59d300596cb0440f994f07b1d020745f', 'request_id': 'req-671223f6-4e8a-4a7c-a31a-3b9e1b209fe4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:08.351981 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-723ad455-031e-4098-8c28-eca517d9abd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ede3d98fb447480cbd2e4602379560de', 'request_id': 'req-723ad455-031e-4098-8c28-eca517d9abd5'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:08.365798 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-723ad455-031e-4098-8c28-eca517d9abd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ede3d98fb447480cbd2e4602379560de', 'request_id': 'req-723ad455-031e-4098-8c28-eca517d9abd5'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:08.374828 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-723ad455-031e-4098-8c28-eca517d9abd5 admin admin] The token cache is being invalidate because project ede3d98fb447480cbd2e4602379560de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:08.375511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-723ad455-031e-4098-8c28-eca517d9abd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:08.376320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-723ad455-031e-4098-8c28-eca517d9abd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:08.379260 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 923/1824] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:07 2022] DELETE /identity/v3/projects/ede3d98fb447480cbd2e4602379560de => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:08.386747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8cf1c-362d-492e-a2bc-2f998947f780 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:08.387040 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8cf1c-362d-492e-a2bc-2f998947f780 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:08.387327 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8cf1c-362d-492e-a2bc-2f998947f780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:08.408650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e2a8cf1c-362d-492e-a2bc-2f998947f780 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:08.409918 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e2a8cf1c-362d-492e-a2bc-2f998947f780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:08.449840 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-671223f6-4e8a-4a7c-a31a-3b9e1b209fe4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] The token cache is being invalidate because project 59d300596cb0440f994f07b1d020745f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:08.450137 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-671223f6-4e8a-4a7c-a31a-3b9e1b209fe4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:08.450799 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-671223f6-4e8a-4a7c-a31a-3b9e1b209fe4 tempest-VolumeQuotaClassesTest-897125428 tempest-VolumeQuotaClassesTest-897125428-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:08.457410 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 902/1825] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:08 2022] DELETE /identity/v3/projects/59d300596cb0440f994f07b1d020745f => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:08.492947 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 924/1826] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:08.506036 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3ea9c-41d3-405e-b5b4-0f1b9d99d0d1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:08.506323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3ea9c-41d3-405e-b5b4-0f1b9d99d0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:08.506604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3ea9c-41d3-405e-b5b4-0f1b9d99d0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:08.526954 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e7c3ea9c-41d3-405e-b5b4-0f1b9d99d0d1 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:08.528165 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e7c3ea9c-41d3-405e-b5b4-0f1b9d99d0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:08.536989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 903/1827] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:08.547507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8cf1c-362d-492e-a2bc-2f998947f780 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:08.558978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8cf1c-362d-492e-a2bc-2f998947f780 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:08.564741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8911db-4140-4257-8acd-4735d3e7cc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:08.565548 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8911db-4140-4257-8acd-4735d3e7cc06 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:08.565719 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8911db-4140-4257-8acd-4735d3e7cc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:08.566040 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8911db-4140-4257-8acd-4735d3e7cc06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:08.567338 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8911db-4140-4257-8acd-4735d3e7cc06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:06:08.567802 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8911db-4140-4257-8acd-4735d3e7cc06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:08.569955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8911db-4140-4257-8acd-4735d3e7cc06 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:08.583624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 925/1828] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:06:08.588085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3ea9c-41d3-405e-b5b4-0f1b9d99d0d1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:08.598235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3ea9c-41d3-405e-b5b4-0f1b9d99d0d1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:08.603146 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894a0de-f8ef-4983-a642-3de8e1e8c043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:08.603771 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894a0de-f8ef-4983-a642-3de8e1e8c043 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:08.604058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894a0de-f8ef-4983-a642-3de8e1e8c043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:08.604339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894a0de-f8ef-4983-a642-3de8e1e8c043 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:08.605176 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894a0de-f8ef-4983-a642-3de8e1e8c043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:08.607070 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894a0de-f8ef-4983-a642-3de8e1e8c043 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:08.761242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 904/1829] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:08 2022] POST /identity/v3/projects => generated 355 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:08.765304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8911db-4140-4257-8acd-4735d3e7cc06 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:08.775952 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8911db-4140-4257-8acd-4735d3e7cc06 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:08.837357 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6318c-4104-4594-a47f-37160c1f5e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:08.837984 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6318c-4104-4594-a47f-37160c1f5e50 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:08.838263 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6318c-4104-4594-a47f-37160c1f5e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:08.838536 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6318c-4104-4594-a47f-37160c1f5e50 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:08.839205 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6318c-4104-4594-a47f-37160c1f5e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:08.841177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6318c-4104-4594-a47f-37160c1f5e50 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:08.970540 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 926/1830] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:08 2022] POST /identity/v3/users => generated 278 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:08.976232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894a0de-f8ef-4983-a642-3de8e1e8c043 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:08.988743 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894a0de-f8ef-4983-a642-3de8e1e8c043 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:08.994870 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388aa25-cdc2-4343-bbfc-cc1a2d35e6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:08.996417 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388aa25-cdc2-4343-bbfc-cc1a2d35e6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:08.996968 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388aa25-cdc2-4343-bbfc-cc1a2d35e6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:08.997442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388aa25-cdc2-4343-bbfc-cc1a2d35e6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:08.998803 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388aa25-cdc2-4343-bbfc-cc1a2d35e6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:09.001492 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388aa25-cdc2-4343-bbfc-cc1a2d35e6a3 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:09.012607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 905/1831] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:09.016934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6318c-4104-4594-a47f-37160c1f5e50 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:09.031942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6318c-4104-4594-a47f-37160c1f5e50 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:09.038127 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4feb0d3-bd5f-40ae-bb62-f3599ab13825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:09.038759 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feb0d3-bd5f-40ae-bb62-f3599ab13825 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:09.039050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feb0d3-bd5f-40ae-bb62-f3599ab13825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:09.039334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feb0d3-bd5f-40ae-bb62-f3599ab13825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:09.040045 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4feb0d3-bd5f-40ae-bb62-f3599ab13825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:09.042523 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4feb0d3-bd5f-40ae-bb62-f3599ab13825 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:09.057677 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 927/1832] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:09.065574 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388aa25-cdc2-4343-bbfc-cc1a2d35e6a3 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:09.079222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388aa25-cdc2-4343-bbfc-cc1a2d35e6a3 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:09.088093 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b165b-42b2-49f3-ad87-5729bf684f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:09.088806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b165b-42b2-49f3-ad87-5729bf684f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:09.089384 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b165b-42b2-49f3-ad87-5729bf684f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:09.092258 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b165b-42b2-49f3-ad87-5729bf684f62 admin admin] PATH_INFO: `/v3/projects/3d1c01cdc89b461ca2dd3855bd652d6b/users/d0e743068c094b63b56069e64e3a0e72/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:09.108987 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b165b-42b2-49f3-ad87-5729bf684f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1c01cdc89b461ca2dd3855bd652d6b, user_id=d0e743068c094b63b56069e64e3a0e72, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:09.111671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b165b-42b2-49f3-ad87-5729bf684f62 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:09.236923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 906/1833] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:09 2022] PUT /identity/v3/projects/3d1c01cdc89b461ca2dd3855bd652d6b/users/d0e743068c094b63b56069e64e3a0e72/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:09.247707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bd77e-19eb-4500-84de-a2b9b93e8308 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:09.248001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bd77e-19eb-4500-84de-a2b9b93e8308 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:09.248281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bd77e-19eb-4500-84de-a2b9b93e8308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:09.312080 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b165b-42b2-49f3-ad87-5729bf684f62 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:09.315761 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f83bd77e-19eb-4500-84de-a2b9b93e8308 None None] MFA Rules not processed for user `d0e743068c094b63b56069e64e3a0e72`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:09.317196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b16b165b-42b2-49f3-ad87-5729bf684f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:09.322589 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f83bd77e-19eb-4500-84de-a2b9b93e8308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:09.424947 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b165b-42b2-49f3-ad87-5729bf684f62 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:09.434706 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9719cf9-4c41-4256-8bcf-cbe4cb61305b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:09.435780 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 928/1834] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:09 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:09.437309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9719cf9-4c41-4256-8bcf-cbe4cb61305b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:09.437659 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9719cf9-4c41-4256-8bcf-cbe4cb61305b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:09.438010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9719cf9-4c41-4256-8bcf-cbe4cb61305b admin admin] PATH_INFO: `/v3/users/e216281f15924e079506fc2d716b24e4` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:09.439619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bd77e-19eb-4500-84de-a2b9b93e8308 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:09.442377 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9719cf9-4c41-4256-8bcf-cbe4cb61305b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e216281f15924e079506fc2d716b24e4)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:09.444398 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9719cf9-4c41-4256-8bcf-cbe4cb61305b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:09.458650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bd77e-19eb-4500-84de-a2b9b93e8308 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:09.464850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2ab9b-e8be-4e04-a2ac-a327dd56b56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:09.465623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2ab9b-e8be-4e04-a2ac-a327dd56b56e admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:09.466009 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2ab9b-e8be-4e04-a2ac-a327dd56b56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:09.466383 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2ab9b-e8be-4e04-a2ac-a327dd56b56e admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:09.467232 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2ab9b-e8be-4e04-a2ac-a327dd56b56e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:09.469666 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2ab9b-e8be-4e04-a2ac-a327dd56b56e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:09.478039 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:09.652032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 929/1835] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:09 2022] POST /identity/v3/projects => generated 357 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:09.655512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2ab9b-e8be-4e04-a2ac-a327dd56b56e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:09.725025 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2ab9b-e8be-4e04-a2ac-a327dd56b56e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:09.730056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7916952-4207-4942-ad43-2384b9aa0a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:09.730693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7916952-4207-4942-ad43-2384b9aa0a87 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:09.730978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7916952-4207-4942-ad43-2384b9aa0a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:09.731259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7916952-4207-4942-ad43-2384b9aa0a87 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:09.731941 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7916952-4207-4942-ad43-2384b9aa0a87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:09.734087 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7916952-4207-4942-ad43-2384b9aa0a87 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:09.755780 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d9719cf9-4c41-4256-8bcf-cbe4cb61305b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e216281f15924e079506fc2d716b24e4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:09.756455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d9719cf9-4c41-4256-8bcf-cbe4cb61305b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e216281f15924e079506fc2d716b24e4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:09.768691 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d9719cf9-4c41-4256-8bcf-cbe4cb61305b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e216281f15924e079506fc2d716b24e4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:09.775646 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d9719cf9-4c41-4256-8bcf-cbe4cb61305b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e216281f15924e079506fc2d716b24e4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:09.776324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d9719cf9-4c41-4256-8bcf-cbe4cb61305b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e216281f15924e079506fc2d716b24e4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:09.853425 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 930/1837] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:09 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:09.854628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 907/1837] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:09 2022] DELETE /identity/v3/users/e216281f15924e079506fc2d716b24e4 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:09.857368 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9719cf9-4c41-4256-8bcf-cbe4cb61305b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:09.858526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a47229-fa22-4b7e-8d79-b4acae0ab92b None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:09.858785 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a47229-fa22-4b7e-8d79-b4acae0ab92b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:09.859072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a47229-fa22-4b7e-8d79-b4acae0ab92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:09.859475 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d9719cf9-4c41-4256-8bcf-cbe4cb61305b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:09.885306 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e5a47229-fa22-4b7e-8d79-b4acae0ab92b None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:09.887319 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e5a47229-fa22-4b7e-8d79-b4acae0ab92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:09.938382 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9719cf9-4c41-4256-8bcf-cbe4cb61305b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:09.943245 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921b55b-25a1-480b-bcfc-c2b602d9a353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:09.943866 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b55b-25a1-480b-bcfc-c2b602d9a353 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:09.944145 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b55b-25a1-480b-bcfc-c2b602d9a353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:09.944418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b55b-25a1-480b-bcfc-c2b602d9a353 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:09.945166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921b55b-25a1-480b-bcfc-c2b602d9a353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:09.950432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921b55b-25a1-480b-bcfc-c2b602d9a353 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:09.957921 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 908/1838] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:09.961854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 931/1839] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:09.962168 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921b55b-25a1-480b-bcfc-c2b602d9a353 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:09.971449 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a47229-fa22-4b7e-8d79-b4acae0ab92b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:09.973910 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921b55b-25a1-480b-bcfc-c2b602d9a353 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:09.974245 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e5a47229-fa22-4b7e-8d79-b4acae0ab92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:09.979225 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a336d7c-281e-4c25-b879-2761a17f6924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:09.979797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a336d7c-281e-4c25-b879-2761a17f6924 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:09.980087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a336d7c-281e-4c25-b879-2761a17f6924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:09.980366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a336d7c-281e-4c25-b879-2761a17f6924 admin admin] PATH_INFO: `/v3/projects/3f658b281adf4ebcb520725dde39c665/users/239da6cfeedc4793ade20666f993b1c4/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:09.998195 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a336d7c-281e-4c25-b879-2761a17f6924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f658b281adf4ebcb520725dde39c665, user_id=239da6cfeedc4793ade20666f993b1c4, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:10.000946 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a336d7c-281e-4c25-b879-2761a17f6924 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:10.047273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a47229-fa22-4b7e-8d79-b4acae0ab92b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:10.051392 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b1dec-9b19-4e59-b723-40439c7a375d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:10.052018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b1dec-9b19-4e59-b723-40439c7a375d service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:10.052298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b1dec-9b19-4e59-b723-40439c7a375d service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:10.052574 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b1dec-9b19-4e59-b723-40439c7a375d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:10.062225 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b1dec-9b19-4e59-b723-40439c7a375d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:10.063653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b1dec-9b19-4e59-b723-40439c7a375d service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:10.073465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 932/1840] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:06:10.109774 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 909/1841] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:09 2022] PUT /identity/v3/projects/3f658b281adf4ebcb520725dde39c665/users/239da6cfeedc4793ade20666f993b1c4/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:10.111067 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b1dec-9b19-4e59-b723-40439c7a375d service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:10.122136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b1dec-9b19-4e59-b723-40439c7a375d service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:10.189665 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae809e-c6d8-478f-b500-cf33c6b3282d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:10.193318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae809e-c6d8-478f-b500-cf33c6b3282d admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:10.193318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae809e-c6d8-478f-b500-cf33c6b3282d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:10.193318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae809e-c6d8-478f-b500-cf33c6b3282d admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:10.193318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae809e-c6d8-478f-b500-cf33c6b3282d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:10.193318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae809e-c6d8-478f-b500-cf33c6b3282d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:10.203056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 933/1842] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:10.207632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a336d7c-281e-4c25-b879-2761a17f6924 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:10.217878 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a336d7c-281e-4c25-b879-2761a17f6924 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:10.223181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe52d8-52b8-407e-8a0c-37a14c09e258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:10.223836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe52d8-52b8-407e-8a0c-37a14c09e258 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:10.224121 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe52d8-52b8-407e-8a0c-37a14c09e258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:10.224380 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe52d8-52b8-407e-8a0c-37a14c09e258 admin admin] PATH_INFO: `/v3/projects/3f658b281adf4ebcb520725dde39c665/users/239da6cfeedc4793ade20666f993b1c4/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:10.226345 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe52d8-52b8-407e-8a0c-37a14c09e258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f658b281adf4ebcb520725dde39c665, user_id=239da6cfeedc4793ade20666f993b1c4, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:10.228978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe52d8-52b8-407e-8a0c-37a14c09e258 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:10.240551 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 910/1843] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:10 2022] PUT /identity/v3/projects/3f658b281adf4ebcb520725dde39c665/users/239da6cfeedc4793ade20666f993b1c4/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:10.252080 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cde261-5631-4b49-a4f3-67eb41d57730 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:10.253259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cde261-5631-4b49-a4f3-67eb41d57730 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:10.253838 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cde261-5631-4b49-a4f3-67eb41d57730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:10.290450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-86cde261-5631-4b49-a4f3-67eb41d57730 None None] MFA Rules not processed for user `239da6cfeedc4793ade20666f993b1c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:10.291818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-86cde261-5631-4b49-a4f3-67eb41d57730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:10.392179 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 934/1844] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:10 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:10.408017 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe52d8-52b8-407e-8a0c-37a14c09e258 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:10.412421 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2cbe52d8-52b8-407e-8a0c-37a14c09e258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:10.498310 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe52d8-52b8-407e-8a0c-37a14c09e258 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:10.511148 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f4e11-04e2-47a2-abe2-b4cf559284f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:10.512248 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f4e11-04e2-47a2-abe2-b4cf559284f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:10.512829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f4e11-04e2-47a2-abe2-b4cf559284f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:10.513233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f4e11-04e2-47a2-abe2-b4cf559284f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:10.527307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f4e11-04e2-47a2-abe2-b4cf559284f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:10.528780 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f4e11-04e2-47a2-abe2-b4cf559284f9 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:10.539999 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 911/1845] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:10 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:10.650447 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cde261-5631-4b49-a4f3-67eb41d57730 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:10.652191 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-86cde261-5631-4b49-a4f3-67eb41d57730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:10.751242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cde261-5631-4b49-a4f3-67eb41d57730 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:10.761089 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ee56e-f3ab-4cb0-b4bf-10c9ac1834aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:10.783671 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ee56e-f3ab-4cb0-b4bf-10c9ac1834aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:10.783671 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ee56e-f3ab-4cb0-b4bf-10c9ac1834aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:10.783671 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ee56e-f3ab-4cb0-b4bf-10c9ac1834aa admin admin] PATH_INFO: `/v3/projects/27c03616cb40498ebc9a8491312f5c4f` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:10.783671 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ee56e-f3ab-4cb0-b4bf-10c9ac1834aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=27c03616cb40498ebc9a8491312f5c4f)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:10.783671 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ee56e-f3ab-4cb0-b4bf-10c9ac1834aa admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:10.888897 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f4e11-04e2-47a2-abe2-b4cf559284f9 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:10.890465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-249f4e11-04e2-47a2-abe2-b4cf559284f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:10.902214 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f4e11-04e2-47a2-abe2-b4cf559284f9 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:10.913908 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-783ee56e-f3ab-4cb0-b4bf-10c9ac1834aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27c03616cb40498ebc9a8491312f5c4f', 'request_id': 'req-783ee56e-f3ab-4cb0-b4bf-10c9ac1834aa'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:10.954183 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0634cd-6e90-4769-8056-c7c24996ba77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:10.957537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0634cd-6e90-4769-8056-c7c24996ba77 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:10.958065 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0634cd-6e90-4769-8056-c7c24996ba77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:10.958169 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0634cd-6e90-4769-8056-c7c24996ba77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:10.960004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5d0634cd-6e90-4769-8056-c7c24996ba77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:11.022212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0634cd-6e90-4769-8056-c7c24996ba77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:11.023531 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0634cd-6e90-4769-8056-c7c24996ba77 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:11.024138 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-783ee56e-f3ab-4cb0-b4bf-10c9ac1834aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27c03616cb40498ebc9a8491312f5c4f', 'request_id': 'req-783ee56e-f3ab-4cb0-b4bf-10c9ac1834aa'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:11.030972 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-783ee56e-f3ab-4cb0-b4bf-10c9ac1834aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27c03616cb40498ebc9a8491312f5c4f', 'request_id': 'req-783ee56e-f3ab-4cb0-b4bf-10c9ac1834aa'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:11.032743 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 912/1846] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:10 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:06:11.046122 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-783ee56e-f3ab-4cb0-b4bf-10c9ac1834aa admin admin] The token cache is being invalidate because project 27c03616cb40498ebc9a8491312f5c4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:11.046582 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-783ee56e-f3ab-4cb0-b4bf-10c9ac1834aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:11.047487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-783ee56e-f3ab-4cb0-b4bf-10c9ac1834aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:11.050136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 935/1847] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:10 2022] DELETE /identity/v3/projects/27c03616cb40498ebc9a8491312f5c4f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:11.054908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0634cd-6e90-4769-8056-c7c24996ba77 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:11.131337 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0634cd-6e90-4769-8056-c7c24996ba77 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:11.136008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83fb1a-76e1-40d8-814b-5a5325caac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:11.136693 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83fb1a-76e1-40d8-814b-5a5325caac1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:11.137007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83fb1a-76e1-40d8-814b-5a5325caac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:11.137286 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83fb1a-76e1-40d8-814b-5a5325caac1b admin admin] PATH_INFO: `/v3/users/a3a718584c764bdbb2d3418df4b3376a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:11.138468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83fb1a-76e1-40d8-814b-5a5325caac1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a718584c764bdbb2d3418df4b3376a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:11.140382 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83fb1a-76e1-40d8-814b-5a5325caac1b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:11.306316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:11.387292 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9c83fb1a-76e1-40d8-814b-5a5325caac1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a718584c764bdbb2d3418df4b3376a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:11.388001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9c83fb1a-76e1-40d8-814b-5a5325caac1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a718584c764bdbb2d3418df4b3376a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:11.399849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9c83fb1a-76e1-40d8-814b-5a5325caac1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a718584c764bdbb2d3418df4b3376a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:11.406886 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9c83fb1a-76e1-40d8-814b-5a5325caac1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a718584c764bdbb2d3418df4b3376a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:11.407609 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9c83fb1a-76e1-40d8-814b-5a5325caac1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a718584c764bdbb2d3418df4b3376a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:11.589173 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 913/1848] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:11 2022] DELETE /identity/v3/users/a3a718584c764bdbb2d3418df4b3376a => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:12.177194 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ee56e-f3ab-4cb0-b4bf-10c9ac1834aa admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:12.179252 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-783ee56e-f3ab-4cb0-b4bf-10c9ac1834aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:12.194119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ee56e-f3ab-4cb0-b4bf-10c9ac1834aa admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:12.252003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72feeaa8-d9ca-4863-bf5b-f3fbc9c3d019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:12.252700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72feeaa8-d9ca-4863-bf5b-f3fbc9c3d019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:12.253018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72feeaa8-d9ca-4863-bf5b-f3fbc9c3d019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:12.253376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72feeaa8-d9ca-4863-bf5b-f3fbc9c3d019 admin admin] PATH_INFO: `/v3/projects/bbabfd7025be4da5bd8adba12b997690` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:12.255286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72feeaa8-d9ca-4863-bf5b-f3fbc9c3d019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbabfd7025be4da5bd8adba12b997690)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:12.257846 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72feeaa8-d9ca-4863-bf5b-f3fbc9c3d019 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:12.274119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83fb1a-76e1-40d8-814b-5a5325caac1b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:12.275665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9c83fb1a-76e1-40d8-814b-5a5325caac1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:12.289882 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83fb1a-76e1-40d8-814b-5a5325caac1b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:12.295977 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63fe9c-968e-4fe5-ab5d-f331baa4532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:12.296629 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63fe9c-968e-4fe5-ab5d-f331baa4532d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:12.296955 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63fe9c-968e-4fe5-ab5d-f331baa4532d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:12.297236 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63fe9c-968e-4fe5-ab5d-f331baa4532d admin admin] PATH_INFO: `/v3/users/18a7a787dee142738bdcb2eeadbb7fbf` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:12.298418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63fe9c-968e-4fe5-ab5d-f331baa4532d admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a7a787dee142738bdcb2eeadbb7fbf)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:12.300347 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63fe9c-968e-4fe5-ab5d-f331baa4532d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:12.368979 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-72feeaa8-d9ca-4863-bf5b-f3fbc9c3d019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbabfd7025be4da5bd8adba12b997690', 'request_id': 'req-72feeaa8-d9ca-4863-bf5b-f3fbc9c3d019'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:12.475390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-72feeaa8-d9ca-4863-bf5b-f3fbc9c3d019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbabfd7025be4da5bd8adba12b997690', 'request_id': 'req-72feeaa8-d9ca-4863-bf5b-f3fbc9c3d019'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:12.481961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-72feeaa8-d9ca-4863-bf5b-f3fbc9c3d019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbabfd7025be4da5bd8adba12b997690', 'request_id': 'req-72feeaa8-d9ca-4863-bf5b-f3fbc9c3d019'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:12.493937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-72feeaa8-d9ca-4863-bf5b-f3fbc9c3d019 admin admin] The token cache is being invalidate because project bbabfd7025be4da5bd8adba12b997690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:12.494238 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-72feeaa8-d9ca-4863-bf5b-f3fbc9c3d019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:12.494927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-72feeaa8-d9ca-4863-bf5b-f3fbc9c3d019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:12.496515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 936/1849] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:12 2022] DELETE /identity/v3/projects/bbabfd7025be4da5bd8adba12b997690 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:12.501520 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1727cb2-2e8b-40ba-8aa2-59b10320b69c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:12.501811 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1727cb2-2e8b-40ba-8aa2-59b10320b69c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:12.502091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1727cb2-2e8b-40ba-8aa2-59b10320b69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:12.523038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f1727cb2-2e8b-40ba-8aa2-59b10320b69c None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:12.524251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f1727cb2-2e8b-40ba-8aa2-59b10320b69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:12.528096 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ce63fe9c-968e-4fe5-ab5d-f331baa4532d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a7a787dee142738bdcb2eeadbb7fbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:12.528811 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ce63fe9c-968e-4fe5-ab5d-f331baa4532d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a7a787dee142738bdcb2eeadbb7fbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:12.540904 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ce63fe9c-968e-4fe5-ab5d-f331baa4532d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a7a787dee142738bdcb2eeadbb7fbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:12.547869 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ce63fe9c-968e-4fe5-ab5d-f331baa4532d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a7a787dee142738bdcb2eeadbb7fbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:12.548613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ce63fe9c-968e-4fe5-ab5d-f331baa4532d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a7a787dee142738bdcb2eeadbb7fbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:12.562832 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:12.584588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 937/1850] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:12.591824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dbf66-5e2c-4fbc-b4f7-4bafa1fc0a30 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:12.592116 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dbf66-5e2c-4fbc-b4f7-4bafa1fc0a30 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:12.592398 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dbf66-5e2c-4fbc-b4f7-4bafa1fc0a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:12.613073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-473dbf66-5e2c-4fbc-b4f7-4bafa1fc0a30 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:12.614173 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-473dbf66-5e2c-4fbc-b4f7-4bafa1fc0a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:12.623000 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 938/1851] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:12.627050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473dbf66-5e2c-4fbc-b4f7-4bafa1fc0a30 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:12.636451 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473dbf66-5e2c-4fbc-b4f7-4bafa1fc0a30 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:12.641794 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285e030-861e-4608-bc1b-4f6d8bc98d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:12.642420 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285e030-861e-4608-bc1b-4f6d8bc98d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:12.642705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285e030-861e-4608-bc1b-4f6d8bc98d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:12.646458 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 914/1852] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:12 2022] DELETE /identity/v3/users/18a7a787dee142738bdcb2eeadbb7fbf => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:12.647051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285e030-861e-4608-bc1b-4f6d8bc98d2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:12.647051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285e030-861e-4608-bc1b-4f6d8bc98d2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:06:12.647051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285e030-861e-4608-bc1b-4f6d8bc98d2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:12.647051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285e030-861e-4608-bc1b-4f6d8bc98d2b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:12.649601 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a37d9-24e1-409d-ae22-c23d47baadd6 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:12.649965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a37d9-24e1-409d-ae22-c23d47baadd6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:12.650340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a37d9-24e1-409d-ae22-c23d47baadd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:12.663935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 939/1853] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:06:12.665702 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285e030-861e-4608-bc1b-4f6d8bc98d2b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:12.677697 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2d7a37d9-24e1-409d-ae22-c23d47baadd6 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:12.679379 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2d7a37d9-24e1-409d-ae22-c23d47baadd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:12.680604 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285e030-861e-4608-bc1b-4f6d8bc98d2b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:12.765936 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 915/1854] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:12.775905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a37d9-24e1-409d-ae22-c23d47baadd6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:12.778591 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2d7a37d9-24e1-409d-ae22-c23d47baadd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:12.801059 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec4ace-89d4-4dbd-84f8-2d3b4040870f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:12.802202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec4ace-89d4-4dbd-84f8-2d3b4040870f admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:12.802595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec4ace-89d4-4dbd-84f8-2d3b4040870f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:12.802959 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec4ace-89d4-4dbd-84f8-2d3b4040870f admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:12.804059 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec4ace-89d4-4dbd-84f8-2d3b4040870f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:12.805832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec4ace-89d4-4dbd-84f8-2d3b4040870f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:12.849197 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a37d9-24e1-409d-ae22-c23d47baadd6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:12.852834 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efd9ee-b7ab-4e2e-9710-e7b80a4b0209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:12.853453 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efd9ee-b7ab-4e2e-9710-e7b80a4b0209 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:12.854213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efd9ee-b7ab-4e2e-9710-e7b80a4b0209 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:12.854213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efd9ee-b7ab-4e2e-9710-e7b80a4b0209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:12.864291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efd9ee-b7ab-4e2e-9710-e7b80a4b0209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:12.865996 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efd9ee-b7ab-4e2e-9710-e7b80a4b0209 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:12.875707 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 916/1855] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:06:12.949616 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 940/1856] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:12 2022] POST /identity/v3/projects => generated 393 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:12.950820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efd9ee-b7ab-4e2e-9710-e7b80a4b0209 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:12.960768 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efd9ee-b7ab-4e2e-9710-e7b80a4b0209 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:13.018872 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aca822-c615-480c-bfc0-6f95d54c58cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:13.019492 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aca822-c615-480c-bfc0-6f95d54c58cd admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:13.019772 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aca822-c615-480c-bfc0-6f95d54c58cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:13.020047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aca822-c615-480c-bfc0-6f95d54c58cd admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:13.020705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aca822-c615-480c-bfc0-6f95d54c58cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:13.022765 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aca822-c615-480c-bfc0-6f95d54c58cd admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:13.194365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 917/1857] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:12 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:13.200977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec4ace-89d4-4dbd-84f8-2d3b4040870f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:13.217404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec4ace-89d4-4dbd-84f8-2d3b4040870f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:13.227554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f334c1-d09f-4788-bc17-54436a9376de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:13.228867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f334c1-d09f-4788-bc17-54436a9376de admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:13.229161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f334c1-d09f-4788-bc17-54436a9376de admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:13.229442 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f334c1-d09f-4788-bc17-54436a9376de admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:13.230158 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f334c1-d09f-4788-bc17-54436a9376de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:13.232540 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f334c1-d09f-4788-bc17-54436a9376de admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:13.252435 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 941/1858] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:13.252920 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aca822-c615-480c-bfc0-6f95d54c58cd admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:13.277235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aca822-c615-480c-bfc0-6f95d54c58cd admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:13.298021 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b2ec2-34a6-43cc-acd0-d50cee06be95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:13.298963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b2ec2-34a6-43cc-acd0-d50cee06be95 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:13.299242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b2ec2-34a6-43cc-acd0-d50cee06be95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:13.299513 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b2ec2-34a6-43cc-acd0-d50cee06be95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:13.300222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b2ec2-34a6-43cc-acd0-d50cee06be95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:13.303544 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b2ec2-34a6-43cc-acd0-d50cee06be95 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:13.328039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 918/1859] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:06:13.333007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f334c1-d09f-4788-bc17-54436a9376de admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:13.356928 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f334c1-d09f-4788-bc17-54436a9376de admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:13.364121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2aadef-9a57-4461-ab08-97f937c227d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:13.365574 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2aadef-9a57-4461-ab08-97f937c227d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:13.365864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2aadef-9a57-4461-ab08-97f937c227d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:13.366148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2aadef-9a57-4461-ab08-97f937c227d1 admin admin] PATH_INFO: `/v3/projects/537dec4ecafd42cba4832b612edb027f/users/734924cad70c424db01f9a80930a59b5/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:13.385154 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2aadef-9a57-4461-ab08-97f937c227d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=537dec4ecafd42cba4832b612edb027f, user_id=734924cad70c424db01f9a80930a59b5, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:13.388374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2aadef-9a57-4461-ab08-97f937c227d1 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:13.564499 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:13.574804 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 942/1860] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:13 2022] PUT /identity/v3/projects/537dec4ecafd42cba4832b612edb027f/users/734924cad70c424db01f9a80930a59b5/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:13.585137 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bb7ba-9734-439d-97f5-f7867d139310 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:13.585433 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bb7ba-9734-439d-97f5-f7867d139310 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:13.585794 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bb7ba-9734-439d-97f5-f7867d139310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:13.620382 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-721bb7ba-9734-439d-97f5-f7867d139310 None None] MFA Rules not processed for user `734924cad70c424db01f9a80930a59b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:13.621741 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-721bb7ba-9734-439d-97f5-f7867d139310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:13.713861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 919/1861] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:13.718306 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2aadef-9a57-4461-ab08-97f937c227d1 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:13.781054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2aadef-9a57-4461-ab08-97f937c227d1 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:13.786735 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b72f8-2b12-45a7-8c89-7137d3cb1854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:13.787584 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b72f8-2b12-45a7-8c89-7137d3cb1854 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:13.788026 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b72f8-2b12-45a7-8c89-7137d3cb1854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:13.788529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b72f8-2b12-45a7-8c89-7137d3cb1854 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:13.790203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b72f8-2b12-45a7-8c89-7137d3cb1854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:13.792271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b72f8-2b12-45a7-8c89-7137d3cb1854 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:13.801884 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bb7ba-9734-439d-97f5-f7867d139310 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:13.803365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-721bb7ba-9734-439d-97f5-f7867d139310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:13.823013 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bb7ba-9734-439d-97f5-f7867d139310 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:13.838819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001f42f-be54-4ad9-ae0c-c2ec40a9310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:13.839494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001f42f-be54-4ad9-ae0c-c2ec40a9310f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:13.839770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001f42f-be54-4ad9-ae0c-c2ec40a9310f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:13.840038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001f42f-be54-4ad9-ae0c-c2ec40a9310f admin admin] PATH_INFO: `/v3/projects/bf67bff6af364e1cb5299a47a0422822` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:13.841359 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001f42f-be54-4ad9-ae0c-c2ec40a9310f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf67bff6af364e1cb5299a47a0422822)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:13.843252 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001f42f-be54-4ad9-ae0c-c2ec40a9310f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:13.893558 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 943/1862] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:13 2022] POST /identity/v3/projects => generated 391 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:13.896670 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b72f8-2b12-45a7-8c89-7137d3cb1854 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:13.963860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b72f8-2b12-45a7-8c89-7137d3cb1854 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:13.968619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca02b0-5afb-4b4a-a0d6-980bb85f17ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:13.969276 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca02b0-5afb-4b4a-a0d6-980bb85f17ae admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:13.969558 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca02b0-5afb-4b4a-a0d6-980bb85f17ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:13.969890 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca02b0-5afb-4b4a-a0d6-980bb85f17ae admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:13.970565 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca02b0-5afb-4b4a-a0d6-980bb85f17ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:13.972510 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca02b0-5afb-4b4a-a0d6-980bb85f17ae admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:13.999698 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7001f42f-be54-4ad9-ae0c-c2ec40a9310f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf67bff6af364e1cb5299a47a0422822', 'request_id': 'req-7001f42f-be54-4ad9-ae0c-c2ec40a9310f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:14.005650 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7001f42f-be54-4ad9-ae0c-c2ec40a9310f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf67bff6af364e1cb5299a47a0422822', 'request_id': 'req-7001f42f-be54-4ad9-ae0c-c2ec40a9310f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:14.011885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7001f42f-be54-4ad9-ae0c-c2ec40a9310f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf67bff6af364e1cb5299a47a0422822', 'request_id': 'req-7001f42f-be54-4ad9-ae0c-c2ec40a9310f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:14.085028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 944/1863] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:13 2022] POST /identity/v3/users => generated 302 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:14.087054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca02b0-5afb-4b4a-a0d6-980bb85f17ae admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:14.098387 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca02b0-5afb-4b4a-a0d6-980bb85f17ae admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:14.116089 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7001f42f-be54-4ad9-ae0c-c2ec40a9310f admin admin] The token cache is being invalidate because project bf67bff6af364e1cb5299a47a0422822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:14.119140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7001f42f-be54-4ad9-ae0c-c2ec40a9310f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:14.119140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7001f42f-be54-4ad9-ae0c-c2ec40a9310f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:14.119831 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 920/1864] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:13 2022] DELETE /identity/v3/projects/bf67bff6af364e1cb5299a47a0422822 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:14.123636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001f42f-be54-4ad9-ae0c-c2ec40a9310f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:14.126817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7001f42f-be54-4ad9-ae0c-c2ec40a9310f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:14.213114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5558e4b-7f00-4707-a199-111a488d917b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:14.213656 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5558e4b-7f00-4707-a199-111a488d917b admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:14.213949 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5558e4b-7f00-4707-a199-111a488d917b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:14.214249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5558e4b-7f00-4707-a199-111a488d917b admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:14.214934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5558e4b-7f00-4707-a199-111a488d917b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:14.218285 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5558e4b-7f00-4707-a199-111a488d917b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:14.234820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001f42f-be54-4ad9-ae0c-c2ec40a9310f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:14.241103 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 945/1865] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:06:14.241863 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5321cd0-9c5a-417b-b40f-7efd75fc06fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:14.242725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5321cd0-9c5a-417b-b40f-7efd75fc06fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:14.243611 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5321cd0-9c5a-417b-b40f-7efd75fc06fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:14.244523 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5321cd0-9c5a-417b-b40f-7efd75fc06fd admin admin] PATH_INFO: `/v3/users/1ddc7f8049f44a7ab005f40d7a33780d` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:14.245264 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5558e4b-7f00-4707-a199-111a488d917b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:14.246296 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5321cd0-9c5a-417b-b40f-7efd75fc06fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ddc7f8049f44a7ab005f40d7a33780d)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:14.247332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d5558e4b-7f00-4707-a199-111a488d917b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:14.248950 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5321cd0-9c5a-417b-b40f-7efd75fc06fd admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:14.260887 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5558e4b-7f00-4707-a199-111a488d917b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:14.268058 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6340da-6dbc-4c9d-8702-994ca3b07b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:14.270762 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6340da-6dbc-4c9d-8702-994ca3b07b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:14.271051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6340da-6dbc-4c9d-8702-994ca3b07b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:14.271332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6340da-6dbc-4c9d-8702-994ca3b07b8d admin admin] PATH_INFO: `/v3/projects/766c0359b4eb443990f32792dfaa9949/users/e8981253b81d414181a61b86cf76bedb/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:14.289943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6340da-6dbc-4c9d-8702-994ca3b07b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=766c0359b4eb443990f32792dfaa9949, user_id=e8981253b81d414181a61b86cf76bedb, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:14.292836 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6340da-6dbc-4c9d-8702-994ca3b07b8d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:14.445538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 946/1866] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:14 2022] PUT /identity/v3/projects/766c0359b4eb443990f32792dfaa9949/users/e8981253b81d414181a61b86cf76bedb/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:14.449181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6340da-6dbc-4c9d-8702-994ca3b07b8d admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:14.547918 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6340da-6dbc-4c9d-8702-994ca3b07b8d admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:14.554665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d5321cd0-9c5a-417b-b40f-7efd75fc06fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ddc7f8049f44a7ab005f40d7a33780d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:14.555224 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a104807-1d01-49d1-91a1-d93f605f16e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:14.555341 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d5321cd0-9c5a-417b-b40f-7efd75fc06fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ddc7f8049f44a7ab005f40d7a33780d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:14.555860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a104807-1d01-49d1-91a1-d93f605f16e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:14.556192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a104807-1d01-49d1-91a1-d93f605f16e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:14.557911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a104807-1d01-49d1-91a1-d93f605f16e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:14.558216 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a104807-1d01-49d1-91a1-d93f605f16e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:14.560494 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a104807-1d01-49d1-91a1-d93f605f16e5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:14.583568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 947/1867] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:14.589432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a104807-1d01-49d1-91a1-d93f605f16e5 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:14.589807 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d5321cd0-9c5a-417b-b40f-7efd75fc06fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ddc7f8049f44a7ab005f40d7a33780d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:14.600513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a104807-1d01-49d1-91a1-d93f605f16e5 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:14.604131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d5321cd0-9c5a-417b-b40f-7efd75fc06fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ddc7f8049f44a7ab005f40d7a33780d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:14.604838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d5321cd0-9c5a-417b-b40f-7efd75fc06fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ddc7f8049f44a7ab005f40d7a33780d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:14.606927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93269f-9b8b-4be5-9d4b-616511fbf80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:14.607808 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93269f-9b8b-4be5-9d4b-616511fbf80b admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:14.608451 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93269f-9b8b-4be5-9d4b-616511fbf80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:14.608849 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93269f-9b8b-4be5-9d4b-616511fbf80b admin admin] PATH_INFO: `/v3/projects/766c0359b4eb443990f32792dfaa9949/users/e8981253b81d414181a61b86cf76bedb/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:14.612525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93269f-9b8b-4be5-9d4b-616511fbf80b admin admin] RBAC: Authorizing `identity:create_grant(project_id=766c0359b4eb443990f32792dfaa9949, user_id=e8981253b81d414181a61b86cf76bedb, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:14.615616 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93269f-9b8b-4be5-9d4b-616511fbf80b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:14.652494 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 948/1868] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:14 2022] PUT /identity/v3/projects/766c0359b4eb443990f32792dfaa9949/users/e8981253b81d414181a61b86cf76bedb/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:14.665782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93dcaa-7a8d-4bf4-9bb4-aa381ce33646 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:14.666101 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93dcaa-7a8d-4bf4-9bb4-aa381ce33646 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:14.666344 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93dcaa-7a8d-4bf4-9bb4-aa381ce33646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:14.707308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-dd93dcaa-7a8d-4bf4-9bb4-aa381ce33646 None None] MFA Rules not processed for user `e8981253b81d414181a61b86cf76bedb`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:14.708634 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-dd93dcaa-7a8d-4bf4-9bb4-aa381ce33646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:14.733416 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 921/1869] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:14 2022] DELETE /identity/v3/users/1ddc7f8049f44a7ab005f40d7a33780d => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:14.845529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 949/1870] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:14.968660 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5321cd0-9c5a-417b-b40f-7efd75fc06fd admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:14.970180 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d5321cd0-9c5a-417b-b40f-7efd75fc06fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:15.047393 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5321cd0-9c5a-417b-b40f-7efd75fc06fd admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:15.051485 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50041532-337c-49ec-bbec-2251b36b3d3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:15.052213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50041532-337c-49ec-bbec-2251b36b3d3f service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:15.052734 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50041532-337c-49ec-bbec-2251b36b3d3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:15.053113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50041532-337c-49ec-bbec-2251b36b3d3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:15.159897 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50041532-337c-49ec-bbec-2251b36b3d3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:15.161833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50041532-337c-49ec-bbec-2251b36b3d3f service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:15.174855 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 922/1871] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:15.273128 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93dcaa-7a8d-4bf4-9bb4-aa381ce33646 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:15.274707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-dd93dcaa-7a8d-4bf4-9bb4-aa381ce33646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:15.305840 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50041532-337c-49ec-bbec-2251b36b3d3f service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:15.315031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50041532-337c-49ec-bbec-2251b36b3d3f service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:15.320014 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e98de-880f-4010-b559-b0a55d9daa84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:15.320951 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e98de-880f-4010-b559-b0a55d9daa84 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:15.321470 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e98de-880f-4010-b559-b0a55d9daa84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:15.322088 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e98de-880f-4010-b559-b0a55d9daa84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:15.324466 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-267e98de-880f-4010-b559-b0a55d9daa84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:15.377036 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93dcaa-7a8d-4bf4-9bb4-aa381ce33646 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:15.515384 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e98de-880f-4010-b559-b0a55d9daa84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:15.525843 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e98de-880f-4010-b559-b0a55d9daa84 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:15.542063 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5d16b-7ea1-40d6-a7ea-9880b133057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:15.542880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5d16b-7ea1-40d6-a7ea-9880b133057d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:15.543279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5d16b-7ea1-40d6-a7ea-9880b133057d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:15.544967 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5d16b-7ea1-40d6-a7ea-9880b133057d admin admin] PATH_INFO: `/v3/users/68061684064e48aaab86c43ee16c8eeb` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:15.546024 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5d16b-7ea1-40d6-a7ea-9880b133057d admin admin] RBAC: Authorizing `identity:delete_user(user_id=68061684064e48aaab86c43ee16c8eeb)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:15.554815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5d16b-7ea1-40d6-a7ea-9880b133057d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:15.556181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 923/1872] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:15.666765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:15.865453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f6a5d16b-7ea1-40d6-a7ea-9880b133057d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68061684064e48aaab86c43ee16c8eeb'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:15.945586 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f6a5d16b-7ea1-40d6-a7ea-9880b133057d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68061684064e48aaab86c43ee16c8eeb'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:15.963253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f6a5d16b-7ea1-40d6-a7ea-9880b133057d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68061684064e48aaab86c43ee16c8eeb'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:15.971816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f6a5d16b-7ea1-40d6-a7ea-9880b133057d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68061684064e48aaab86c43ee16c8eeb'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:15.973136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f6a5d16b-7ea1-40d6-a7ea-9880b133057d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68061684064e48aaab86c43ee16c8eeb'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:15.994806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 950/1873] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:15 2022] DELETE /identity/v3/users/68061684064e48aaab86c43ee16c8eeb => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:16.001575 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971917a-8683-4d69-afae-ec649770d1d7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:16.002155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971917a-8683-4d69-afae-ec649770d1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:16.002636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971917a-8683-4d69-afae-ec649770d1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:16.032922 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b971917a-8683-4d69-afae-ec649770d1d7 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:16.034400 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b971917a-8683-4d69-afae-ec649770d1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:16.141018 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 924/1874] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:16.152793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5d16b-7ea1-40d6-a7ea-9880b133057d admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:16.155026 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f6a5d16b-7ea1-40d6-a7ea-9880b133057d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:16.164867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:16.189255 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971917a-8683-4d69-afae-ec649770d1d7 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:16.195091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b971917a-8683-4d69-afae-ec649770d1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:16.224795 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971917a-8683-4d69-afae-ec649770d1d7 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:16.241058 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3eb2c2-b959-4580-8836-ce790e0dc43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:16.241743 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eb2c2-b959-4580-8836-ce790e0dc43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:16.242027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eb2c2-b959-4580-8836-ce790e0dc43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:16.242307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eb2c2-b959-4580-8836-ce790e0dc43a admin admin] PATH_INFO: `/v3/projects/2891706e63ee4a9eb350d304f4be5053` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:16.244121 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3eb2c2-b959-4580-8836-ce790e0dc43a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2891706e63ee4a9eb350d304f4be5053)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:16.246104 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3eb2c2-b959-4580-8836-ce790e0dc43a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:16.325457 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5d16b-7ea1-40d6-a7ea-9880b133057d admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:16.330559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a89a9-26a8-4632-89fb-0dac66a8c3dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:16.330859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a89a9-26a8-4632-89fb-0dac66a8c3dd service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:16.331142 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a89a9-26a8-4632-89fb-0dac66a8c3dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:16.331416 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a89a9-26a8-4632-89fb-0dac66a8c3dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:16.365031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a89a9-26a8-4632-89fb-0dac66a8c3dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:16.366526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a89a9-26a8-4632-89fb-0dac66a8c3dd service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:16.391186 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 951/1875] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:16.488348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5b3eb2c2-b959-4580-8836-ce790e0dc43a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2891706e63ee4a9eb350d304f4be5053', 'request_id': 'req-5b3eb2c2-b959-4580-8836-ce790e0dc43a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:16.507113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5b3eb2c2-b959-4580-8836-ce790e0dc43a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2891706e63ee4a9eb350d304f4be5053', 'request_id': 'req-5b3eb2c2-b959-4580-8836-ce790e0dc43a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:16.519107 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5b3eb2c2-b959-4580-8836-ce790e0dc43a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2891706e63ee4a9eb350d304f4be5053', 'request_id': 'req-5b3eb2c2-b959-4580-8836-ce790e0dc43a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:16.592402 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:16.600889 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5b3eb2c2-b959-4580-8836-ce790e0dc43a admin admin] The token cache is being invalidate because project 2891706e63ee4a9eb350d304f4be5053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:16.601474 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5b3eb2c2-b959-4580-8836-ce790e0dc43a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:16.608903 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5b3eb2c2-b959-4580-8836-ce790e0dc43a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:16.612067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 925/1876] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:16 2022] DELETE /identity/v3/projects/2891706e63ee4a9eb350d304f4be5053 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:16.617098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a642c0-3006-475e-abb5-4ef74a02ea70 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:16.617470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a642c0-3006-475e-abb5-4ef74a02ea70 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:16.618015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a642c0-3006-475e-abb5-4ef74a02ea70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:16.692997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b0a642c0-3006-475e-abb5-4ef74a02ea70 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:16.697151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b0a642c0-3006-475e-abb5-4ef74a02ea70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:16.864491 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 952/1877] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:16.872283 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54466f4-d843-4dba-95ca-2d4419fa887c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:16.872884 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54466f4-d843-4dba-95ca-2d4419fa887c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:16.873304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54466f4-d843-4dba-95ca-2d4419fa887c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:16.902044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c54466f4-d843-4dba-95ca-2d4419fa887c None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:16.903285 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c54466f4-d843-4dba-95ca-2d4419fa887c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:16.927109 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 926/1878] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:16.932308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a642c0-3006-475e-abb5-4ef74a02ea70 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:16.947416 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a642c0-3006-475e-abb5-4ef74a02ea70 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:16.954148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd0a62-bc08-4ca3-b455-5c21b13de8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:16.955223 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd0a62-bc08-4ca3-b455-5c21b13de8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:16.957596 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd0a62-bc08-4ca3-b455-5c21b13de8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:16.957596 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd0a62-bc08-4ca3-b455-5c21b13de8d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:16.960317 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd0a62-bc08-4ca3-b455-5c21b13de8d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:06:16.960639 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd0a62-bc08-4ca3-b455-5c21b13de8d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:16.963773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd0a62-bc08-4ca3-b455-5c21b13de8d2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:16.982028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 953/1879] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:06:16.983694 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54466f4-d843-4dba-95ca-2d4419fa887c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:16.997428 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54466f4-d843-4dba-95ca-2d4419fa887c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:17.003567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d3278-aa44-4917-b3bb-15ea417acccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:17.008998 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d3278-aa44-4917-b3bb-15ea417acccf admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:17.008998 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d3278-aa44-4917-b3bb-15ea417acccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:17.008998 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d3278-aa44-4917-b3bb-15ea417acccf admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:17.008998 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d3278-aa44-4917-b3bb-15ea417acccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:17.009813 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d3278-aa44-4917-b3bb-15ea417acccf admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:17.133812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 927/1880] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:16 2022] POST /identity/v3/projects => generated 371 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:17.140183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd0a62-bc08-4ca3-b455-5c21b13de8d2 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:17.163998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd0a62-bc08-4ca3-b455-5c21b13de8d2 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:17.312742 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95219b77-5ba2-4c0f-9339-f27dfb501363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:17.313586 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95219b77-5ba2-4c0f-9339-f27dfb501363 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:17.314023 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95219b77-5ba2-4c0f-9339-f27dfb501363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:17.314474 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95219b77-5ba2-4c0f-9339-f27dfb501363 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:17.315826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95219b77-5ba2-4c0f-9339-f27dfb501363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:17.318948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95219b77-5ba2-4c0f-9339-f27dfb501363 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:17.328392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301ab6f-9169-43fe-9e3c-fc4c986d15e1 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:17.328392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301ab6f-9169-43fe-9e3c-fc4c986d15e1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:17.328392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301ab6f-9169-43fe-9e3c-fc4c986d15e1 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:17.328392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 928/1881] 10.222.0.75 () {54 vars in 921 bytes} [Thu Jul 28 18:06:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:06:17.352001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5391a-79ff-46c8-9c90-a2d4e7f45464 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:17.352953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5391a-79ff-46c8-9c90-a2d4e7f45464 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:17.353902 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5391a-79ff-46c8-9c90-a2d4e7f45464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:17.425136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4ea5391a-79ff-46c8-9c90-a2d4e7f45464 None None] MFA Rules not processed for user `c456a787159844feb7eabfd1e527e46e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:17.429749 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4ea5391a-79ff-46c8-9c90-a2d4e7f45464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:17.523390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 954/1882] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:17 2022] POST /identity/v3/users => generated 286 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:17.527467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95219b77-5ba2-4c0f-9339-f27dfb501363 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:17.539426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95219b77-5ba2-4c0f-9339-f27dfb501363 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:17.544861 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47634f-681c-44f9-9644-67fd38a337f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:17.545502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47634f-681c-44f9-9644-67fd38a337f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:17.545793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47634f-681c-44f9-9644-67fd38a337f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:17.546119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47634f-681c-44f9-9644-67fd38a337f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:17.548052 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47634f-681c-44f9-9644-67fd38a337f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:17.549006 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47634f-681c-44f9-9644-67fd38a337f9 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:17.563594 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 955/1883] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:06:17.570651 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47634f-681c-44f9-9644-67fd38a337f9 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:17.572343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 929/1884] 10.222.0.75 () {58 vars in 1018 bytes} [Thu Jul 28 18:06:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:17.595893 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47634f-681c-44f9-9644-67fd38a337f9 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:17.608430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48294f76-a089-46ad-9553-f3df1ed5ac66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:17.609130 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48294f76-a089-46ad-9553-f3df1ed5ac66 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:17.609419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48294f76-a089-46ad-9553-f3df1ed5ac66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:17.609697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48294f76-a089-46ad-9553-f3df1ed5ac66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:17.612302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48294f76-a089-46ad-9553-f3df1ed5ac66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:17.616952 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48294f76-a089-46ad-9553-f3df1ed5ac66 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:17.644438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 956/1885] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:17.645680 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5391a-79ff-46c8-9c90-a2d4e7f45464 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:17.657999 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5391a-79ff-46c8-9c90-a2d4e7f45464 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:17.667554 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dada2e-e102-4ffb-b500-c5629f1ce8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:17.668426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dada2e-e102-4ffb-b500-c5629f1ce8b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:17.668540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dada2e-e102-4ffb-b500-c5629f1ce8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:17.668849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dada2e-e102-4ffb-b500-c5629f1ce8b2 admin admin] PATH_INFO: `/v3/projects/fe06e7bcd26f4fee926fd2b229aa04fb/users/5154fb387db349b0904dc93b5d8b7664/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:17.711556 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dada2e-e102-4ffb-b500-c5629f1ce8b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe06e7bcd26f4fee926fd2b229aa04fb, user_id=5154fb387db349b0904dc93b5d8b7664, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:17.714307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dada2e-e102-4ffb-b500-c5629f1ce8b2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:17.807114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48294f76-a089-46ad-9553-f3df1ed5ac66 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:17.810525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-48294f76-a089-46ad-9553-f3df1ed5ac66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:17.836868 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 930/1886] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:17 2022] PUT /identity/v3/projects/fe06e7bcd26f4fee926fd2b229aa04fb/users/5154fb387db349b0904dc93b5d8b7664/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:17.841384 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48294f76-a089-46ad-9553-f3df1ed5ac66 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:17.842649 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a36cad-dda2-4a7c-8e6d-3815d31d13d0 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:17.842877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a36cad-dda2-4a7c-8e6d-3815d31d13d0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:17.843113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a36cad-dda2-4a7c-8e6d-3815d31d13d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:17.876745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-59a36cad-dda2-4a7c-8e6d-3815d31d13d0 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:17.878044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-59a36cad-dda2-4a7c-8e6d-3815d31d13d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:17.938513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630ee4c-6256-4589-a57a-c0c75024d2c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:17.943563 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630ee4c-6256-4589-a57a-c0c75024d2c2 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:17.943563 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630ee4c-6256-4589-a57a-c0c75024d2c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:17.943563 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630ee4c-6256-4589-a57a-c0c75024d2c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:17.952790 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630ee4c-6256-4589-a57a-c0c75024d2c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:17.954449 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630ee4c-6256-4589-a57a-c0c75024d2c2 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:17.969974 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 957/1887] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:06:18.005205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 931/1888] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:18.014042 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630ee4c-6256-4589-a57a-c0c75024d2c2 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:18.015654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3630ee4c-6256-4589-a57a-c0c75024d2c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:18.121051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630ee4c-6256-4589-a57a-c0c75024d2c2 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:18.121051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d9fee-49a5-49c4-b4bb-22342ddd260b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:18.126585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d9fee-49a5-49c4-b4bb-22342ddd260b service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:18.126585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d9fee-49a5-49c4-b4bb-22342ddd260b service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:18.126585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d9fee-49a5-49c4-b4bb-22342ddd260b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:18.134325 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d9fee-49a5-49c4-b4bb-22342ddd260b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:18.139522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d9fee-49a5-49c4-b4bb-22342ddd260b service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:18.149176 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 958/1889] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:18.192431 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:18.274866 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a36cad-dda2-4a7c-8e6d-3815d31d13d0 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:18.276981 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-59a36cad-dda2-4a7c-8e6d-3815d31d13d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:18.293814 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a36cad-dda2-4a7c-8e6d-3815d31d13d0 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:18.302872 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545e998-dcfa-413d-b5c1-2faa782e7a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:18.303279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545e998-dcfa-413d-b5c1-2faa782e7a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:18.303813 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545e998-dcfa-413d-b5c1-2faa782e7a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:18.303986 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545e998-dcfa-413d-b5c1-2faa782e7a08 admin admin] PATH_INFO: `/v3/projects/5009d2bc1f37464e96f53414bddb59ff` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:18.305976 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545e998-dcfa-413d-b5c1-2faa782e7a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5009d2bc1f37464e96f53414bddb59ff)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:18.308134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545e998-dcfa-413d-b5c1-2faa782e7a08 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:18.470325 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d545e998-dcfa-413d-b5c1-2faa782e7a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5009d2bc1f37464e96f53414bddb59ff', 'request_id': 'req-d545e998-dcfa-413d-b5c1-2faa782e7a08'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:18.478531 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d545e998-dcfa-413d-b5c1-2faa782e7a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5009d2bc1f37464e96f53414bddb59ff', 'request_id': 'req-d545e998-dcfa-413d-b5c1-2faa782e7a08'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:18.486000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d545e998-dcfa-413d-b5c1-2faa782e7a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5009d2bc1f37464e96f53414bddb59ff', 'request_id': 'req-d545e998-dcfa-413d-b5c1-2faa782e7a08'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:18.558046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:18.632254 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d545e998-dcfa-413d-b5c1-2faa782e7a08 admin admin] The token cache is being invalidate because project 5009d2bc1f37464e96f53414bddb59ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:18.633452 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d545e998-dcfa-413d-b5c1-2faa782e7a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:18.633452 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d545e998-dcfa-413d-b5c1-2faa782e7a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:18.635008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 932/1890] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:18 2022] DELETE /identity/v3/projects/5009d2bc1f37464e96f53414bddb59ff => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:18.639066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d9fee-49a5-49c4-b4bb-22342ddd260b service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:18.650634 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d9fee-49a5-49c4-b4bb-22342ddd260b service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:18.746374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687b73d-438b-4a14-b6f8-f3e1678e4ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:18.747051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687b73d-438b-4a14-b6f8-f3e1678e4ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:18.747391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687b73d-438b-4a14-b6f8-f3e1678e4ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:18.747946 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687b73d-438b-4a14-b6f8-f3e1678e4ef2 admin admin] PATH_INFO: `/v3/users/d023b65687464981a6bd382bc2eb0619` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:18.749606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687b73d-438b-4a14-b6f8-f3e1678e4ef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d023b65687464981a6bd382bc2eb0619)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:18.750356 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac1344-c75f-416e-a5aa-79c69677b682 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:18.751229 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac1344-c75f-416e-a5aa-79c69677b682 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:18.751714 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac1344-c75f-416e-a5aa-79c69677b682 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:18.753516 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 933/1891] 10.222.0.75 () {54 vars in 921 bytes} [Thu Jul 28 18:06:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 18:06:18.756156 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687b73d-438b-4a14-b6f8-f3e1678e4ef2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:18.777635 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e7922-83e1-4a7e-b891-38f9c681d2e6 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:18.778192 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e7922-83e1-4a7e-b891-38f9c681d2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:18.778624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e7922-83e1-4a7e-b891-38f9c681d2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:18.828122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6c4e7922-83e1-4a7e-b891-38f9c681d2e6 None None] MFA Rules not processed for user `c456a787159844feb7eabfd1e527e46e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:18.832144 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6c4e7922-83e1-4a7e-b891-38f9c681d2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:18.984568 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 934/1892] 10.222.0.75 () {58 vars in 1018 bytes} [Thu Jul 28 18:06:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:19.006523 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e7922-83e1-4a7e-b891-38f9c681d2e6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:19.008720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6c4e7922-83e1-4a7e-b891-38f9c681d2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:19.023008 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b687b73d-438b-4a14-b6f8-f3e1678e4ef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd023b65687464981a6bd382bc2eb0619'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:19.032383 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e7922-83e1-4a7e-b891-38f9c681d2e6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:19.040941 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f20a8-8a11-48b9-b72d-f0ad4f068d66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:19.041822 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f20a8-8a11-48b9-b72d-f0ad4f068d66 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:19.041966 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f20a8-8a11-48b9-b72d-f0ad4f068d66 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:19.042247 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f20a8-8a11-48b9-b72d-f0ad4f068d66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:19.053710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f20a8-8a11-48b9-b72d-f0ad4f068d66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:19.055376 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f20a8-8a11-48b9-b72d-f0ad4f068d66 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:19.078155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 935/1893] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:19.116303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b687b73d-438b-4a14-b6f8-f3e1678e4ef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd023b65687464981a6bd382bc2eb0619'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:19.141643 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b687b73d-438b-4a14-b6f8-f3e1678e4ef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd023b65687464981a6bd382bc2eb0619'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:19.168018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b687b73d-438b-4a14-b6f8-f3e1678e4ef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd023b65687464981a6bd382bc2eb0619'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:19.184483 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b687b73d-438b-4a14-b6f8-f3e1678e4ef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd023b65687464981a6bd382bc2eb0619'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:19.203824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 959/1894] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:18 2022] DELETE /identity/v3/users/d023b65687464981a6bd382bc2eb0619 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:19.956955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:19.967634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f20a8-8a11-48b9-b72d-f0ad4f068d66 service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:19.971457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a25f20a8-8a11-48b9-b72d-f0ad4f068d66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:20.002002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f20a8-8a11-48b9-b72d-f0ad4f068d66 service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:20.065199 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeefab0-6582-4239-bb4a-ce3d8442d26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:20.065723 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeefab0-6582-4239-bb4a-ce3d8442d26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:20.066027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeefab0-6582-4239-bb4a-ce3d8442d26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:20.066324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeefab0-6582-4239-bb4a-ce3d8442d26d admin admin] PATH_INFO: `/v3/projects/3ef1bf92582f4e9a87db275185949279` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:20.067590 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeefab0-6582-4239-bb4a-ce3d8442d26d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ef1bf92582f4e9a87db275185949279)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:20.073806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeefab0-6582-4239-bb4a-ce3d8442d26d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:20.080377 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c66472-78f8-4521-bbee-c13aa9bc104f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:20.080669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c66472-78f8-4521-bbee-c13aa9bc104f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:20.083319 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c66472-78f8-4521-bbee-c13aa9bc104f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:20.141502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-86c66472-78f8-4521-bbee-c13aa9bc104f None None] MFA Rules not processed for user `5154fb387db349b0904dc93b5d8b7664`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:20.143026 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-86c66472-78f8-4521-bbee-c13aa9bc104f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:20.223639 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 960/1895] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:20.228390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c66472-78f8-4521-bbee-c13aa9bc104f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:20.229960 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-86c66472-78f8-4521-bbee-c13aa9bc104f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:20.242969 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7eeefab0-6582-4239-bb4a-ce3d8442d26d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ef1bf92582f4e9a87db275185949279', 'request_id': 'req-7eeefab0-6582-4239-bb4a-ce3d8442d26d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:20.257091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7eeefab0-6582-4239-bb4a-ce3d8442d26d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ef1bf92582f4e9a87db275185949279', 'request_id': 'req-7eeefab0-6582-4239-bb4a-ce3d8442d26d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:20.268620 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c66472-78f8-4521-bbee-c13aa9bc104f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:20.271313 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7eeefab0-6582-4239-bb4a-ce3d8442d26d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ef1bf92582f4e9a87db275185949279', 'request_id': 'req-7eeefab0-6582-4239-bb4a-ce3d8442d26d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:20.355575 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fac54a-efd8-45ed-8515-53789036a2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:20.356229 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fac54a-efd8-45ed-8515-53789036a2de admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:20.356520 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fac54a-efd8-45ed-8515-53789036a2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:20.356834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fac54a-efd8-45ed-8515-53789036a2de admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:20.357520 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fac54a-efd8-45ed-8515-53789036a2de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:20.359563 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fac54a-efd8-45ed-8515-53789036a2de admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:20.480733 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7eeefab0-6582-4239-bb4a-ce3d8442d26d admin admin] The token cache is being invalidate because project 3ef1bf92582f4e9a87db275185949279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:20.481147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7eeefab0-6582-4239-bb4a-ce3d8442d26d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:20.481844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7eeefab0-6582-4239-bb4a-ce3d8442d26d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:20.483573 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 936/1896] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:19 2022] DELETE /identity/v3/projects/3ef1bf92582f4e9a87db275185949279 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:20.488867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d5c3a-1919-4570-895a-3baf4947c11d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:20.489158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d5c3a-1919-4570-895a-3baf4947c11d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:20.489443 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d5c3a-1919-4570-895a-3baf4947c11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:20.511911 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-492d5c3a-1919-4570-895a-3baf4947c11d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:20.513338 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-492d5c3a-1919-4570-895a-3baf4947c11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:20.525175 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 937/1897] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:20.533211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73751be-256e-432d-84a2-ee39527b9fb6 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:20.533411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 961/1898] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:20 2022] POST /identity/v3/projects => generated 373 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:20.533506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73751be-256e-432d-84a2-ee39527b9fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:20.533506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73751be-256e-432d-84a2-ee39527b9fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:20.535859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fac54a-efd8-45ed-8515-53789036a2de admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:20.538801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d1fac54a-efd8-45ed-8515-53789036a2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:20.562656 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e73751be-256e-432d-84a2-ee39527b9fb6 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:20.563879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e73751be-256e-432d-84a2-ee39527b9fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:20.630407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fac54a-efd8-45ed-8515-53789036a2de admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:20.635706 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10105f1d-ad24-4b39-bcbb-744c72e709bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:20.636354 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10105f1d-ad24-4b39-bcbb-744c72e709bc admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:20.636637 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10105f1d-ad24-4b39-bcbb-744c72e709bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:20.636943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10105f1d-ad24-4b39-bcbb-744c72e709bc admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:20.637617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10105f1d-ad24-4b39-bcbb-744c72e709bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:20.639602 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10105f1d-ad24-4b39-bcbb-744c72e709bc admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:20.700508 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 938/1899] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:20.705146 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73751be-256e-432d-84a2-ee39527b9fb6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:20.714518 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73751be-256e-432d-84a2-ee39527b9fb6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:20.721445 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aabeeb-226f-4ddc-b421-9af5359397a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:20.722217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aabeeb-226f-4ddc-b421-9af5359397a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:20.723018 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aabeeb-226f-4ddc-b421-9af5359397a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:20.723472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aabeeb-226f-4ddc-b421-9af5359397a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:20.724363 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aabeeb-226f-4ddc-b421-9af5359397a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:06:20.724734 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aabeeb-226f-4ddc-b421-9af5359397a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:20.726477 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aabeeb-226f-4ddc-b421-9af5359397a7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:20.743644 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 939/1900] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:06:20.744646 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aabeeb-226f-4ddc-b421-9af5359397a7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:20.754975 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aabeeb-226f-4ddc-b421-9af5359397a7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:20.768839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 962/1901] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:20 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:20.769862 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10105f1d-ad24-4b39-bcbb-744c72e709bc admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:20.773912 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f9138-f5d3-426a-be41-ddaa14648e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:20.774934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f9138-f5d3-426a-be41-ddaa14648e17 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:20.775370 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f9138-f5d3-426a-be41-ddaa14648e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:20.775833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f9138-f5d3-426a-be41-ddaa14648e17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:20.776675 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f9138-f5d3-426a-be41-ddaa14648e17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:20.779078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f9138-f5d3-426a-be41-ddaa14648e17 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:20.781689 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10105f1d-ad24-4b39-bcbb-744c72e709bc admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:20.792974 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f418a13-fe6e-4b68-a41f-2d3f299b796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:20.792974 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f418a13-fe6e-4b68-a41f-2d3f299b796a admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:20.792974 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f418a13-fe6e-4b68-a41f-2d3f299b796a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:20.792974 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f418a13-fe6e-4b68-a41f-2d3f299b796a admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:20.793306 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f418a13-fe6e-4b68-a41f-2d3f299b796a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:20.794422 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f418a13-fe6e-4b68-a41f-2d3f299b796a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:20.813277 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 963/1902] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:20.817896 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f418a13-fe6e-4b68-a41f-2d3f299b796a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:20.830442 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f418a13-fe6e-4b68-a41f-2d3f299b796a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:20.836001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad217c-7a9a-46e1-b7f3-5ea20c3ca01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:20.837294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad217c-7a9a-46e1-b7f3-5ea20c3ca01f admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:20.837862 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad217c-7a9a-46e1-b7f3-5ea20c3ca01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:20.838334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad217c-7a9a-46e1-b7f3-5ea20c3ca01f admin admin] PATH_INFO: `/v3/projects/32d5ec9ddd2b4c748711a67ed79f0902/users/f9d4d090e3f24e5b9d1629a3734de3b6/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:20.860701 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad217c-7a9a-46e1-b7f3-5ea20c3ca01f admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d5ec9ddd2b4c748711a67ed79f0902, user_id=f9d4d090e3f24e5b9d1629a3734de3b6, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:20.864199 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad217c-7a9a-46e1-b7f3-5ea20c3ca01f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:20.963695 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 940/1903] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:20 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:20.967845 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f9138-f5d3-426a-be41-ddaa14648e17 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:20.970913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 964/1904] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:20 2022] PUT /identity/v3/projects/32d5ec9ddd2b4c748711a67ed79f0902/users/f9d4d090e3f24e5b9d1629a3734de3b6/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:20.975950 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad217c-7a9a-46e1-b7f3-5ea20c3ca01f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:21.061046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f9138-f5d3-426a-be41-ddaa14648e17 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:21.069158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9256d-4a92-43c1-ba70-a078369b8fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:21.070052 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9256d-4a92-43c1-ba70-a078369b8fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:21.070514 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9256d-4a92-43c1-ba70-a078369b8fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:21.071117 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9256d-4a92-43c1-ba70-a078369b8fa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:21.071996 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9256d-4a92-43c1-ba70-a078369b8fa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:21.075117 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9256d-4a92-43c1-ba70-a078369b8fa6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:21.128217 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad217c-7a9a-46e1-b7f3-5ea20c3ca01f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:21.134826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:21.136408 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979da52-8dd1-4269-b175-4ccf5cc974a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:21.137396 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979da52-8dd1-4269-b175-4ccf5cc974a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:21.137688 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979da52-8dd1-4269-b175-4ccf5cc974a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:21.138021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979da52-8dd1-4269-b175-4ccf5cc974a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:21.138734 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979da52-8dd1-4269-b175-4ccf5cc974a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:21.140527 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979da52-8dd1-4269-b175-4ccf5cc974a7 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:21.152091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 965/1905] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:21.156186 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979da52-8dd1-4269-b175-4ccf5cc974a7 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:21.170771 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979da52-8dd1-4269-b175-4ccf5cc974a7 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:21.176738 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d19b3f-9fa4-46a9-b4e2-cbaa4f4abab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:21.190202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d19b3f-9fa4-46a9-b4e2-cbaa4f4abab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:21.190202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d19b3f-9fa4-46a9-b4e2-cbaa4f4abab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:21.190202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d19b3f-9fa4-46a9-b4e2-cbaa4f4abab3 admin admin] PATH_INFO: `/v3/projects/32d5ec9ddd2b4c748711a67ed79f0902/users/f9d4d090e3f24e5b9d1629a3734de3b6/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:21.190202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d19b3f-9fa4-46a9-b4e2-cbaa4f4abab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d5ec9ddd2b4c748711a67ed79f0902, user_id=f9d4d090e3f24e5b9d1629a3734de3b6, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:21.190202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d19b3f-9fa4-46a9-b4e2-cbaa4f4abab3 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:21.190680 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 941/1906] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:20 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:21.198325 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9256d-4a92-43c1-ba70-a078369b8fa6 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:21.203111 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 966/1907] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:21 2022] PUT /identity/v3/projects/32d5ec9ddd2b4c748711a67ed79f0902/users/f9d4d090e3f24e5b9d1629a3734de3b6/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:21.224950 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9256d-4a92-43c1-ba70-a078369b8fa6 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:21.372215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214a4aa-0179-44a7-b0ba-3b2929a3273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:21.373100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214a4aa-0179-44a7-b0ba-3b2929a3273d admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:21.373389 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214a4aa-0179-44a7-b0ba-3b2929a3273d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:21.373669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214a4aa-0179-44a7-b0ba-3b2929a3273d admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:21.374454 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8214a4aa-0179-44a7-b0ba-3b2929a3273d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:21.376232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8214a4aa-0179-44a7-b0ba-3b2929a3273d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:21.423090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 942/1908] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:21.430143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d19b3f-9fa4-46a9-b4e2-cbaa4f4abab3 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:21.444938 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d19b3f-9fa4-46a9-b4e2-cbaa4f4abab3 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:21.465275 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad658c3-45f4-435d-b790-baa424a7a920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:21.466189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad658c3-45f4-435d-b790-baa424a7a920 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:21.466664 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad658c3-45f4-435d-b790-baa424a7a920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:21.467112 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad658c3-45f4-435d-b790-baa424a7a920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:21.467993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad658c3-45f4-435d-b790-baa424a7a920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:21.469806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad658c3-45f4-435d-b790-baa424a7a920 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:21.498054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 967/1909] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:21.502930 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214a4aa-0179-44a7-b0ba-3b2929a3273d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:21.520170 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214a4aa-0179-44a7-b0ba-3b2929a3273d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:21.525439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186858d-36ac-4ace-bdd0-0c2d30046c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:21.526367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186858d-36ac-4ace-bdd0-0c2d30046c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:21.527153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186858d-36ac-4ace-bdd0-0c2d30046c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:21.528733 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186858d-36ac-4ace-bdd0-0c2d30046c79 admin admin] PATH_INFO: `/v3/projects/b8075d261cd84c6799b1dee84031e0fb/users/e82641ce63df4724a93ca08d27152883/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:21.553830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186858d-36ac-4ace-bdd0-0c2d30046c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8075d261cd84c6799b1dee84031e0fb, user_id=e82641ce63df4724a93ca08d27152883, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:21.558581 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186858d-36ac-4ace-bdd0-0c2d30046c79 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:21.573499 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:21.738507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 943/1910] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:21 2022] PUT /identity/v3/projects/b8075d261cd84c6799b1dee84031e0fb/users/e82641ce63df4724a93ca08d27152883/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:21.739468 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f8d17-2ded-4239-a80f-4b231240758b None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:21.739674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f8d17-2ded-4239-a80f-4b231240758b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:21.740211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f8d17-2ded-4239-a80f-4b231240758b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:21.792832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-7b7f8d17-2ded-4239-a80f-4b231240758b None None] MFA Rules not processed for user `e82641ce63df4724a93ca08d27152883`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:21.794744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7b7f8d17-2ded-4239-a80f-4b231240758b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:21.869195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 968/1911] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:21.873603 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186858d-36ac-4ace-bdd0-0c2d30046c79 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:21.946918 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186858d-36ac-4ace-bdd0-0c2d30046c79 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:21.953744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb826db-a64c-42f0-ad7f-359aeb653f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:21.954888 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb826db-a64c-42f0-ad7f-359aeb653f84 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:21.955182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb826db-a64c-42f0-ad7f-359aeb653f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:21.955464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb826db-a64c-42f0-ad7f-359aeb653f84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:21.956458 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb826db-a64c-42f0-ad7f-359aeb653f84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:21.959960 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb826db-a64c-42f0-ad7f-359aeb653f84 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:22.086155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 944/1912] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:21 2022] POST /identity/v3/projects => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:22.090725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f8d17-2ded-4239-a80f-4b231240758b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:22.103571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f8d17-2ded-4239-a80f-4b231240758b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:22.171604 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522b3f7-6c18-4154-a981-e7582fce03ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:22.172325 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522b3f7-6c18-4154-a981-e7582fce03ea admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:22.177048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522b3f7-6c18-4154-a981-e7582fce03ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:22.177048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522b3f7-6c18-4154-a981-e7582fce03ea admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:22.177048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522b3f7-6c18-4154-a981-e7582fce03ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:22.177048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522b3f7-6c18-4154-a981-e7582fce03ea admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:22.267104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 969/1913] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:22 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:22.271970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb826db-a64c-42f0-ad7f-359aeb653f84 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:22.283463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb826db-a64c-42f0-ad7f-359aeb653f84 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:22.293929 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19576b23-5561-43ed-845c-f9eae79a58fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:22.294566 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19576b23-5561-43ed-845c-f9eae79a58fc admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:22.294850 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19576b23-5561-43ed-845c-f9eae79a58fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:22.295123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19576b23-5561-43ed-845c-f9eae79a58fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:22.299120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19576b23-5561-43ed-845c-f9eae79a58fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:22.300080 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19576b23-5561-43ed-845c-f9eae79a58fc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:22.315603 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 945/1914] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:22.317970 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522b3f7-6c18-4154-a981-e7582fce03ea admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:22.333362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522b3f7-6c18-4154-a981-e7582fce03ea admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:22.346818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e45a1-1a22-4cef-a15a-419b9e1c28f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:22.347730 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e45a1-1a22-4cef-a15a-419b9e1c28f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:22.348023 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e45a1-1a22-4cef-a15a-419b9e1c28f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:22.348362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e45a1-1a22-4cef-a15a-419b9e1c28f1 admin admin] PATH_INFO: `/v3/projects/ed764b04d0754ba7a5997265216cba18/users/6131fa6275584c28bd87230eb782ca49/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:22.369973 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e45a1-1a22-4cef-a15a-419b9e1c28f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed764b04d0754ba7a5997265216cba18, user_id=6131fa6275584c28bd87230eb782ca49, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:22.372940 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e45a1-1a22-4cef-a15a-419b9e1c28f1 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:22.460458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 970/1915] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:22 2022] PUT /identity/v3/projects/ed764b04d0754ba7a5997265216cba18/users/6131fa6275584c28bd87230eb782ca49/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:22.464897 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19576b23-5561-43ed-845c-f9eae79a58fc admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:22.475582 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19576b23-5561-43ed-845c-f9eae79a58fc admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:22.534407 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02727aa5-ff74-476c-87fc-901e6df65aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:22.534995 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02727aa5-ff74-476c-87fc-901e6df65aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:22.535280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02727aa5-ff74-476c-87fc-901e6df65aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:22.535552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02727aa5-ff74-476c-87fc-901e6df65aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:22.536250 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02727aa5-ff74-476c-87fc-901e6df65aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:22.537893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02727aa5-ff74-476c-87fc-901e6df65aa0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:22.548742 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 946/1916] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:22.553993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e45a1-1a22-4cef-a15a-419b9e1c28f1 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:22.565802 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e45a1-1a22-4cef-a15a-419b9e1c28f1 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:22.571127 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef194e49-80ff-42e1-bb8b-5764263b24ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:22.571875 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef194e49-80ff-42e1-bb8b-5764263b24ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:22.572159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef194e49-80ff-42e1-bb8b-5764263b24ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:22.572446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef194e49-80ff-42e1-bb8b-5764263b24ee admin admin] PATH_INFO: `/v3/projects/ed764b04d0754ba7a5997265216cba18/users/6131fa6275584c28bd87230eb782ca49/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:22.574904 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef194e49-80ff-42e1-bb8b-5764263b24ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed764b04d0754ba7a5997265216cba18, user_id=6131fa6275584c28bd87230eb782ca49, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:22.576481 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:22.580284 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef194e49-80ff-42e1-bb8b-5764263b24ee admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:22.594093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 971/1917] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:22 2022] PUT /identity/v3/projects/ed764b04d0754ba7a5997265216cba18/users/6131fa6275584c28bd87230eb782ca49/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:22.604546 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee053d5-bcbf-4241-b97b-eb2e4c91a7d0 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:22.604860 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee053d5-bcbf-4241-b97b-eb2e4c91a7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:22.605136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee053d5-bcbf-4241-b97b-eb2e4c91a7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:22.647768 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6ee053d5-bcbf-4241-b97b-eb2e4c91a7d0 None None] MFA Rules not processed for user `6131fa6275584c28bd87230eb782ca49`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:22.649112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6ee053d5-bcbf-4241-b97b-eb2e4c91a7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:22.677962 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef194e49-80ff-42e1-bb8b-5764263b24ee admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:22.679707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ef194e49-80ff-42e1-bb8b-5764263b24ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:22.737010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 947/1918] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:22.749828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee053d5-bcbf-4241-b97b-eb2e4c91a7d0 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:22.751303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6ee053d5-bcbf-4241-b97b-eb2e4c91a7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:22.760793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef194e49-80ff-42e1-bb8b-5764263b24ee admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:22.765562 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd4e4e-79b0-4732-aa34-9bb649834f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:22.767881 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd4e4e-79b0-4732-aa34-9bb649834f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:22.767881 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd4e4e-79b0-4732-aa34-9bb649834f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:22.767881 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd4e4e-79b0-4732-aa34-9bb649834f7d admin admin] PATH_INFO: `/v3/users/734924cad70c424db01f9a80930a59b5` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:22.768110 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd4e4e-79b0-4732-aa34-9bb649834f7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=734924cad70c424db01f9a80930a59b5)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:22.770191 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd4e4e-79b0-4732-aa34-9bb649834f7d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:22.823339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee053d5-bcbf-4241-b97b-eb2e4c91a7d0 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:22.827030 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4f6a4-1b41-48ce-99f9-b90ad7be754a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:22.827660 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4f6a4-1b41-48ce-99f9-b90ad7be754a service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:22.827941 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4f6a4-1b41-48ce-99f9-b90ad7be754a service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:22.828223 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4f6a4-1b41-48ce-99f9-b90ad7be754a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:22.838311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4f6a4-1b41-48ce-99f9-b90ad7be754a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:22.839859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4f6a4-1b41-48ce-99f9-b90ad7be754a service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:22.852483 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 948/1919] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:06:22.985704 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4f6a4-1b41-48ce-99f9-b90ad7be754a service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:22.995820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4f6a4-1b41-48ce-99f9-b90ad7be754a service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:22.999829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f00d0-877f-4d59-a8ad-b41fff9e7ec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:23.000836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f00d0-877f-4d59-a8ad-b41fff9e7ec0 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:23.001154 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f00d0-877f-4d59-a8ad-b41fff9e7ec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:23.001433 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f00d0-877f-4d59-a8ad-b41fff9e7ec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:23.053531 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e9cd4e4e-79b0-4732-aa34-9bb649834f7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '734924cad70c424db01f9a80930a59b5'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:23.068528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f00d0-877f-4d59-a8ad-b41fff9e7ec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:23.070075 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f00d0-877f-4d59-a8ad-b41fff9e7ec0 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:23.079654 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 949/1920] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:06:23.153946 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473de957-3dda-44f1-94cd-c8beb9fae2e3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:23.154866 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473de957-3dda-44f1-94cd-c8beb9fae2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:23.155561 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473de957-3dda-44f1-94cd-c8beb9fae2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:23.180350 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e9cd4e4e-79b0-4732-aa34-9bb649834f7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '734924cad70c424db01f9a80930a59b5'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:23.187387 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:23.198648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e9cd4e4e-79b0-4732-aa34-9bb649834f7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '734924cad70c424db01f9a80930a59b5'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:23.201440 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-473de957-3dda-44f1-94cd-c8beb9fae2e3 None None] MFA Rules not processed for user `f9d4d090e3f24e5b9d1629a3734de3b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:23.203207 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-473de957-3dda-44f1-94cd-c8beb9fae2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:23.210591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e9cd4e4e-79b0-4732-aa34-9bb649834f7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '734924cad70c424db01f9a80930a59b5'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:23.211755 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e9cd4e4e-79b0-4732-aa34-9bb649834f7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '734924cad70c424db01f9a80930a59b5'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:23.221240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 972/1921] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:22 2022] DELETE /identity/v3/users/734924cad70c424db01f9a80930a59b5 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:23.226374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386743e-f4dc-43b2-84a3-b47ae0f79d89 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:23.226781 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386743e-f4dc-43b2-84a3-b47ae0f79d89 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:23.227223 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386743e-f4dc-43b2-84a3-b47ae0f79d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:23.264490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-9386743e-f4dc-43b2-84a3-b47ae0f79d89 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:23.266119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9386743e-f4dc-43b2-84a3-b47ae0f79d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:23.299139 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 950/1922] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:23.310345 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bc8c6-129c-4f6a-b2cd-209d1d4f9f89 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:23.310636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bc8c6-129c-4f6a-b2cd-209d1d4f9f89 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:23.310917 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bc8c6-129c-4f6a-b2cd-209d1d4f9f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:23.336590 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b75bc8c6-129c-4f6a-b2cd-209d1d4f9f89 None None] MFA Rules not processed for user `5154fb387db349b0904dc93b5d8b7664`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:23.338106 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b75bc8c6-129c-4f6a-b2cd-209d1d4f9f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:23.363665 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 973/1923] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:23.375176 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386743e-f4dc-43b2-84a3-b47ae0f79d89 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:23.376624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9386743e-f4dc-43b2-84a3-b47ae0f79d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:23.438248 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 951/1924] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:23.449448 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386743e-f4dc-43b2-84a3-b47ae0f79d89 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:23.451460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bc8c6-129c-4f6a-b2cd-209d1d4f9f89 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:23.454206 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b75bc8c6-129c-4f6a-b2cd-209d1d4f9f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:23.467456 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f24e1-ee4d-4a9e-ac6a-c74576d5b800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:23.470402 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f24e1-ee4d-4a9e-ac6a-c74576d5b800 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:23.471215 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f24e1-ee4d-4a9e-ac6a-c74576d5b800 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:23.475467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f24e1-ee4d-4a9e-ac6a-c74576d5b800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:23.495327 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f24e1-ee4d-4a9e-ac6a-c74576d5b800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:23.497250 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f24e1-ee4d-4a9e-ac6a-c74576d5b800 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:23.512388 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 974/1925] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:23.570517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bc8c6-129c-4f6a-b2cd-209d1d4f9f89 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:23.576995 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d7513-521b-4748-91d1-3d3994dc27c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:23.577633 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d7513-521b-4748-91d1-3d3994dc27c6 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:23.577969 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d7513-521b-4748-91d1-3d3994dc27c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:23.578182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d7513-521b-4748-91d1-3d3994dc27c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:23.580927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fb1d7513-521b-4748-91d1-3d3994dc27c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:23.615965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d7513-521b-4748-91d1-3d3994dc27c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:23.617654 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d7513-521b-4748-91d1-3d3994dc27c6 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:23.629253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 952/1926] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:06:24.180971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f24e1-ee4d-4a9e-ac6a-c74576d5b800 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:24.181548 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b41f24e1-ee4d-4a9e-ac6a-c74576d5b800 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:24.195861 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f24e1-ee4d-4a9e-ac6a-c74576d5b800 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:24.202610 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c58073-1d06-4a98-af70-82b74eefe041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:24.203581 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c58073-1d06-4a98-af70-82b74eefe041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:24.204069 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c58073-1d06-4a98-af70-82b74eefe041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:24.204539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c58073-1d06-4a98-af70-82b74eefe041 admin admin] PATH_INFO: `/v3/projects/537dec4ecafd42cba4832b612edb027f` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:24.207386 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c58073-1d06-4a98-af70-82b74eefe041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=537dec4ecafd42cba4832b612edb027f)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:24.209726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c58073-1d06-4a98-af70-82b74eefe041 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:24.380978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b7c58073-1d06-4a98-af70-82b74eefe041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '537dec4ecafd42cba4832b612edb027f', 'request_id': 'req-b7c58073-1d06-4a98-af70-82b74eefe041'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:24.643354 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b7c58073-1d06-4a98-af70-82b74eefe041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '537dec4ecafd42cba4832b612edb027f', 'request_id': 'req-b7c58073-1d06-4a98-af70-82b74eefe041'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:24.653353 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b7c58073-1d06-4a98-af70-82b74eefe041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '537dec4ecafd42cba4832b612edb027f', 'request_id': 'req-b7c58073-1d06-4a98-af70-82b74eefe041'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:24.661433 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b7c58073-1d06-4a98-af70-82b74eefe041 admin admin] The token cache is being invalidate because project 537dec4ecafd42cba4832b612edb027f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:24.661726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b7c58073-1d06-4a98-af70-82b74eefe041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:24.662399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b7c58073-1d06-4a98-af70-82b74eefe041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:24.664288 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 975/1927] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:24 2022] DELETE /identity/v3/projects/537dec4ecafd42cba4832b612edb027f => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:24.668027 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d7513-521b-4748-91d1-3d3994dc27c6 service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:24.679381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d7513-521b-4748-91d1-3d3994dc27c6 service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:24.787547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8963f8-01d0-43ff-9f74-73d41b648840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:24.787547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8963f8-01d0-43ff-9f74-73d41b648840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:24.788108 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8963f8-01d0-43ff-9f74-73d41b648840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:24.788494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8963f8-01d0-43ff-9f74-73d41b648840 admin admin] PATH_INFO: `/v3/users/e8981253b81d414181a61b86cf76bedb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:24.790073 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8963f8-01d0-43ff-9f74-73d41b648840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8981253b81d414181a61b86cf76bedb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:24.792222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8963f8-01d0-43ff-9f74-73d41b648840 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:24.815671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:25.070409 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:25.085892 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-dd8963f8-01d0-43ff-9f74-73d41b648840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8981253b81d414181a61b86cf76bedb'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:25.087736 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-dd8963f8-01d0-43ff-9f74-73d41b648840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8981253b81d414181a61b86cf76bedb'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:25.100471 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-dd8963f8-01d0-43ff-9f74-73d41b648840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8981253b81d414181a61b86cf76bedb'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:25.107421 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-dd8963f8-01d0-43ff-9f74-73d41b648840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8981253b81d414181a61b86cf76bedb'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:25.108120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-dd8963f8-01d0-43ff-9f74-73d41b648840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8981253b81d414181a61b86cf76bedb'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:25.191777 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 953/1928] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:24 2022] DELETE /identity/v3/users/e8981253b81d414181a61b86cf76bedb => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:25.864541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c58073-1d06-4a98-af70-82b74eefe041 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:25.867289 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b7c58073-1d06-4a98-af70-82b74eefe041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:25.891854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c58073-1d06-4a98-af70-82b74eefe041 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:25.966247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a650c-8ff9-492b-835a-43dc81317afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:25.966934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a650c-8ff9-492b-835a-43dc81317afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:25.967363 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a650c-8ff9-492b-835a-43dc81317afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:25.967568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a650c-8ff9-492b-835a-43dc81317afa admin admin] PATH_INFO: `/v3/projects/766c0359b4eb443990f32792dfaa9949` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:25.968844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a650c-8ff9-492b-835a-43dc81317afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=766c0359b4eb443990f32792dfaa9949)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:25.971080 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a650c-8ff9-492b-835a-43dc81317afa admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:26.098991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-491a650c-8ff9-492b-835a-43dc81317afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '766c0359b4eb443990f32792dfaa9949', 'request_id': 'req-491a650c-8ff9-492b-835a-43dc81317afa'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:26.228177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-491a650c-8ff9-492b-835a-43dc81317afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '766c0359b4eb443990f32792dfaa9949', 'request_id': 'req-491a650c-8ff9-492b-835a-43dc81317afa'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:26.248294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-491a650c-8ff9-492b-835a-43dc81317afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '766c0359b4eb443990f32792dfaa9949', 'request_id': 'req-491a650c-8ff9-492b-835a-43dc81317afa'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:26.276028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-491a650c-8ff9-492b-835a-43dc81317afa admin admin] The token cache is being invalidate because project 766c0359b4eb443990f32792dfaa9949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:26.279242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-491a650c-8ff9-492b-835a-43dc81317afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:26.281733 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-491a650c-8ff9-492b-835a-43dc81317afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:26.295060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99a3bd-92ae-40c9-81b0-297795c1d655 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:26.295852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99a3bd-92ae-40c9-81b0-297795c1d655 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:26.295852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99a3bd-92ae-40c9-81b0-297795c1d655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:26.310411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 976/1929] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:25 2022] DELETE /identity/v3/projects/766c0359b4eb443990f32792dfaa9949 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:26.347792 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-dd99a3bd-92ae-40c9-81b0-297795c1d655 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:26.349106 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dd99a3bd-92ae-40c9-81b0-297795c1d655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:26.431960 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 954/1930] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:26.439775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ff537-21bd-4bad-abf4-a87763a012f8 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:26.440160 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ff537-21bd-4bad-abf4-a87763a012f8 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:26.441023 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ff537-21bd-4bad-abf4-a87763a012f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:26.481989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-3c4ff537-21bd-4bad-abf4-a87763a012f8 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:26.483133 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3c4ff537-21bd-4bad-abf4-a87763a012f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:26.497621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 977/1931] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:26.499047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99a3bd-92ae-40c9-81b0-297795c1d655 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:26.511081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99a3bd-92ae-40c9-81b0-297795c1d655 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:26.533332 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e2c1a-16d0-4bec-b531-6e15dc63ef49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:26.539018 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e2c1a-16d0-4bec-b531-6e15dc63ef49 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:26.539565 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e2c1a-16d0-4bec-b531-6e15dc63ef49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:26.540104 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e2c1a-16d0-4bec-b531-6e15dc63ef49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:26.541274 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e2c1a-16d0-4bec-b531-6e15dc63ef49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:06:26.541829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e2c1a-16d0-4bec-b531-6e15dc63ef49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:26.545502 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e2c1a-16d0-4bec-b531-6e15dc63ef49 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:26.600912 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ff537-21bd-4bad-abf4-a87763a012f8 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:26.601710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 955/1932] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:06:26.618945 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ff537-21bd-4bad-abf4-a87763a012f8 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:26.644137 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6835ff1-3b8a-40b0-b645-81735db2d032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:26.645089 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6835ff1-3b8a-40b0-b645-81735db2d032 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:26.647986 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6835ff1-3b8a-40b0-b645-81735db2d032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:26.648323 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6835ff1-3b8a-40b0-b645-81735db2d032 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:26.651109 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6835ff1-3b8a-40b0-b645-81735db2d032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:26.656495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6835ff1-3b8a-40b0-b645-81735db2d032 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:26.826538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e2c1a-16d0-4bec-b531-6e15dc63ef49 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:26.827023 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 978/1933] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:26 2022] POST /identity/v3/projects => generated 367 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:26.845713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e2c1a-16d0-4bec-b531-6e15dc63ef49 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:26.975901 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e80c6d-a6e8-4aa7-82ac-3a41198b04f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:26.976195 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e80c6d-a6e8-4aa7-82ac-3a41198b04f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:26.976368 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e80c6d-a6e8-4aa7-82ac-3a41198b04f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:26.976647 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e80c6d-a6e8-4aa7-82ac-3a41198b04f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:26.977980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e80c6d-a6e8-4aa7-82ac-3a41198b04f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:26.980373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e80c6d-a6e8-4aa7-82ac-3a41198b04f2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:27.004584 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:27.123489 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 956/1934] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:26 2022] POST /identity/v3/users => generated 284 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:27.127390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6835ff1-3b8a-40b0-b645-81735db2d032 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:27.147346 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6835ff1-3b8a-40b0-b645-81735db2d032 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:27.170476 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401ff6b-bc25-477e-8978-45efbc0a1114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:27.171211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401ff6b-bc25-477e-8978-45efbc0a1114 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:27.171942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401ff6b-bc25-477e-8978-45efbc0a1114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:27.172303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401ff6b-bc25-477e-8978-45efbc0a1114 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:27.173249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401ff6b-bc25-477e-8978-45efbc0a1114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:27.175220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401ff6b-bc25-477e-8978-45efbc0a1114 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:27.192398 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 979/1935] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:27.197171 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e80c6d-a6e8-4aa7-82ac-3a41198b04f2 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:27.213911 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e80c6d-a6e8-4aa7-82ac-3a41198b04f2 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:27.220502 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019deb46-6ee7-4fb8-be12-40352bd59092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:27.222804 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019deb46-6ee7-4fb8-be12-40352bd59092 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:27.223494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019deb46-6ee7-4fb8-be12-40352bd59092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:27.223928 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019deb46-6ee7-4fb8-be12-40352bd59092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:27.224973 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019deb46-6ee7-4fb8-be12-40352bd59092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:27.227536 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019deb46-6ee7-4fb8-be12-40352bd59092 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:27.244979 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 957/1936] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:27.245743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401ff6b-bc25-477e-8978-45efbc0a1114 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:27.257935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401ff6b-bc25-477e-8978-45efbc0a1114 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:27.262674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819b230-e8b1-4790-a2cf-9be99f86027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:27.263422 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819b230-e8b1-4790-a2cf-9be99f86027b admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:27.263799 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819b230-e8b1-4790-a2cf-9be99f86027b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:27.264148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819b230-e8b1-4790-a2cf-9be99f86027b admin admin] PATH_INFO: `/v3/projects/99d30f72dbb34ccc9adf1798c4f51505/users/f80ee330961d46d785b3dda4743f69b3/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:27.279307 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819b230-e8b1-4790-a2cf-9be99f86027b admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d30f72dbb34ccc9adf1798c4f51505, user_id=f80ee330961d46d785b3dda4743f69b3, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:27.282235 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819b230-e8b1-4790-a2cf-9be99f86027b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:27.364659 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 980/1937] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:27 2022] PUT /identity/v3/projects/99d30f72dbb34ccc9adf1798c4f51505/users/f80ee330961d46d785b3dda4743f69b3/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:27.377700 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82653029-729d-404b-81c9-69257551fe48 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:27.378557 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82653029-729d-404b-81c9-69257551fe48 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:27.378557 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82653029-729d-404b-81c9-69257551fe48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:27.424452 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-82653029-729d-404b-81c9-69257551fe48 None None] MFA Rules not processed for user `f80ee330961d46d785b3dda4743f69b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:27.426840 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-82653029-729d-404b-81c9-69257551fe48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:27.522536 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 958/1938] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:27.526868 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819b230-e8b1-4790-a2cf-9be99f86027b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:27.593138 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819b230-e8b1-4790-a2cf-9be99f86027b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:27.599199 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca910d4c-80fd-47fc-8bbd-511750de41b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:27.599836 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca910d4c-80fd-47fc-8bbd-511750de41b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:27.600123 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca910d4c-80fd-47fc-8bbd-511750de41b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:27.600396 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca910d4c-80fd-47fc-8bbd-511750de41b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:27.601158 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca910d4c-80fd-47fc-8bbd-511750de41b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:27.603230 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca910d4c-80fd-47fc-8bbd-511750de41b9 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:27.678236 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:27.718356 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82653029-729d-404b-81c9-69257551fe48 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:27.719847 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-82653029-729d-404b-81c9-69257551fe48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:27.733862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82653029-729d-404b-81c9-69257551fe48 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:27.739245 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccce39e-858c-4cd7-a3bf-9a5f3f69d8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:27.740151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccce39e-858c-4cd7-a3bf-9a5f3f69d8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:27.741038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccce39e-858c-4cd7-a3bf-9a5f3f69d8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:27.741038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccce39e-858c-4cd7-a3bf-9a5f3f69d8b5 admin admin] PATH_INFO: `/v3/users/e82641ce63df4724a93ca08d27152883` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:27.741995 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccce39e-858c-4cd7-a3bf-9a5f3f69d8b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e82641ce63df4724a93ca08d27152883)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:27.742624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 981/1939] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:27 2022] POST /identity/v3/projects => generated 365 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:27.744086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccce39e-858c-4cd7-a3bf-9a5f3f69d8b5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:27.747204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca910d4c-80fd-47fc-8bbd-511750de41b9 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:27.809656 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca910d4c-80fd-47fc-8bbd-511750de41b9 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:27.814687 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4062552-daf7-4ec5-ac31-b7bcce7483f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:27.815312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4062552-daf7-4ec5-ac31-b7bcce7483f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:27.815590 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4062552-daf7-4ec5-ac31-b7bcce7483f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:27.815863 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4062552-daf7-4ec5-ac31-b7bcce7483f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:27.817317 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4062552-daf7-4ec5-ac31-b7bcce7483f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:27.819249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4062552-daf7-4ec5-ac31-b7bcce7483f2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:27.906462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 982/1940] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:27 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:27.910834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4062552-daf7-4ec5-ac31-b7bcce7483f2 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:27.920256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4062552-daf7-4ec5-ac31-b7bcce7483f2 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:27.924998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51f6bf-5ae0-48af-8a61-60295da8a190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:27.925598 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51f6bf-5ae0-48af-8a61-60295da8a190 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:27.925917 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51f6bf-5ae0-48af-8a61-60295da8a190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:27.926219 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51f6bf-5ae0-48af-8a61-60295da8a190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:27.927445 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51f6bf-5ae0-48af-8a61-60295da8a190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:27.929976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51f6bf-5ae0-48af-8a61-60295da8a190 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:27.941003 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9ccce39e-858c-4cd7-a3bf-9a5f3f69d8b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e82641ce63df4724a93ca08d27152883'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:27.942424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 983/1941] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:06:27.944725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9ccce39e-858c-4cd7-a3bf-9a5f3f69d8b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e82641ce63df4724a93ca08d27152883'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:27.945716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51f6bf-5ae0-48af-8a61-60295da8a190 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:27.953741 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9ccce39e-858c-4cd7-a3bf-9a5f3f69d8b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e82641ce63df4724a93ca08d27152883'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:27.955413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51f6bf-5ae0-48af-8a61-60295da8a190 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:27.960771 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b15ad-7446-4c52-b2b4-049bc7c3ba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:27.961093 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9ccce39e-858c-4cd7-a3bf-9a5f3f69d8b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e82641ce63df4724a93ca08d27152883'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:27.961426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b15ad-7446-4c52-b2b4-049bc7c3ba55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:27.961709 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b15ad-7446-4c52-b2b4-049bc7c3ba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:27.961806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9ccce39e-858c-4cd7-a3bf-9a5f3f69d8b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e82641ce63df4724a93ca08d27152883'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:27.962007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b15ad-7446-4c52-b2b4-049bc7c3ba55 admin admin] PATH_INFO: `/v3/projects/bca86a735f32482598659ddb79b3a675/users/6d04d64f5fab4385b83c0263bcfb32f8/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:27.977158 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b15ad-7446-4c52-b2b4-049bc7c3ba55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca86a735f32482598659ddb79b3a675, user_id=6d04d64f5fab4385b83c0263bcfb32f8, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:27.980448 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b15ad-7446-4c52-b2b4-049bc7c3ba55 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:28.073495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 959/1942] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:27 2022] DELETE /identity/v3/users/e82641ce63df4724a93ca08d27152883 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:28.074149 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 984/1943] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:27 2022] PUT /identity/v3/projects/bca86a735f32482598659ddb79b3a675/users/6d04d64f5fab4385b83c0263bcfb32f8/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:28.077889 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c764b-cbb4-4d7b-b300-9036bc6374b5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:28.078174 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c764b-cbb4-4d7b-b300-9036bc6374b5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:28.078502 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c764b-cbb4-4d7b-b300-9036bc6374b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:28.079975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b15ad-7446-4c52-b2b4-049bc7c3ba55 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:28.082841 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-268b15ad-7446-4c52-b2b4-049bc7c3ba55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:28.101270 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-762c764b-cbb4-4d7b-b300-9036bc6374b5 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:28.102664 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-762c764b-cbb4-4d7b-b300-9036bc6374b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:28.168302 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 960/1944] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:28.178266 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b15ad-7446-4c52-b2b4-049bc7c3ba55 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:28.183349 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb2c71-2a20-43b5-a7b0-09fd20ed7877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:28.183994 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb2c71-2a20-43b5-a7b0-09fd20ed7877 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:28.184590 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb2c71-2a20-43b5-a7b0-09fd20ed7877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:28.184837 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb2c71-2a20-43b5-a7b0-09fd20ed7877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:28.185849 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb2c71-2a20-43b5-a7b0-09fd20ed7877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:28.186571 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c764b-cbb4-4d7b-b300-9036bc6374b5 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:28.187673 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb2c71-2a20-43b5-a7b0-09fd20ed7877 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:28.188267 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-762c764b-cbb4-4d7b-b300-9036bc6374b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:28.204469 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 985/1945] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:28.208683 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb2c71-2a20-43b5-a7b0-09fd20ed7877 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:28.219470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb2c71-2a20-43b5-a7b0-09fd20ed7877 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:28.226049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26daeb1-96fe-4232-aba2-31705b01fc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:28.226737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26daeb1-96fe-4232-aba2-31705b01fc46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:28.229234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26daeb1-96fe-4232-aba2-31705b01fc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:28.229234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26daeb1-96fe-4232-aba2-31705b01fc46 admin admin] PATH_INFO: `/v3/projects/bca86a735f32482598659ddb79b3a675/users/6d04d64f5fab4385b83c0263bcfb32f8/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:28.229445 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26daeb1-96fe-4232-aba2-31705b01fc46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca86a735f32482598659ddb79b3a675, user_id=6d04d64f5fab4385b83c0263bcfb32f8, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:28.232593 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26daeb1-96fe-4232-aba2-31705b01fc46 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:28.244833 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 986/1946] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:28 2022] PUT /identity/v3/projects/bca86a735f32482598659ddb79b3a675/users/6d04d64f5fab4385b83c0263bcfb32f8/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:28.255327 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb675d4-71fd-4e14-a624-8baef960ab19 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:28.255956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb675d4-71fd-4e14-a624-8baef960ab19 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:28.256511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb675d4-71fd-4e14-a624-8baef960ab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:28.278162 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c764b-cbb4-4d7b-b300-9036bc6374b5 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:28.296390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-8bb675d4-71fd-4e14-a624-8baef960ab19 None None] MFA Rules not processed for user `6d04d64f5fab4385b83c0263bcfb32f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:28.297618 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8bb675d4-71fd-4e14-a624-8baef960ab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:28.353649 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ac715-2cd4-45cf-8eae-cc6514ff1048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:28.354477 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ac715-2cd4-45cf-8eae-cc6514ff1048 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:28.354862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ac715-2cd4-45cf-8eae-cc6514ff1048 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:28.355231 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ac715-2cd4-45cf-8eae-cc6514ff1048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:28.403144 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 987/1947] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:28.412829 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb675d4-71fd-4e14-a624-8baef960ab19 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:28.413220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8bb675d4-71fd-4e14-a624-8baef960ab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:28.471644 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ac715-2cd4-45cf-8eae-cc6514ff1048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:28.473945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ac715-2cd4-45cf-8eae-cc6514ff1048 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:28.491355 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 961/1948] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:06:28.495422 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb675d4-71fd-4e14-a624-8baef960ab19 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:28.499646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98269ae-6be6-4a9d-b2ad-4623e8fd59e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:28.500286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98269ae-6be6-4a9d-b2ad-4623e8fd59e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:28.500572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98269ae-6be6-4a9d-b2ad-4623e8fd59e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:28.500911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98269ae-6be6-4a9d-b2ad-4623e8fd59e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:28.511640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98269ae-6be6-4a9d-b2ad-4623e8fd59e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:28.513287 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98269ae-6be6-4a9d-b2ad-4623e8fd59e9 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:28.528902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 988/1949] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:28 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:06:28.695097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:28.798666 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ac715-2cd4-45cf-8eae-cc6514ff1048 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:28.808703 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ac715-2cd4-45cf-8eae-cc6514ff1048 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:28.812545 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6cf72-05a1-4293-a71a-2f278c4013b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:28.813883 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6cf72-05a1-4293-a71a-2f278c4013b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:28.813883 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6cf72-05a1-4293-a71a-2f278c4013b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:28.813883 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6cf72-05a1-4293-a71a-2f278c4013b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:28.815526 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0de6cf72-05a1-4293-a71a-2f278c4013b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:28.877583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6cf72-05a1-4293-a71a-2f278c4013b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:28.879040 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6cf72-05a1-4293-a71a-2f278c4013b4 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:28.888319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 962/1950] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:29.010920 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98269ae-6be6-4a9d-b2ad-4623e8fd59e9 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:29.013997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a98269ae-6be6-4a9d-b2ad-4623e8fd59e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:29.028455 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98269ae-6be6-4a9d-b2ad-4623e8fd59e9 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:29.033673 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a919c3-212e-4f87-b583-eee8a23717da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:29.034318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a919c3-212e-4f87-b583-eee8a23717da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:29.034598 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a919c3-212e-4f87-b583-eee8a23717da admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:29.034874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a919c3-212e-4f87-b583-eee8a23717da admin admin] PATH_INFO: `/v3/projects/b8075d261cd84c6799b1dee84031e0fb` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:29.036605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a919c3-212e-4f87-b583-eee8a23717da admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8075d261cd84c6799b1dee84031e0fb)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:29.038551 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a919c3-212e-4f87-b583-eee8a23717da admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:29.191724 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-45a919c3-212e-4f87-b583-eee8a23717da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8075d261cd84c6799b1dee84031e0fb', 'request_id': 'req-45a919c3-212e-4f87-b583-eee8a23717da'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:29.288897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-45a919c3-212e-4f87-b583-eee8a23717da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8075d261cd84c6799b1dee84031e0fb', 'request_id': 'req-45a919c3-212e-4f87-b583-eee8a23717da'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:29.295021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-45a919c3-212e-4f87-b583-eee8a23717da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8075d261cd84c6799b1dee84031e0fb', 'request_id': 'req-45a919c3-212e-4f87-b583-eee8a23717da'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:29.308002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-45a919c3-212e-4f87-b583-eee8a23717da admin admin] The token cache is being invalidate because project b8075d261cd84c6799b1dee84031e0fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:29.308002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-45a919c3-212e-4f87-b583-eee8a23717da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:29.308741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-45a919c3-212e-4f87-b583-eee8a23717da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:29.310352 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 989/1951] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:29 2022] DELETE /identity/v3/projects/b8075d261cd84c6799b1dee84031e0fb => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:29.314505 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6cf72-05a1-4293-a71a-2f278c4013b4 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:29.326539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6cf72-05a1-4293-a71a-2f278c4013b4 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:29.415354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f986d0d-3933-4429-90c4-546054f2090c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:29.416011 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f986d0d-3933-4429-90c4-546054f2090c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:29.416294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f986d0d-3933-4429-90c4-546054f2090c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:29.416573 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f986d0d-3933-4429-90c4-546054f2090c admin admin] PATH_INFO: `/v3/users/6131fa6275584c28bd87230eb782ca49` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:29.417891 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f986d0d-3933-4429-90c4-546054f2090c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6131fa6275584c28bd87230eb782ca49)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:29.419870 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f986d0d-3933-4429-90c4-546054f2090c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:29.621666 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:29.684444 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2f986d0d-3933-4429-90c4-546054f2090c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6131fa6275584c28bd87230eb782ca49'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:29.685292 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2f986d0d-3933-4429-90c4-546054f2090c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6131fa6275584c28bd87230eb782ca49'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:29.711501 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2f986d0d-3933-4429-90c4-546054f2090c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6131fa6275584c28bd87230eb782ca49'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:29.719647 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2f986d0d-3933-4429-90c4-546054f2090c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6131fa6275584c28bd87230eb782ca49'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:29.720722 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2f986d0d-3933-4429-90c4-546054f2090c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6131fa6275584c28bd87230eb782ca49'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:29.860661 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 963/1952] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:29 2022] DELETE /identity/v3/users/6131fa6275584c28bd87230eb782ca49 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:30.348648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a919c3-212e-4f87-b583-eee8a23717da admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:30.350112 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-45a919c3-212e-4f87-b583-eee8a23717da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:30.365759 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a919c3-212e-4f87-b583-eee8a23717da admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:30.423676 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023abd2-9026-4be2-8cb4-04a93347de9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:30.424329 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023abd2-9026-4be2-8cb4-04a93347de9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:30.424611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023abd2-9026-4be2-8cb4-04a93347de9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:30.424926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023abd2-9026-4be2-8cb4-04a93347de9a admin admin] PATH_INFO: `/v3/projects/ed764b04d0754ba7a5997265216cba18` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:30.426960 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023abd2-9026-4be2-8cb4-04a93347de9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed764b04d0754ba7a5997265216cba18)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:30.428989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023abd2-9026-4be2-8cb4-04a93347de9a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:30.554553 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6023abd2-9026-4be2-8cb4-04a93347de9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed764b04d0754ba7a5997265216cba18', 'request_id': 'req-6023abd2-9026-4be2-8cb4-04a93347de9a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:30.650067 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6023abd2-9026-4be2-8cb4-04a93347de9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed764b04d0754ba7a5997265216cba18', 'request_id': 'req-6023abd2-9026-4be2-8cb4-04a93347de9a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:30.658619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6023abd2-9026-4be2-8cb4-04a93347de9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed764b04d0754ba7a5997265216cba18', 'request_id': 'req-6023abd2-9026-4be2-8cb4-04a93347de9a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:30.671068 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6023abd2-9026-4be2-8cb4-04a93347de9a admin admin] The token cache is being invalidate because project ed764b04d0754ba7a5997265216cba18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:30.671493 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6023abd2-9026-4be2-8cb4-04a93347de9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:30.672246 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6023abd2-9026-4be2-8cb4-04a93347de9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:30.676975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 990/1953] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:30 2022] DELETE /identity/v3/projects/ed764b04d0754ba7a5997265216cba18 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:30.678966 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea992a-3d48-4a08-ad5f-43be0454426d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:30.679412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea992a-3d48-4a08-ad5f-43be0454426d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:30.679590 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea992a-3d48-4a08-ad5f-43be0454426d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:30.710250 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-77ea992a-3d48-4a08-ad5f-43be0454426d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:30.712318 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-77ea992a-3d48-4a08-ad5f-43be0454426d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:30.785152 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 964/1954] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:30.794108 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea6b16-8bac-4a60-8376-af4e1b9cf266 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:30.794423 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea6b16-8bac-4a60-8376-af4e1b9cf266 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:30.794700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea6b16-8bac-4a60-8376-af4e1b9cf266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:30.818526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c1ea6b16-8bac-4a60-8376-af4e1b9cf266 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:30.823391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c1ea6b16-8bac-4a60-8376-af4e1b9cf266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:30.831782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 991/1955] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:30.836737 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea992a-3d48-4a08-ad5f-43be0454426d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:30.849630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea992a-3d48-4a08-ad5f-43be0454426d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:30.854449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343179ed-117b-4559-8ede-599b3965ac2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:30.855154 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343179ed-117b-4559-8ede-599b3965ac2c admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:30.855446 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343179ed-117b-4559-8ede-599b3965ac2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:30.855716 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343179ed-117b-4559-8ede-599b3965ac2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:30.856662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343179ed-117b-4559-8ede-599b3965ac2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:06:30.857070 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343179ed-117b-4559-8ede-599b3965ac2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:30.858792 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343179ed-117b-4559-8ede-599b3965ac2c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:30.873853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 965/1956] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:06:30.878240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea6b16-8bac-4a60-8376-af4e1b9cf266 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:30.888358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea6b16-8bac-4a60-8376-af4e1b9cf266 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:30.893707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10786ede-aac5-4ea2-b642-2032f0154919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:30.894340 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10786ede-aac5-4ea2-b642-2032f0154919 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:30.895389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10786ede-aac5-4ea2-b642-2032f0154919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:30.895554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10786ede-aac5-4ea2-b642-2032f0154919 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:30.896225 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10786ede-aac5-4ea2-b642-2032f0154919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:30.898322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10786ede-aac5-4ea2-b642-2032f0154919 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:31.051375 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 992/1957] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:30 2022] POST /identity/v3/projects => generated 389 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:31.055405 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343179ed-117b-4559-8ede-599b3965ac2c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:31.065847 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343179ed-117b-4559-8ede-599b3965ac2c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:31.124279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161083a-03b4-49c6-b3c5-24fdb3ea4573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:31.124967 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161083a-03b4-49c6-b3c5-24fdb3ea4573 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:31.125251 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161083a-03b4-49c6-b3c5-24fdb3ea4573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:31.125533 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161083a-03b4-49c6-b3c5-24fdb3ea4573 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:31.126555 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161083a-03b4-49c6-b3c5-24fdb3ea4573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:31.128367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161083a-03b4-49c6-b3c5-24fdb3ea4573 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:31.242896 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:31.248299 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 966/1958] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:31 2022] POST /identity/v3/users => generated 295 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:31.252328 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10786ede-aac5-4ea2-b642-2032f0154919 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:31.263158 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10786ede-aac5-4ea2-b642-2032f0154919 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:31.267746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e90d3-65ed-4ffa-880e-8b0f95e6f24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:31.268370 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e90d3-65ed-4ffa-880e-8b0f95e6f24b admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:31.268653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e90d3-65ed-4ffa-880e-8b0f95e6f24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:31.268968 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e90d3-65ed-4ffa-880e-8b0f95e6f24b admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:31.269687 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e90d3-65ed-4ffa-880e-8b0f95e6f24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:31.271302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e90d3-65ed-4ffa-880e-8b0f95e6f24b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:31.281566 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 993/1959] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:31.286483 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161083a-03b4-49c6-b3c5-24fdb3ea4573 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:31.296676 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161083a-03b4-49c6-b3c5-24fdb3ea4573 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:31.304473 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cbfa0-2ede-47e7-9179-297f9b5e9915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:31.305155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cbfa0-2ede-47e7-9179-297f9b5e9915 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:31.305444 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cbfa0-2ede-47e7-9179-297f9b5e9915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:31.305727 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cbfa0-2ede-47e7-9179-297f9b5e9915 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:31.306470 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cbfa0-2ede-47e7-9179-297f9b5e9915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:31.308123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cbfa0-2ede-47e7-9179-297f9b5e9915 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:31.319852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 967/1960] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:31.324162 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e90d3-65ed-4ffa-880e-8b0f95e6f24b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:31.343509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e90d3-65ed-4ffa-880e-8b0f95e6f24b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:31.355058 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3983dc9-20d5-47e3-9fa4-bd74b7600815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:31.359103 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3983dc9-20d5-47e3-9fa4-bd74b7600815 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:31.359103 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3983dc9-20d5-47e3-9fa4-bd74b7600815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:31.359103 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3983dc9-20d5-47e3-9fa4-bd74b7600815 admin admin] PATH_INFO: `/v3/projects/a309d54ca68f4d2ba033b68cdcfff2a7/users/b4450a554ba74eebb51629ef37f12b2d/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:31.380473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3983dc9-20d5-47e3-9fa4-bd74b7600815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a309d54ca68f4d2ba033b68cdcfff2a7, user_id=b4450a554ba74eebb51629ef37f12b2d, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:31.384066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3983dc9-20d5-47e3-9fa4-bd74b7600815 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:32.163313 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 994/1961] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:31 2022] PUT /identity/v3/projects/a309d54ca68f4d2ba033b68cdcfff2a7/users/b4450a554ba74eebb51629ef37f12b2d/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:32.172616 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02ea78-0dfd-459c-8229-f9a0e754c92e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:32.173663 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02ea78-0dfd-459c-8229-f9a0e754c92e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:32.174150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02ea78-0dfd-459c-8229-f9a0e754c92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:32.206282 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7a02ea78-0dfd-459c-8229-f9a0e754c92e None None] MFA Rules not processed for user `b4450a554ba74eebb51629ef37f12b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:32.208591 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7a02ea78-0dfd-459c-8229-f9a0e754c92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:32.303093 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 968/1962] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:32.307874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3983dc9-20d5-47e3-9fa4-bd74b7600815 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:32.377462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3983dc9-20d5-47e3-9fa4-bd74b7600815 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:32.382880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179789ec-f0be-453c-9bec-1242de0c2a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:32.383568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179789ec-f0be-453c-9bec-1242de0c2a86 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:32.383859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179789ec-f0be-453c-9bec-1242de0c2a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:32.384147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179789ec-f0be-453c-9bec-1242de0c2a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:32.384910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179789ec-f0be-453c-9bec-1242de0c2a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:32.386872 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179789ec-f0be-453c-9bec-1242de0c2a86 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:32.600344 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 995/1963] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:32 2022] POST /identity/v3/projects => generated 387 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:32.604502 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02ea78-0dfd-459c-8229-f9a0e754c92e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:32.615948 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02ea78-0dfd-459c-8229-f9a0e754c92e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:32.673945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62498c-70b0-41e7-980e-7930de8edc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:32.674617 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62498c-70b0-41e7-980e-7930de8edc27 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:32.674975 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62498c-70b0-41e7-980e-7930de8edc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:32.675173 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62498c-70b0-41e7-980e-7930de8edc27 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:32.675914 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62498c-70b0-41e7-980e-7930de8edc27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:32.677919 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62498c-70b0-41e7-980e-7930de8edc27 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:32.890857 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:32.915963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 969/1964] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:32 2022] POST /identity/v3/users => generated 300 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:32.917120 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179789ec-f0be-453c-9bec-1242de0c2a86 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:32.931086 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179789ec-f0be-453c-9bec-1242de0c2a86 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:32.937019 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87c14e-b308-4c1c-8b1d-4f7ff30046f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:32.937850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87c14e-b308-4c1c-8b1d-4f7ff30046f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:32.938229 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87c14e-b308-4c1c-8b1d-4f7ff30046f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:32.938518 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87c14e-b308-4c1c-8b1d-4f7ff30046f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:32.939231 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87c14e-b308-4c1c-8b1d-4f7ff30046f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:32.940944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87c14e-b308-4c1c-8b1d-4f7ff30046f9 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:32.953371 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 996/1965] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:06:32.961285 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62498c-70b0-41e7-980e-7930de8edc27 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:32.971209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62498c-70b0-41e7-980e-7930de8edc27 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:32.976005 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f8095-5339-4dec-9324-2d6a32145fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:32.976796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f8095-5339-4dec-9324-2d6a32145fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:32.977150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f8095-5339-4dec-9324-2d6a32145fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:32.977488 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f8095-5339-4dec-9324-2d6a32145fbe admin admin] PATH_INFO: `/v3/projects/571f8aa79837486e829a72787c962d1f/users/18d3ea226df4482eb13143c7105eed13/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:32.993406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f8095-5339-4dec-9324-2d6a32145fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=571f8aa79837486e829a72787c962d1f, user_id=18d3ea226df4482eb13143c7105eed13, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:32.996282 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f8095-5339-4dec-9324-2d6a32145fbe admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:33.156678 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 970/1966] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:32 2022] PUT /identity/v3/projects/571f8aa79837486e829a72787c962d1f/users/18d3ea226df4482eb13143c7105eed13/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:33.160393 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87c14e-b308-4c1c-8b1d-4f7ff30046f9 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:33.175297 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87c14e-b308-4c1c-8b1d-4f7ff30046f9 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:33.377163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3ee06-531e-4bec-85b9-0c027d7e0eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:33.378926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3ee06-531e-4bec-85b9-0c027d7e0eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:33.378926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3ee06-531e-4bec-85b9-0c027d7e0eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:33.378926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3ee06-531e-4bec-85b9-0c027d7e0eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:33.380165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3ee06-531e-4bec-85b9-0c027d7e0eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:33.381933 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3ee06-531e-4bec-85b9-0c027d7e0eb9 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:33.394265 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 997/1967] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:33.398216 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f8095-5339-4dec-9324-2d6a32145fbe admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:33.420656 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f8095-5339-4dec-9324-2d6a32145fbe admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:33.437673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138f33d-a7a0-47ea-8ea9-668acc8c1efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:33.438923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138f33d-a7a0-47ea-8ea9-668acc8c1efe admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:33.439437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138f33d-a7a0-47ea-8ea9-668acc8c1efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:33.439784 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138f33d-a7a0-47ea-8ea9-668acc8c1efe admin admin] PATH_INFO: `/v3/projects/571f8aa79837486e829a72787c962d1f/users/18d3ea226df4482eb13143c7105eed13/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:33.442312 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138f33d-a7a0-47ea-8ea9-668acc8c1efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=571f8aa79837486e829a72787c962d1f, user_id=18d3ea226df4482eb13143c7105eed13, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:33.445683 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138f33d-a7a0-47ea-8ea9-668acc8c1efe admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:33.461701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 971/1968] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:33 2022] PUT /identity/v3/projects/571f8aa79837486e829a72787c962d1f/users/18d3ea226df4482eb13143c7105eed13/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:33.472105 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2b92d-36b0-422f-892f-0f659fecfc46 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:33.472396 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2b92d-36b0-422f-892f-0f659fecfc46 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:33.473237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2b92d-36b0-422f-892f-0f659fecfc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:33.511428 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b7d2b92d-36b0-422f-892f-0f659fecfc46 None None] MFA Rules not processed for user `18d3ea226df4482eb13143c7105eed13`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:33.513621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b7d2b92d-36b0-422f-892f-0f659fecfc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:33.622964 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 998/1969] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:33.633815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138f33d-a7a0-47ea-8ea9-668acc8c1efe admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:33.635529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c138f33d-a7a0-47ea-8ea9-668acc8c1efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:33.709786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138f33d-a7a0-47ea-8ea9-668acc8c1efe admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:33.713577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e9ad8-7da1-4742-9831-3edcaf63b6d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:33.727695 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e9ad8-7da1-4742-9831-3edcaf63b6d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:33.727695 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e9ad8-7da1-4742-9831-3edcaf63b6d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:33.727695 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e9ad8-7da1-4742-9831-3edcaf63b6d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:33.727695 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e9ad8-7da1-4742-9831-3edcaf63b6d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:33.727695 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e9ad8-7da1-4742-9831-3edcaf63b6d1 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:33.737995 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 972/1970] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:33.886472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2b92d-36b0-422f-892f-0f659fecfc46 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:33.954454 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2b92d-36b0-422f-892f-0f659fecfc46 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:33.960084 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e340f0-031b-42b4-9beb-0096f3275b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:33.961739 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e340f0-031b-42b4-9beb-0096f3275b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:33.962234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e340f0-031b-42b4-9beb-0096f3275b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:33.962704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e340f0-031b-42b4-9beb-0096f3275b83 admin admin] PATH_INFO: `/v3/users/b4450a554ba74eebb51629ef37f12b2d` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:33.974081 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e340f0-031b-42b4-9beb-0096f3275b83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4450a554ba74eebb51629ef37f12b2d)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:33.976113 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e340f0-031b-42b4-9beb-0096f3275b83 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:34.193090 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-60e340f0-031b-42b4-9beb-0096f3275b83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4450a554ba74eebb51629ef37f12b2d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:34.270696 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-60e340f0-031b-42b4-9beb-0096f3275b83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4450a554ba74eebb51629ef37f12b2d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:34.283924 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-60e340f0-031b-42b4-9beb-0096f3275b83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4450a554ba74eebb51629ef37f12b2d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:34.291832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-60e340f0-031b-42b4-9beb-0096f3275b83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4450a554ba74eebb51629ef37f12b2d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:34.292565 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-60e340f0-031b-42b4-9beb-0096f3275b83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4450a554ba74eebb51629ef37f12b2d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:34.299033 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 999/1971] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:33 2022] DELETE /identity/v3/users/b4450a554ba74eebb51629ef37f12b2d => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:34.304169 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494313f5-56a8-4da7-a3da-1be93afa1263 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:34.304909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494313f5-56a8-4da7-a3da-1be93afa1263 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:34.305953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494313f5-56a8-4da7-a3da-1be93afa1263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:34.363245 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-494313f5-56a8-4da7-a3da-1be93afa1263 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:34.365781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-494313f5-56a8-4da7-a3da-1be93afa1263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:34.474387 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 973/1972] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:34.487850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e340f0-031b-42b4-9beb-0096f3275b83 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:34.492527 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-60e340f0-031b-42b4-9beb-0096f3275b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:34.613660 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e340f0-031b-42b4-9beb-0096f3275b83 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:34.632109 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2dda91-17e3-44a4-ba52-e8f041cda96c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:34.633108 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dda91-17e3-44a4-ba52-e8f041cda96c service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:34.633108 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dda91-17e3-44a4-ba52-e8f041cda96c service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:34.633342 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dda91-17e3-44a4-ba52-e8f041cda96c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:34.672607 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2dda91-17e3-44a4-ba52-e8f041cda96c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:34.674306 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2dda91-17e3-44a4-ba52-e8f041cda96c service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:34.695196 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1000/1973] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:35.969908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494313f5-56a8-4da7-a3da-1be93afa1263 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:35.972724 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-494313f5-56a8-4da7-a3da-1be93afa1263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:36.001421 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494313f5-56a8-4da7-a3da-1be93afa1263 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:36.010565 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae563440-29af-4acd-a33f-ee36e73eb83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:36.011335 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae563440-29af-4acd-a33f-ee36e73eb83d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:36.011694 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae563440-29af-4acd-a33f-ee36e73eb83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:36.013485 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae563440-29af-4acd-a33f-ee36e73eb83d admin admin] PATH_INFO: `/v3/projects/a309d54ca68f4d2ba033b68cdcfff2a7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:36.017801 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae563440-29af-4acd-a33f-ee36e73eb83d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a309d54ca68f4d2ba033b68cdcfff2a7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:36.021644 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae563440-29af-4acd-a33f-ee36e73eb83d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:36.043585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:36.186188 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ae563440-29af-4acd-a33f-ee36e73eb83d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a309d54ca68f4d2ba033b68cdcfff2a7', 'request_id': 'req-ae563440-29af-4acd-a33f-ee36e73eb83d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:36.200825 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ae563440-29af-4acd-a33f-ee36e73eb83d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a309d54ca68f4d2ba033b68cdcfff2a7', 'request_id': 'req-ae563440-29af-4acd-a33f-ee36e73eb83d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:36.214495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ae563440-29af-4acd-a33f-ee36e73eb83d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a309d54ca68f4d2ba033b68cdcfff2a7', 'request_id': 'req-ae563440-29af-4acd-a33f-ee36e73eb83d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:36.310742 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ae563440-29af-4acd-a33f-ee36e73eb83d admin admin] The token cache is being invalidate because project a309d54ca68f4d2ba033b68cdcfff2a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:36.311044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ae563440-29af-4acd-a33f-ee36e73eb83d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:36.313141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ae563440-29af-4acd-a33f-ee36e73eb83d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:36.314997 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 974/1974] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:35 2022] DELETE /identity/v3/projects/a309d54ca68f4d2ba033b68cdcfff2a7 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:36.319261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2dda91-17e3-44a4-ba52-e8f041cda96c service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:36.332812 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2dda91-17e3-44a4-ba52-e8f041cda96c service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:36.469232 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295886ac-365b-4732-bb57-106e4c2a2a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:36.470737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295886ac-365b-4732-bb57-106e4c2a2a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:36.471032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295886ac-365b-4732-bb57-106e4c2a2a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:36.475077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295886ac-365b-4732-bb57-106e4c2a2a30 admin admin] PATH_INFO: `/v3/users/18d3ea226df4482eb13143c7105eed13` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:36.476601 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295886ac-365b-4732-bb57-106e4c2a2a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d3ea226df4482eb13143c7105eed13)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:36.478638 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295886ac-365b-4732-bb57-106e4c2a2a30 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:36.692386 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-295886ac-365b-4732-bb57-106e4c2a2a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d3ea226df4482eb13143c7105eed13'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:36.752617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-295886ac-365b-4732-bb57-106e4c2a2a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d3ea226df4482eb13143c7105eed13'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:36.766539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-295886ac-365b-4732-bb57-106e4c2a2a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d3ea226df4482eb13143c7105eed13'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:36.773478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-295886ac-365b-4732-bb57-106e4c2a2a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d3ea226df4482eb13143c7105eed13'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:36.774202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-295886ac-365b-4732-bb57-106e4c2a2a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d3ea226df4482eb13143c7105eed13'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:36.780166 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1001/1975] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:36 2022] DELETE /identity/v3/users/18d3ea226df4482eb13143c7105eed13 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:37.211684 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:37.669324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae563440-29af-4acd-a33f-ee36e73eb83d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:37.676202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ae563440-29af-4acd-a33f-ee36e73eb83d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:37.685041 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae563440-29af-4acd-a33f-ee36e73eb83d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:37.756700 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c4e1d-3ee8-4589-b18d-6571d0b6230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:37.757410 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c4e1d-3ee8-4589-b18d-6571d0b6230f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:37.757697 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c4e1d-3ee8-4589-b18d-6571d0b6230f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:37.757974 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c4e1d-3ee8-4589-b18d-6571d0b6230f admin admin] PATH_INFO: `/v3/projects/571f8aa79837486e829a72787c962d1f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:37.759202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c4e1d-3ee8-4589-b18d-6571d0b6230f admin admin] RBAC: Authorizing `identity:delete_project(project_id=571f8aa79837486e829a72787c962d1f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:37.761189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c4e1d-3ee8-4589-b18d-6571d0b6230f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:37.954020 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e46c4e1d-3ee8-4589-b18d-6571d0b6230f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '571f8aa79837486e829a72787c962d1f', 'request_id': 'req-e46c4e1d-3ee8-4589-b18d-6571d0b6230f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:37.963630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e46c4e1d-3ee8-4589-b18d-6571d0b6230f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '571f8aa79837486e829a72787c962d1f', 'request_id': 'req-e46c4e1d-3ee8-4589-b18d-6571d0b6230f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:37.972361 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e46c4e1d-3ee8-4589-b18d-6571d0b6230f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '571f8aa79837486e829a72787c962d1f', 'request_id': 'req-e46c4e1d-3ee8-4589-b18d-6571d0b6230f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:38.152380 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e46c4e1d-3ee8-4589-b18d-6571d0b6230f admin admin] The token cache is being invalidate because project 571f8aa79837486e829a72787c962d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:38.152957 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e46c4e1d-3ee8-4589-b18d-6571d0b6230f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:38.153800 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e46c4e1d-3ee8-4589-b18d-6571d0b6230f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:38.156713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 975/1976] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:37 2022] DELETE /identity/v3/projects/571f8aa79837486e829a72787c962d1f => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:38.165014 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9a805-a433-4e78-90a5-ac5ec0c610ce None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:38.165539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9a805-a433-4e78-90a5-ac5ec0c610ce None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:38.165642 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9a805-a433-4e78-90a5-ac5ec0c610ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:38.208228 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c1d9a805-a433-4e78-90a5-ac5ec0c610ce None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:38.209883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c1d9a805-a433-4e78-90a5-ac5ec0c610ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:38.325882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1002/1977] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:38.328046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67589f9a-fd1b-404f-b5bf-8df698ac1fbf None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:38.328553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67589f9a-fd1b-404f-b5bf-8df698ac1fbf None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:38.328655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67589f9a-fd1b-404f-b5bf-8df698ac1fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:38.333896 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9a805-a433-4e78-90a5-ac5ec0c610ce None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:38.336020 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c1d9a805-a433-4e78-90a5-ac5ec0c610ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:38.355226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9a805-a433-4e78-90a5-ac5ec0c610ce None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:38.367172 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257a8bd-9e5a-4cc2-9487-2cf12b0a35f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:38.367857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257a8bd-9e5a-4cc2-9487-2cf12b0a35f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:38.368146 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257a8bd-9e5a-4cc2-9487-2cf12b0a35f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:38.368426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257a8bd-9e5a-4cc2-9487-2cf12b0a35f9 admin admin] PATH_INFO: `/v3/users/d0e743068c094b63b56069e64e3a0e72` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:38.373637 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257a8bd-9e5a-4cc2-9487-2cf12b0a35f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e743068c094b63b56069e64e3a0e72)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:38.377931 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257a8bd-9e5a-4cc2-9487-2cf12b0a35f9 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:38.379011 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-67589f9a-fd1b-404f-b5bf-8df698ac1fbf None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:38.380470 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-67589f9a-fd1b-404f-b5bf-8df698ac1fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:38.391481 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 976/1978] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:38.398983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67589f9a-fd1b-404f-b5bf-8df698ac1fbf None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:38.412025 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67589f9a-fd1b-404f-b5bf-8df698ac1fbf None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:38.417840 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896406f3-f7b2-412f-a7c4-8b4d7c82ca9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:38.418831 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896406f3-f7b2-412f-a7c4-8b4d7c82ca9e admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:38.419216 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896406f3-f7b2-412f-a7c4-8b4d7c82ca9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:38.419586 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896406f3-f7b2-412f-a7c4-8b4d7c82ca9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:38.420303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896406f3-f7b2-412f-a7c4-8b4d7c82ca9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:06:38.420610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896406f3-f7b2-412f-a7c4-8b4d7c82ca9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:38.422311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896406f3-f7b2-412f-a7c4-8b4d7c82ca9e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:38.448469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 977/1979] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:06:38.452700 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896406f3-f7b2-412f-a7c4-8b4d7c82ca9e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:38.483393 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896406f3-f7b2-412f-a7c4-8b4d7c82ca9e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:38.498257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db4562-8d73-4107-a47b-04ed17e169a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:38.508839 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db4562-8d73-4107-a47b-04ed17e169a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:38.509366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db4562-8d73-4107-a47b-04ed17e169a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:38.509820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db4562-8d73-4107-a47b-04ed17e169a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:38.510541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db4562-8d73-4107-a47b-04ed17e169a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:38.514965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db4562-8d73-4107-a47b-04ed17e169a8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:38.682797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 978/1980] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:38 2022] POST /identity/v3/projects => generated 375 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:38.682797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db4562-8d73-4107-a47b-04ed17e169a8 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:38.686628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-33db4562-8d73-4107-a47b-04ed17e169a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:38.691174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-1257a8bd-9e5a-4cc2-9487-2cf12b0a35f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e743068c094b63b56069e64e3a0e72'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:38.759016 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db4562-8d73-4107-a47b-04ed17e169a8 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:38.764135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ed1d1-e3f9-442a-8776-ebc215848e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:38.764828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ed1d1-e3f9-442a-8776-ebc215848e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:38.765116 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ed1d1-e3f9-442a-8776-ebc215848e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:38.765399 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ed1d1-e3f9-442a-8776-ebc215848e08 admin admin] PATH_INFO: `/v3/users/f80ee330961d46d785b3dda4743f69b3` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:38.766598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ed1d1-e3f9-442a-8776-ebc215848e08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80ee330961d46d785b3dda4743f69b3)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:38.768739 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ed1d1-e3f9-442a-8776-ebc215848e08 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:38.774455 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-1257a8bd-9e5a-4cc2-9487-2cf12b0a35f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e743068c094b63b56069e64e3a0e72'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:38.791750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-1257a8bd-9e5a-4cc2-9487-2cf12b0a35f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e743068c094b63b56069e64e3a0e72'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:38.799751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-1257a8bd-9e5a-4cc2-9487-2cf12b0a35f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e743068c094b63b56069e64e3a0e72'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:38.800563 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-1257a8bd-9e5a-4cc2-9487-2cf12b0a35f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e743068c094b63b56069e64e3a0e72'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:38.807299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1003/1981] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:38 2022] DELETE /identity/v3/users/d0e743068c094b63b56069e64e3a0e72 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:38.808340 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257a8bd-9e5a-4cc2-9487-2cf12b0a35f9 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:38.809900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1257a8bd-9e5a-4cc2-9487-2cf12b0a35f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:38.878525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257a8bd-9e5a-4cc2-9487-2cf12b0a35f9 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:38.883496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164e7c1-e298-4092-89f3-eec884d0c7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:38.884138 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164e7c1-e298-4092-89f3-eec884d0c7ca admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:38.884423 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164e7c1-e298-4092-89f3-eec884d0c7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:38.884701 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164e7c1-e298-4092-89f3-eec884d0c7ca admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:38.885423 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164e7c1-e298-4092-89f3-eec884d0c7ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:38.887477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164e7c1-e298-4092-89f3-eec884d0c7ca admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:38.949292 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fb5ed1d1-e3f9-442a-8776-ebc215848e08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80ee330961d46d785b3dda4743f69b3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:38.950026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fb5ed1d1-e3f9-442a-8776-ebc215848e08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80ee330961d46d785b3dda4743f69b3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:38.962483 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fb5ed1d1-e3f9-442a-8776-ebc215848e08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80ee330961d46d785b3dda4743f69b3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:38.970818 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fb5ed1d1-e3f9-442a-8776-ebc215848e08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80ee330961d46d785b3dda4743f69b3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:38.971586 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fb5ed1d1-e3f9-442a-8776-ebc215848e08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80ee330961d46d785b3dda4743f69b3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:38.976739 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1004/1982] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:38 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:38.983105 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243fab0-4469-4c90-9d17-ee2b8c61a784 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:38.983105 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243fab0-4469-4c90-9d17-ee2b8c61a784 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:38.983105 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243fab0-4469-4c90-9d17-ee2b8c61a784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:38.999991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f243fab0-4469-4c90-9d17-ee2b8c61a784 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:39.001438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f243fab0-4469-4c90-9d17-ee2b8c61a784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:39.010944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1005/1983] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:39.010944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243fab0-4469-4c90-9d17-ee2b8c61a784 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:39.015454 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f243fab0-4469-4c90-9d17-ee2b8c61a784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:39.027858 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243fab0-4469-4c90-9d17-ee2b8c61a784 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:39.032533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8eb3e1-cca7-4d90-ab19-a3d2a67f434f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:39.033239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8eb3e1-cca7-4d90-ab19-a3d2a67f434f admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:39.033520 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8eb3e1-cca7-4d90-ab19-a3d2a67f434f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:39.033789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8eb3e1-cca7-4d90-ab19-a3d2a67f434f admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:39.034489 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8eb3e1-cca7-4d90-ab19-a3d2a67f434f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:39.036643 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8eb3e1-cca7-4d90-ab19-a3d2a67f434f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:39.046814 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1006/1984] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:39.047637 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8eb3e1-cca7-4d90-ab19-a3d2a67f434f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:39.049823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1a8eb3e1-cca7-4d90-ab19-a3d2a67f434f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:39.105227 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 979/1985] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:38 2022] DELETE /identity/v3/users/f80ee330961d46d785b3dda4743f69b3 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:39.107356 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ed1d1-e3f9-442a-8776-ebc215848e08 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:39.120659 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8eb3e1-cca7-4d90-ab19-a3d2a67f434f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:39.172457 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0a142-4070-49d5-ab35-dde587f63475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:39.173166 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0a142-4070-49d5-ab35-dde587f63475 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:39.173450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0a142-4070-49d5-ab35-dde587f63475 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:39.173724 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0a142-4070-49d5-ab35-dde587f63475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:39.176567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ed1d1-e3f9-442a-8776-ebc215848e08 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:39.181499 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b860caf-7c98-4a26-a6f3-0d296c8a73cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:39.183657 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b860caf-7c98-4a26-a6f3-0d296c8a73cc admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:39.183657 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b860caf-7c98-4a26-a6f3-0d296c8a73cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:39.183657 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b860caf-7c98-4a26-a6f3-0d296c8a73cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:39.183897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0a142-4070-49d5-ab35-dde587f63475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:39.183977 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b860caf-7c98-4a26-a6f3-0d296c8a73cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:39.184909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0a142-4070-49d5-ab35-dde587f63475 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:39.185009 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b860caf-7c98-4a26-a6f3-0d296c8a73cc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:39.195749 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 980/1986] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:39.197853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab1aa3-4d33-437e-a9bb-82d7101284e9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:39.198350 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab1aa3-4d33-437e-a9bb-82d7101284e9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:39.198825 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab1aa3-4d33-437e-a9bb-82d7101284e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:39.201018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1007/1987] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:39.203553 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0a142-4070-49d5-ab35-dde587f63475 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:39.227613 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0a142-4070-49d5-ab35-dde587f63475 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:39.229938 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0eab1aa3-4d33-437e-a9bb-82d7101284e9 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:39.234439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0eab1aa3-4d33-437e-a9bb-82d7101284e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:39.240095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b01bb7-512e-4a9e-a98b-ea1b91d9c94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:39.241812 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b01bb7-512e-4a9e-a98b-ea1b91d9c94d admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:39.242376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b01bb7-512e-4a9e-a98b-ea1b91d9c94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:39.242759 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b01bb7-512e-4a9e-a98b-ea1b91d9c94d admin admin] PATH_INFO: `/v3/projects/464f1c13916f463e8b980afd747629e9/users/60069a4d38834d26bd71c5cf8344e826/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:39.244549 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 981/1988] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:39.249204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:39.264933 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab1aa3-4d33-437e-a9bb-82d7101284e9 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:39.270301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b01bb7-512e-4a9e-a98b-ea1b91d9c94d admin admin] RBAC: Authorizing `identity:create_grant(project_id=464f1c13916f463e8b980afd747629e9, user_id=60069a4d38834d26bd71c5cf8344e826, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:39.278736 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab1aa3-4d33-437e-a9bb-82d7101284e9 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:39.278892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b01bb7-512e-4a9e-a98b-ea1b91d9c94d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:39.303751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1247452-b942-4009-9278-49f93971b99a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:39.305161 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247452-b942-4009-9278-49f93971b99a service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:39.305571 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247452-b942-4009-9278-49f93971b99a service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:39.305926 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247452-b942-4009-9278-49f93971b99a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:39.328215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1247452-b942-4009-9278-49f93971b99a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:39.328215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1247452-b942-4009-9278-49f93971b99a service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:39.338796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 982/1989] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:06:39.427047 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1008/1990] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:39 2022] PUT /identity/v3/projects/464f1c13916f463e8b980afd747629e9/users/60069a4d38834d26bd71c5cf8344e826/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:39.439658 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a810fe4-3e43-442d-8759-636a8ee317aa None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:39.439955 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a810fe4-3e43-442d-8759-636a8ee317aa None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:39.440232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a810fe4-3e43-442d-8759-636a8ee317aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:39.472073 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2a810fe4-3e43-442d-8759-636a8ee317aa None None] MFA Rules not processed for user `60069a4d38834d26bd71c5cf8344e826`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:39.474246 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2a810fe4-3e43-442d-8759-636a8ee317aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:39.604438 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 983/1991] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:39.608958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b01bb7-512e-4a9e-a98b-ea1b91d9c94d admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:39.727595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b01bb7-512e-4a9e-a98b-ea1b91d9c94d admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:39.755669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5561f38-24dd-486c-9d64-725f94021c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:39.758258 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5561f38-24dd-486c-9d64-725f94021c54 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:39.760011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5561f38-24dd-486c-9d64-725f94021c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:39.760510 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5561f38-24dd-486c-9d64-725f94021c54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:39.764645 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5561f38-24dd-486c-9d64-725f94021c54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:39.767911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5561f38-24dd-486c-9d64-725f94021c54 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:39.921895 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1009/1992] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:39 2022] POST /identity/v3/projects => generated 373 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:39.923149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a810fe4-3e43-442d-8759-636a8ee317aa None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:39.938229 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5561f38-24dd-486c-9d64-725f94021c54 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:39.940902 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a810fe4-3e43-442d-8759-636a8ee317aa None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:39.942425 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c5561f38-24dd-486c-9d64-725f94021c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:40.020826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f2f23-2d24-4800-93e9-cc68cdc45d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:40.021091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5561f38-24dd-486c-9d64-725f94021c54 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:40.021484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f2f23-2d24-4800-93e9-cc68cdc45d1e admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:40.021753 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f2f23-2d24-4800-93e9-cc68cdc45d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:40.022055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f2f23-2d24-4800-93e9-cc68cdc45d1e admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:40.025200 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f2f23-2d24-4800-93e9-cc68cdc45d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:40.027467 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f2f23-2d24-4800-93e9-cc68cdc45d1e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:40.031498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22992d0-2698-49b4-a29e-0f1a7509d7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:40.032590 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22992d0-2698-49b4-a29e-0f1a7509d7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:40.032973 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22992d0-2698-49b4-a29e-0f1a7509d7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:40.033321 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22992d0-2698-49b4-a29e-0f1a7509d7af admin admin] PATH_INFO: `/v3/projects/3d1c01cdc89b461ca2dd3855bd652d6b` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:40.034592 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22992d0-2698-49b4-a29e-0f1a7509d7af admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d1c01cdc89b461ca2dd3855bd652d6b)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:40.037558 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22992d0-2698-49b4-a29e-0f1a7509d7af admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:40.170172 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 984/1993] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:39 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:40.171087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f2f23-2d24-4800-93e9-cc68cdc45d1e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:40.172992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1c9f2f23-2d24-4800-93e9-cc68cdc45d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:40.186218 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f2f23-2d24-4800-93e9-cc68cdc45d1e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:40.191186 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a0ab4-af7d-48ae-8751-77eaeb3f108c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:40.191934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a0ab4-af7d-48ae-8751-77eaeb3f108c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:40.192223 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a0ab4-af7d-48ae-8751-77eaeb3f108c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:40.192502 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a0ab4-af7d-48ae-8751-77eaeb3f108c admin admin] PATH_INFO: `/v3/projects/99d30f72dbb34ccc9adf1798c4f51505` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:40.193734 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a0ab4-af7d-48ae-8751-77eaeb3f108c admin admin] RBAC: Authorizing `identity:delete_project(project_id=99d30f72dbb34ccc9adf1798c4f51505)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:40.195711 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a0ab4-af7d-48ae-8751-77eaeb3f108c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:40.206989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:40.234116 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b22992d0-2698-49b4-a29e-0f1a7509d7af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d1c01cdc89b461ca2dd3855bd652d6b', 'request_id': 'req-b22992d0-2698-49b4-a29e-0f1a7509d7af'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:40.352315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-388a0ab4-af7d-48ae-8751-77eaeb3f108c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99d30f72dbb34ccc9adf1798c4f51505', 'request_id': 'req-388a0ab4-af7d-48ae-8751-77eaeb3f108c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:40.358713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-388a0ab4-af7d-48ae-8751-77eaeb3f108c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99d30f72dbb34ccc9adf1798c4f51505', 'request_id': 'req-388a0ab4-af7d-48ae-8751-77eaeb3f108c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:40.365038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b22992d0-2698-49b4-a29e-0f1a7509d7af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d1c01cdc89b461ca2dd3855bd652d6b', 'request_id': 'req-b22992d0-2698-49b4-a29e-0f1a7509d7af'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:40.367046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-388a0ab4-af7d-48ae-8751-77eaeb3f108c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99d30f72dbb34ccc9adf1798c4f51505', 'request_id': 'req-388a0ab4-af7d-48ae-8751-77eaeb3f108c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:40.387757 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b22992d0-2698-49b4-a29e-0f1a7509d7af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d1c01cdc89b461ca2dd3855bd652d6b', 'request_id': 'req-b22992d0-2698-49b4-a29e-0f1a7509d7af'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:40.406809 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b22992d0-2698-49b4-a29e-0f1a7509d7af admin admin] The token cache is being invalidate because project 3d1c01cdc89b461ca2dd3855bd652d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:40.407368 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b22992d0-2698-49b4-a29e-0f1a7509d7af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:40.408293 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b22992d0-2698-49b4-a29e-0f1a7509d7af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:40.411027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1010/1994] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:39 2022] DELETE /identity/v3/projects/3d1c01cdc89b461ca2dd3855bd652d6b => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:40.412204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22992d0-2698-49b4-a29e-0f1a7509d7af admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:40.413875 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b22992d0-2698-49b4-a29e-0f1a7509d7af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:40.468327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-388a0ab4-af7d-48ae-8751-77eaeb3f108c admin admin] The token cache is being invalidate because project 99d30f72dbb34ccc9adf1798c4f51505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:40.468644 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-388a0ab4-af7d-48ae-8751-77eaeb3f108c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:40.469368 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-388a0ab4-af7d-48ae-8751-77eaeb3f108c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:40.471804 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 985/1995] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:40 2022] DELETE /identity/v3/projects/99d30f72dbb34ccc9adf1798c4f51505 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:40.472165 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a0ab4-af7d-48ae-8751-77eaeb3f108c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:40.474179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-388a0ab4-af7d-48ae-8751-77eaeb3f108c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:40.507809 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22992d0-2698-49b4-a29e-0f1a7509d7af admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:40.580874 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a0ab4-af7d-48ae-8751-77eaeb3f108c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:40.586309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ecf9b-7674-4198-a9fc-b8992e4fdc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:40.586991 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ecf9b-7674-4198-a9fc-b8992e4fdc3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:40.587296 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ecf9b-7674-4198-a9fc-b8992e4fdc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:40.587561 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ecf9b-7674-4198-a9fc-b8992e4fdc3d admin admin] PATH_INFO: `/v3/users/239da6cfeedc4793ade20666f993b1c4` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:40.588852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ecf9b-7674-4198-a9fc-b8992e4fdc3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=239da6cfeedc4793ade20666f993b1c4)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:40.590933 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ecf9b-7674-4198-a9fc-b8992e4fdc3d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:40.597330 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b4380-8e3f-48e5-b8cc-84edc44b0099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:40.598602 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b4380-8e3f-48e5-b8cc-84edc44b0099 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:40.598890 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b4380-8e3f-48e5-b8cc-84edc44b0099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:40.599170 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b4380-8e3f-48e5-b8cc-84edc44b0099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:40.599880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b4380-8e3f-48e5-b8cc-84edc44b0099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:40.601575 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b4380-8e3f-48e5-b8cc-84edc44b0099 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:40.612841 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1011/1996] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:40.614517 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b4380-8e3f-48e5-b8cc-84edc44b0099 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:40.616906 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-382b4380-8e3f-48e5-b8cc-84edc44b0099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:40.630941 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b4380-8e3f-48e5-b8cc-84edc44b0099 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:40.636397 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d34fb7-04a0-43f5-8453-06356a13ff09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:40.637100 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d34fb7-04a0-43f5-8453-06356a13ff09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:40.637388 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d34fb7-04a0-43f5-8453-06356a13ff09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:40.637666 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d34fb7-04a0-43f5-8453-06356a13ff09 admin admin] PATH_INFO: `/v3/users/6d04d64f5fab4385b83c0263bcfb32f8` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:40.638947 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d34fb7-04a0-43f5-8453-06356a13ff09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d04d64f5fab4385b83c0263bcfb32f8)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:40.641064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d34fb7-04a0-43f5-8453-06356a13ff09 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:40.869930 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2d9ecf9b-7674-4198-a9fc-b8992e4fdc3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '239da6cfeedc4793ade20666f993b1c4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:40.870589 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2d9ecf9b-7674-4198-a9fc-b8992e4fdc3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '239da6cfeedc4793ade20666f993b1c4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:40.874218 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-69d34fb7-04a0-43f5-8453-06356a13ff09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d04d64f5fab4385b83c0263bcfb32f8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:40.885023 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2d9ecf9b-7674-4198-a9fc-b8992e4fdc3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '239da6cfeedc4793ade20666f993b1c4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:40.892038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2d9ecf9b-7674-4198-a9fc-b8992e4fdc3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '239da6cfeedc4793ade20666f993b1c4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:40.901274 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2d9ecf9b-7674-4198-a9fc-b8992e4fdc3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '239da6cfeedc4793ade20666f993b1c4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:40.997684 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-69d34fb7-04a0-43f5-8453-06356a13ff09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d04d64f5fab4385b83c0263bcfb32f8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:41.010993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-69d34fb7-04a0-43f5-8453-06356a13ff09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d04d64f5fab4385b83c0263bcfb32f8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:41.017790 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-69d34fb7-04a0-43f5-8453-06356a13ff09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d04d64f5fab4385b83c0263bcfb32f8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:41.018522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-69d34fb7-04a0-43f5-8453-06356a13ff09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d04d64f5fab4385b83c0263bcfb32f8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:41.025165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1012/1997] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:40 2022] DELETE /identity/v3/users/6d04d64f5fab4385b83c0263bcfb32f8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:41.025995 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d34fb7-04a0-43f5-8453-06356a13ff09 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:41.027279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-69d34fb7-04a0-43f5-8453-06356a13ff09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:41.075005 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 986/1998] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:40 2022] DELETE /identity/v3/users/239da6cfeedc4793ade20666f993b1c4 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:41.111413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d34fb7-04a0-43f5-8453-06356a13ff09 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:41.195200 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816edad-1651-4d4a-878b-0e4429925591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:41.195887 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816edad-1651-4d4a-878b-0e4429925591 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:41.196173 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816edad-1651-4d4a-878b-0e4429925591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:41.196453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816edad-1651-4d4a-878b-0e4429925591 admin admin] PATH_INFO: `/v3/projects/472ab877710f4706bad31cd716c93d70/users/fd6a5eccca214376b9e8d8a10dc580cf/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:41.212605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816edad-1651-4d4a-878b-0e4429925591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=472ab877710f4706bad31cd716c93d70, user_id=fd6a5eccca214376b9e8d8a10dc580cf, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:41.215618 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816edad-1651-4d4a-878b-0e4429925591 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:41.325994 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1013/1999] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:41 2022] PUT /identity/v3/projects/472ab877710f4706bad31cd716c93d70/users/fd6a5eccca214376b9e8d8a10dc580cf/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:41.330004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ecf9b-7674-4198-a9fc-b8992e4fdc3d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:41.331503 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2d9ecf9b-7674-4198-a9fc-b8992e4fdc3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:41.353313 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ecf9b-7674-4198-a9fc-b8992e4fdc3d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:41.427035 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc1872-6cc3-4a26-beb7-11b9d8ba39b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:41.427677 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc1872-6cc3-4a26-beb7-11b9d8ba39b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:41.427964 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc1872-6cc3-4a26-beb7-11b9d8ba39b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:41.428288 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc1872-6cc3-4a26-beb7-11b9d8ba39b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:41.429137 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc1872-6cc3-4a26-beb7-11b9d8ba39b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:41.431958 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc1872-6cc3-4a26-beb7-11b9d8ba39b5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:41.446903 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 987/2000] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:41.451457 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816edad-1651-4d4a-878b-0e4429925591 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:41.462763 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816edad-1651-4d4a-878b-0e4429925591 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:41.467768 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa199b40-ed82-478f-a1e3-0b552b0ee028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:41.468480 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa199b40-ed82-478f-a1e3-0b552b0ee028 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:41.468796 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa199b40-ed82-478f-a1e3-0b552b0ee028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:41.469248 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa199b40-ed82-478f-a1e3-0b552b0ee028 admin admin] PATH_INFO: `/v3/projects/472ab877710f4706bad31cd716c93d70/users/fd6a5eccca214376b9e8d8a10dc580cf/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:41.471396 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa199b40-ed82-478f-a1e3-0b552b0ee028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=472ab877710f4706bad31cd716c93d70, user_id=fd6a5eccca214376b9e8d8a10dc580cf, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:41.474301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa199b40-ed82-478f-a1e3-0b552b0ee028 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:41.492803 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1014/2001] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:41 2022] PUT /identity/v3/projects/472ab877710f4706bad31cd716c93d70/users/fd6a5eccca214376b9e8d8a10dc580cf/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:41.499681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0366166-ff5d-4337-90ae-f67c6098c569 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:41.499979 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0366166-ff5d-4337-90ae-f67c6098c569 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:41.500265 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0366166-ff5d-4337-90ae-f67c6098c569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:41.541900 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b0366166-ff5d-4337-90ae-f67c6098c569 None None] MFA Rules not processed for user `fd6a5eccca214376b9e8d8a10dc580cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:41.544011 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b0366166-ff5d-4337-90ae-f67c6098c569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:41.609886 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:41.649678 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 988/2002] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:41.661927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa199b40-ed82-478f-a1e3-0b552b0ee028 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:41.664383 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fa199b40-ed82-478f-a1e3-0b552b0ee028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:41.732628 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa199b40-ed82-478f-a1e3-0b552b0ee028 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:41.736582 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d32e53-ba59-496d-ab06-1944d5fc2390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:41.737270 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d32e53-ba59-496d-ab06-1944d5fc2390 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:41.737579 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d32e53-ba59-496d-ab06-1944d5fc2390 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:41.737834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d32e53-ba59-496d-ab06-1944d5fc2390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:41.740573 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-66d32e53-ba59-496d-ab06-1944d5fc2390 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:41.784134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0366166-ff5d-4337-90ae-f67c6098c569 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:41.787115 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b0366166-ff5d-4337-90ae-f67c6098c569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:41.838913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d32e53-ba59-496d-ab06-1944d5fc2390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:41.840398 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d32e53-ba59-496d-ab06-1944d5fc2390 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:41.850443 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1015/2003] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:41.884620 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0366166-ff5d-4337-90ae-f67c6098c569 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:41.890942 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad996495-5c79-4fae-b7c0-ec49407acc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:41.891984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad996495-5c79-4fae-b7c0-ec49407acc8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:41.892423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad996495-5c79-4fae-b7c0-ec49407acc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:41.892897 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad996495-5c79-4fae-b7c0-ec49407acc8b admin admin] PATH_INFO: `/v3/projects/bca86a735f32482598659ddb79b3a675` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:41.894365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad996495-5c79-4fae-b7c0-ec49407acc8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bca86a735f32482598659ddb79b3a675)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:41.896919 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad996495-5c79-4fae-b7c0-ec49407acc8b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:42.006691 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d32e53-ba59-496d-ab06-1944d5fc2390 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:42.008792 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-66d32e53-ba59-496d-ab06-1944d5fc2390 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:42.023954 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d32e53-ba59-496d-ab06-1944d5fc2390 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:42.036341 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ad996495-5c79-4fae-b7c0-ec49407acc8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bca86a735f32482598659ddb79b3a675', 'request_id': 'req-ad996495-5c79-4fae-b7c0-ec49407acc8b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:42.046155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ad996495-5c79-4fae-b7c0-ec49407acc8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bca86a735f32482598659ddb79b3a675', 'request_id': 'req-ad996495-5c79-4fae-b7c0-ec49407acc8b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:42.057117 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ad996495-5c79-4fae-b7c0-ec49407acc8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bca86a735f32482598659ddb79b3a675', 'request_id': 'req-ad996495-5c79-4fae-b7c0-ec49407acc8b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:42.099174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59414a-caa5-4307-8369-09a7b95155a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:42.099843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59414a-caa5-4307-8369-09a7b95155a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:42.100130 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59414a-caa5-4307-8369-09a7b95155a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:42.100474 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59414a-caa5-4307-8369-09a7b95155a9 admin admin] PATH_INFO: `/v3/projects/3f658b281adf4ebcb520725dde39c665` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:42.101807 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59414a-caa5-4307-8369-09a7b95155a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f658b281adf4ebcb520725dde39c665)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:42.103760 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59414a-caa5-4307-8369-09a7b95155a9 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:42.184139 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ad996495-5c79-4fae-b7c0-ec49407acc8b admin admin] The token cache is being invalidate because project bca86a735f32482598659ddb79b3a675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:42.184478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ad996495-5c79-4fae-b7c0-ec49407acc8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:42.185100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ad996495-5c79-4fae-b7c0-ec49407acc8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:42.187043 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 989/2004] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:41 2022] DELETE /identity/v3/projects/bca86a735f32482598659ddb79b3a675 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:42.193143 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d556d-a5ed-456f-a4fa-c8f73bbf0673 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:42.193500 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d556d-a5ed-456f-a4fa-c8f73bbf0673 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:42.193839 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d556d-a5ed-456f-a4fa-c8f73bbf0673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:42.213994 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-457d556d-a5ed-456f-a4fa-c8f73bbf0673 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:42.215255 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-457d556d-a5ed-456f-a4fa-c8f73bbf0673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:42.223826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 990/2005] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:42.233726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331862d7-26d6-4442-8333-039f5eaf0e06 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:42.234069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331862d7-26d6-4442-8333-039f5eaf0e06 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:42.234348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331862d7-26d6-4442-8333-039f5eaf0e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:42.256133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-331862d7-26d6-4442-8333-039f5eaf0e06 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:42.257537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-331862d7-26d6-4442-8333-039f5eaf0e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:42.265878 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0e59414a-caa5-4307-8369-09a7b95155a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f658b281adf4ebcb520725dde39c665', 'request_id': 'req-0e59414a-caa5-4307-8369-09a7b95155a9'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:42.324019 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 991/2006] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:42.328770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331862d7-26d6-4442-8333-039f5eaf0e06 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:42.338100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331862d7-26d6-4442-8333-039f5eaf0e06 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:42.342972 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d63e0a-a478-4d26-84fc-79c2c2e18c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:42.343601 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d63e0a-a478-4d26-84fc-79c2c2e18c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:42.343884 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d63e0a-a478-4d26-84fc-79c2c2e18c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:42.344157 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d63e0a-a478-4d26-84fc-79c2c2e18c51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:42.344891 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d63e0a-a478-4d26-84fc-79c2c2e18c51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:06:42.345203 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d63e0a-a478-4d26-84fc-79c2c2e18c51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:42.346875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d63e0a-a478-4d26-84fc-79c2c2e18c51 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:42.351306 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0e59414a-caa5-4307-8369-09a7b95155a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f658b281adf4ebcb520725dde39c665', 'request_id': 'req-0e59414a-caa5-4307-8369-09a7b95155a9'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:42.358789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0e59414a-caa5-4307-8369-09a7b95155a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f658b281adf4ebcb520725dde39c665', 'request_id': 'req-0e59414a-caa5-4307-8369-09a7b95155a9'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:42.374344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 992/2007] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:06:42.378685 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d63e0a-a478-4d26-84fc-79c2c2e18c51 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:42.381532 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0e59414a-caa5-4307-8369-09a7b95155a9 admin admin] The token cache is being invalidate because project 3f658b281adf4ebcb520725dde39c665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:42.383993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0e59414a-caa5-4307-8369-09a7b95155a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:42.385237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0e59414a-caa5-4307-8369-09a7b95155a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:42.390743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1016/2008] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:42 2022] DELETE /identity/v3/projects/3f658b281adf4ebcb520725dde39c665 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:42.397308 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d63e0a-a478-4d26-84fc-79c2c2e18c51 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:42.401521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad9600-6161-411d-b938-547486b12e92 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:42.401894 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad9600-6161-411d-b938-547486b12e92 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:42.402409 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad9600-6161-411d-b938-547486b12e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:42.415882 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970866ea-a7b4-4123-b7e9-e31dbf8ce679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:42.424002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970866ea-a7b4-4123-b7e9-e31dbf8ce679 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:42.424002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970866ea-a7b4-4123-b7e9-e31dbf8ce679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:42.424002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970866ea-a7b4-4123-b7e9-e31dbf8ce679 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:42.424002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970866ea-a7b4-4123-b7e9-e31dbf8ce679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:42.424002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970866ea-a7b4-4123-b7e9-e31dbf8ce679 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:42.453987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c5ad9600-6161-411d-b938-547486b12e92 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:42.455343 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c5ad9600-6161-411d-b938-547486b12e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:42.468923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1017/2009] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:42.473347 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017d136-1560-404a-afd2-68edeef0d25c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:42.473853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017d136-1560-404a-afd2-68edeef0d25c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:42.474308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017d136-1560-404a-afd2-68edeef0d25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:42.495212 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f017d136-1560-404a-afd2-68edeef0d25c None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:42.497286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f017d136-1560-404a-afd2-68edeef0d25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:42.509188 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1018/2010] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:42.512064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017d136-1560-404a-afd2-68edeef0d25c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:42.522683 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017d136-1560-404a-afd2-68edeef0d25c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:42.535507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cf54f-1c16-4895-bbba-c52f7f44123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:42.552238 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cf54f-1c16-4895-bbba-c52f7f44123a admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:42.556746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cf54f-1c16-4895-bbba-c52f7f44123a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:42.556993 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 993/2011] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:42 2022] POST /identity/v3/projects => generated 381 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:42.557110 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cf54f-1c16-4895-bbba-c52f7f44123a admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:42.557814 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9cf54f-1c16-4895-bbba-c52f7f44123a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:06:42.558617 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970866ea-a7b4-4123-b7e9-e31dbf8ce679 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:42.561093 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-970866ea-a7b4-4123-b7e9-e31dbf8ce679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:42.572833 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9cf54f-1c16-4895-bbba-c52f7f44123a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:42.572833 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9cf54f-1c16-4895-bbba-c52f7f44123a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:42.590253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1019/2012] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:06:42.595176 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cf54f-1c16-4895-bbba-c52f7f44123a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:42.621355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cf54f-1c16-4895-bbba-c52f7f44123a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:42.715449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970866ea-a7b4-4123-b7e9-e31dbf8ce679 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:42.735464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:42.742042 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b11218-c6d9-4244-89e7-2a035c50f070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:42.742803 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b11218-c6d9-4244-89e7-2a035c50f070 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:42.743631 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12960f45-264a-41cf-97ea-137e71811c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:42.743757 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b11218-c6d9-4244-89e7-2a035c50f070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:42.743757 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b11218-c6d9-4244-89e7-2a035c50f070 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:42.744155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b11218-c6d9-4244-89e7-2a035c50f070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:42.746314 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b11218-c6d9-4244-89e7-2a035c50f070 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:42.747628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12960f45-264a-41cf-97ea-137e71811c9f admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:42.747936 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12960f45-264a-41cf-97ea-137e71811c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:42.748220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12960f45-264a-41cf-97ea-137e71811c9f admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:42.748958 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12960f45-264a-41cf-97ea-137e71811c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:42.752735 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12960f45-264a-41cf-97ea-137e71811c9f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:42.855451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 994/2013] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:42 2022] POST /identity/v3/users => generated 291 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:42.859656 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12960f45-264a-41cf-97ea-137e71811c9f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:42.870381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12960f45-264a-41cf-97ea-137e71811c9f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:42.875124 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abaf632-d89c-4b9b-b480-fe9c162d1784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:42.875750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaf632-d89c-4b9b-b480-fe9c162d1784 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:42.876034 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaf632-d89c-4b9b-b480-fe9c162d1784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:42.876355 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaf632-d89c-4b9b-b480-fe9c162d1784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:42.877045 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abaf632-d89c-4b9b-b480-fe9c162d1784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:42.878648 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abaf632-d89c-4b9b-b480-fe9c162d1784 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:42.890784 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 995/2014] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:06:42.895748 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abaf632-d89c-4b9b-b480-fe9c162d1784 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:42.908285 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abaf632-d89c-4b9b-b480-fe9c162d1784 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:42.912027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1020/2015] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:42 2022] POST /identity/v3/projects => generated 387 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:42.913401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b11218-c6d9-4244-89e7-2a035c50f070 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:43.000138 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983fd08-f955-4f7b-9a97-07f907fe3308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:43.000926 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983fd08-f955-4f7b-9a97-07f907fe3308 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:43.001176 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983fd08-f955-4f7b-9a97-07f907fe3308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:43.001429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983fd08-f955-4f7b-9a97-07f907fe3308 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:43.002254 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983fd08-f955-4f7b-9a97-07f907fe3308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:43.003848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983fd08-f955-4f7b-9a97-07f907fe3308 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:43.016032 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 996/2016] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:43.020558 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983fd08-f955-4f7b-9a97-07f907fe3308 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:43.024178 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b11218-c6d9-4244-89e7-2a035c50f070 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:43.029462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b4e47-a223-4eaf-8991-17f73059d6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:43.030096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b4e47-a223-4eaf-8991-17f73059d6ee admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:43.030383 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b4e47-a223-4eaf-8991-17f73059d6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:43.030663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b4e47-a223-4eaf-8991-17f73059d6ee admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:43.031708 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b4e47-a223-4eaf-8991-17f73059d6ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:43.032595 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983fd08-f955-4f7b-9a97-07f907fe3308 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:43.033361 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b4e47-a223-4eaf-8991-17f73059d6ee admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:43.038798 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170c1cb-7521-4d66-86be-9103061ac592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:43.039582 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170c1cb-7521-4d66-86be-9103061ac592 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:43.040442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170c1cb-7521-4d66-86be-9103061ac592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:43.040442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170c1cb-7521-4d66-86be-9103061ac592 admin admin] PATH_INFO: `/v3/projects/79ffdf409591498c836364074043c49c/users/5874e910ad8c4ea8a709ba51b38dcf88/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:43.057082 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170c1cb-7521-4d66-86be-9103061ac592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ffdf409591498c836364074043c49c, user_id=5874e910ad8c4ea8a709ba51b38dcf88, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:43.059389 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170c1cb-7521-4d66-86be-9103061ac592 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:43.147715 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1021/2017] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:42 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:43.152012 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b4e47-a223-4eaf-8991-17f73059d6ee admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:43.164121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b4e47-a223-4eaf-8991-17f73059d6ee admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:43.168925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40967687-3215-44ba-9182-fc1315b1d377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:43.169584 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40967687-3215-44ba-9182-fc1315b1d377 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:43.169865 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40967687-3215-44ba-9182-fc1315b1d377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:43.170141 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40967687-3215-44ba-9182-fc1315b1d377 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:43.170858 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40967687-3215-44ba-9182-fc1315b1d377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:43.172480 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40967687-3215-44ba-9182-fc1315b1d377 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:43.183546 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1022/2018] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:06:43.187771 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40967687-3215-44ba-9182-fc1315b1d377 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:43.194053 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 997/2019] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:43 2022] PUT /identity/v3/projects/79ffdf409591498c836364074043c49c/users/5874e910ad8c4ea8a709ba51b38dcf88/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:43.197877 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40967687-3215-44ba-9182-fc1315b1d377 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:43.205440 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6b3d3-2d66-4f03-80ef-4f84d9eb2277 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:43.206175 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6b3d3-2d66-4f03-80ef-4f84d9eb2277 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:43.206631 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6b3d3-2d66-4f03-80ef-4f84d9eb2277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:43.241253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7dd6b3d3-2d66-4f03-80ef-4f84d9eb2277 None None] MFA Rules not processed for user `5874e910ad8c4ea8a709ba51b38dcf88`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:43.242862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7dd6b3d3-2d66-4f03-80ef-4f84d9eb2277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:43.270874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e63ae2-a0ad-4e22-bcdc-969e340a6777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:43.271514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e63ae2-a0ad-4e22-bcdc-969e340a6777 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:43.271800 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e63ae2-a0ad-4e22-bcdc-969e340a6777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:43.272079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e63ae2-a0ad-4e22-bcdc-969e340a6777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:43.272805 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e63ae2-a0ad-4e22-bcdc-969e340a6777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:43.274456 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e63ae2-a0ad-4e22-bcdc-969e340a6777 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:43.290182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1023/2020] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:06:43.290972 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e63ae2-a0ad-4e22-bcdc-969e340a6777 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:43.303088 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e63ae2-a0ad-4e22-bcdc-969e340a6777 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:43.310122 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b3f65-5c38-4226-a27b-88b601e9dda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:43.310502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b3f65-5c38-4226-a27b-88b601e9dda4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:43.310790 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b3f65-5c38-4226-a27b-88b601e9dda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:43.311199 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b3f65-5c38-4226-a27b-88b601e9dda4 admin admin] PATH_INFO: `/v3/projects/ad1c985074144005b54f8b6ae7e367a4/users/dcb59e3091614e109eaa81aa2341fa4a/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:43.329750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b3f65-5c38-4226-a27b-88b601e9dda4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1c985074144005b54f8b6ae7e367a4, user_id=dcb59e3091614e109eaa81aa2341fa4a, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:43.333737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b3f65-5c38-4226-a27b-88b601e9dda4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:43.345588 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 998/2021] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:43.350374 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6b3d3-2d66-4f03-80ef-4f84d9eb2277 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:43.361974 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6b3d3-2d66-4f03-80ef-4f84d9eb2277 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:43.367870 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328a614-9ef6-46f2-a5ee-b36c81e71070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:43.368502 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328a614-9ef6-46f2-a5ee-b36c81e71070 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:43.369993 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328a614-9ef6-46f2-a5ee-b36c81e71070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:43.369993 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328a614-9ef6-46f2-a5ee-b36c81e71070 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:43.369993 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328a614-9ef6-46f2-a5ee-b36c81e71070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:43.371893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328a614-9ef6-46f2-a5ee-b36c81e71070 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:43.468813 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1024/2022] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:43 2022] PUT /identity/v3/projects/ad1c985074144005b54f8b6ae7e367a4/users/dcb59e3091614e109eaa81aa2341fa4a/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:43.480909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb85cb3-c08e-4685-a56f-8d4f24d72edf None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:43.481195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb85cb3-c08e-4685-a56f-8d4f24d72edf None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:43.481485 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb85cb3-c08e-4685-a56f-8d4f24d72edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:43.507749 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 999/2023] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:43 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:43.508661 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328a614-9ef6-46f2-a5ee-b36c81e71070 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:43.527062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-bdb85cb3-c08e-4685-a56f-8d4f24d72edf None None] MFA Rules not processed for user `dcb59e3091614e109eaa81aa2341fa4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:43.528430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bdb85cb3-c08e-4685-a56f-8d4f24d72edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:43.576651 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328a614-9ef6-46f2-a5ee-b36c81e71070 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:43.581952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095021f-8581-466f-8b3c-ec61e71ecd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:43.582876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095021f-8581-466f-8b3c-ec61e71ecd02 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:43.583279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095021f-8581-466f-8b3c-ec61e71ecd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:43.583651 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095021f-8581-466f-8b3c-ec61e71ecd02 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:43.584434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095021f-8581-466f-8b3c-ec61e71ecd02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:43.586579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095021f-8581-466f-8b3c-ec61e71ecd02 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:43.598691 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1025/2024] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:43.604496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb85cb3-c08e-4685-a56f-8d4f24d72edf None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:43.614785 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:43.619333 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb85cb3-c08e-4685-a56f-8d4f24d72edf None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:43.624029 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69164bac-c81a-4bdb-b0d5-22a84d58b5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:43.624672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69164bac-c81a-4bdb-b0d5-22a84d58b5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:43.624979 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69164bac-c81a-4bdb-b0d5-22a84d58b5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:43.625253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69164bac-c81a-4bdb-b0d5-22a84d58b5a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:43.625917 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69164bac-c81a-4bdb-b0d5-22a84d58b5a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:43.627825 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69164bac-c81a-4bdb-b0d5-22a84d58b5a1 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:43.682248 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1000/2025] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:43 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:43.685469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095021f-8581-466f-8b3c-ec61e71ecd02 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:43.695931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095021f-8581-466f-8b3c-ec61e71ecd02 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:43.700572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d919173-438f-4685-8cc1-e0b9435dcb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:43.701231 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d919173-438f-4685-8cc1-e0b9435dcb2d admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:43.701517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d919173-438f-4685-8cc1-e0b9435dcb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:43.701796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d919173-438f-4685-8cc1-e0b9435dcb2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:43.702513 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d919173-438f-4685-8cc1-e0b9435dcb2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:43.704245 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d919173-438f-4685-8cc1-e0b9435dcb2d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:43.718096 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1001/2026] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:43.721888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1026/2027] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:43 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:43.722596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d919173-438f-4685-8cc1-e0b9435dcb2d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:43.725321 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69164bac-c81a-4bdb-b0d5-22a84d58b5a1 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:43.733286 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d919173-438f-4685-8cc1-e0b9435dcb2d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:43.805534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dba8fe-280f-456e-9849-93f5335378fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:43.806221 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dba8fe-280f-456e-9849-93f5335378fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:43.809559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dba8fe-280f-456e-9849-93f5335378fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:43.809559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dba8fe-280f-456e-9849-93f5335378fe admin admin] PATH_INFO: `/v3/projects/216394ee69674e28a8e723a14043e550/users/26de5e8db90f4e9f9bf8c21a1ab0f96b/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:43.810943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69164bac-c81a-4bdb-b0d5-22a84d58b5a1 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:43.816148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c92d4-72fb-4162-8412-f6830b03029e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:43.816949 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c92d4-72fb-4162-8412-f6830b03029e admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:43.817347 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c92d4-72fb-4162-8412-f6830b03029e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:43.817687 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c92d4-72fb-4162-8412-f6830b03029e admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:43.818378 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c92d4-72fb-4162-8412-f6830b03029e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:43.820452 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c92d4-72fb-4162-8412-f6830b03029e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:43.823345 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dba8fe-280f-456e-9849-93f5335378fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=216394ee69674e28a8e723a14043e550, user_id=26de5e8db90f4e9f9bf8c21a1ab0f96b, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:43.826299 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dba8fe-280f-456e-9849-93f5335378fe admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:43.924008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1002/2028] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:43 2022] PUT /identity/v3/projects/216394ee69674e28a8e723a14043e550/users/26de5e8db90f4e9f9bf8c21a1ab0f96b/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:43.929122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dba8fe-280f-456e-9849-93f5335378fe admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:43.964260 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1027/2029] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:43 2022] POST /identity/v3/users => generated 300 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:43.967854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c92d4-72fb-4162-8412-f6830b03029e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:43.980160 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c92d4-72fb-4162-8412-f6830b03029e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:44.001150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dba8fe-280f-456e-9849-93f5335378fe admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:44.019661 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304590b-f9df-457f-974b-140d414e4c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:44.020318 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304590b-f9df-457f-974b-140d414e4c34 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:44.020601 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304590b-f9df-457f-974b-140d414e4c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:44.021507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304590b-f9df-457f-974b-140d414e4c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:44.022384 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304590b-f9df-457f-974b-140d414e4c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:44.024251 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304590b-f9df-457f-974b-140d414e4c34 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:44.038480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1003/2030] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:06:44.042398 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304590b-f9df-457f-974b-140d414e4c34 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:44.046093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e24d3-7eee-409b-a279-b31dad3796f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:44.046772 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e24d3-7eee-409b-a279-b31dad3796f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:44.047269 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e24d3-7eee-409b-a279-b31dad3796f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:44.047557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e24d3-7eee-409b-a279-b31dad3796f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:44.048317 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e24d3-7eee-409b-a279-b31dad3796f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:44.049999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e24d3-7eee-409b-a279-b31dad3796f7 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:44.055287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304590b-f9df-457f-974b-140d414e4c34 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:44.061848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722f962-05dd-48c6-8d97-ecc61015f50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:44.062633 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722f962-05dd-48c6-8d97-ecc61015f50d admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:44.062992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722f962-05dd-48c6-8d97-ecc61015f50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:44.063340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722f962-05dd-48c6-8d97-ecc61015f50d admin admin] PATH_INFO: `/v3/projects/216394ee69674e28a8e723a14043e550/users/26de5e8db90f4e9f9bf8c21a1ab0f96b/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:44.065104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1028/2031] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:44.066217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722f962-05dd-48c6-8d97-ecc61015f50d admin admin] RBAC: Authorizing `identity:create_grant(project_id=216394ee69674e28a8e723a14043e550, user_id=26de5e8db90f4e9f9bf8c21a1ab0f96b, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:44.069117 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e24d3-7eee-409b-a279-b31dad3796f7 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:44.069767 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722f962-05dd-48c6-8d97-ecc61015f50d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:44.080375 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e24d3-7eee-409b-a279-b31dad3796f7 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:44.084440 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1004/2032] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:44 2022] PUT /identity/v3/projects/216394ee69674e28a8e723a14043e550/users/26de5e8db90f4e9f9bf8c21a1ab0f96b/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:44.094549 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245eb48-f677-4eb9-91c2-4c09808bbf8b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:44.094892 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245eb48-f677-4eb9-91c2-4c09808bbf8b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:44.095249 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245eb48-f677-4eb9-91c2-4c09808bbf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:44.130404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2245eb48-f677-4eb9-91c2-4c09808bbf8b None None] MFA Rules not processed for user `26de5e8db90f4e9f9bf8c21a1ab0f96b`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:44.131969 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2245eb48-f677-4eb9-91c2-4c09808bbf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:44.147876 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d522fa-4c47-43f2-87ad-862af52dd833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:44.148561 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d522fa-4c47-43f2-87ad-862af52dd833 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:44.148937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d522fa-4c47-43f2-87ad-862af52dd833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:44.149203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d522fa-4c47-43f2-87ad-862af52dd833 admin admin] PATH_INFO: `/v3/projects/c40f5d982a654e9baae2e57d233703d6/users/7a882e4e10424fcea7112203b09917f5/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:44.166252 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d522fa-4c47-43f2-87ad-862af52dd833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40f5d982a654e9baae2e57d233703d6, user_id=7a882e4e10424fcea7112203b09917f5, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:44.169277 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d522fa-4c47-43f2-87ad-862af52dd833 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:44.212282 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1005/2033] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:44.223962 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245eb48-f677-4eb9-91c2-4c09808bbf8b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:44.225348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2245eb48-f677-4eb9-91c2-4c09808bbf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:44.281166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245eb48-f677-4eb9-91c2-4c09808bbf8b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:44.284796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228c03e-c38c-4481-82af-17253c3d7e97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:44.286086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228c03e-c38c-4481-82af-17253c3d7e97 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:44.286366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228c03e-c38c-4481-82af-17253c3d7e97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:44.286638 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228c03e-c38c-4481-82af-17253c3d7e97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:44.295547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228c03e-c38c-4481-82af-17253c3d7e97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:44.297010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228c03e-c38c-4481-82af-17253c3d7e97 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:44.306629 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1006/2034] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:06:44.314376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1029/2035] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:44 2022] PUT /identity/v3/projects/c40f5d982a654e9baae2e57d233703d6/users/7a882e4e10424fcea7112203b09917f5/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:44.317872 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228c03e-c38c-4481-82af-17253c3d7e97 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:44.328137 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228c03e-c38c-4481-82af-17253c3d7e97 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:44.386316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b51dc-3d55-45e3-92fb-7b5f863847c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:44.386875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b51dc-3d55-45e3-92fb-7b5f863847c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:44.387160 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b51dc-3d55-45e3-92fb-7b5f863847c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:44.387441 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b51dc-3d55-45e3-92fb-7b5f863847c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:44.388171 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b51dc-3d55-45e3-92fb-7b5f863847c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:44.389848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b51dc-3d55-45e3-92fb-7b5f863847c7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:44.400533 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1007/2036] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:06:44.404864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d522fa-4c47-43f2-87ad-862af52dd833 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:44.415830 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d522fa-4c47-43f2-87ad-862af52dd833 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:44.420963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee1117-1288-4e18-8634-69d12d8e973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:44.421629 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee1117-1288-4e18-8634-69d12d8e973e admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:44.421911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee1117-1288-4e18-8634-69d12d8e973e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:44.423444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee1117-1288-4e18-8634-69d12d8e973e admin admin] PATH_INFO: `/v3/projects/c40f5d982a654e9baae2e57d233703d6/users/7a882e4e10424fcea7112203b09917f5/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:44.424320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee1117-1288-4e18-8634-69d12d8e973e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40f5d982a654e9baae2e57d233703d6, user_id=7a882e4e10424fcea7112203b09917f5, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:44.428005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee1117-1288-4e18-8634-69d12d8e973e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:44.442467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1030/2037] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:44 2022] PUT /identity/v3/projects/c40f5d982a654e9baae2e57d233703d6/users/7a882e4e10424fcea7112203b09917f5/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:44.452841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67fb90-6e4c-4cf4-b04b-3ce6b375e305 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:44.452841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67fb90-6e4c-4cf4-b04b-3ce6b375e305 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:44.453151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67fb90-6e4c-4cf4-b04b-3ce6b375e305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:44.482312 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ce67fb90-6e4c-4cf4-b04b-3ce6b375e305 None None] MFA Rules not processed for user `7a882e4e10424fcea7112203b09917f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:44.483545 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ce67fb90-6e4c-4cf4-b04b-3ce6b375e305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:44.554106 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1008/2038] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:44.565683 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee1117-1288-4e18-8634-69d12d8e973e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:44.626350 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee1117-1288-4e18-8634-69d12d8e973e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:44.630710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329f829-30be-4ee2-bb14-8caccad0d277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:44.631339 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329f829-30be-4ee2-bb14-8caccad0d277 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:44.631619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329f829-30be-4ee2-bb14-8caccad0d277 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:44.632623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329f829-30be-4ee2-bb14-8caccad0d277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:44.643430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329f829-30be-4ee2-bb14-8caccad0d277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:44.652815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329f829-30be-4ee2-bb14-8caccad0d277 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:44.656545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1031/2039] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:44.666650 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:44.686493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67fb90-6e4c-4cf4-b04b-3ce6b375e305 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:44.756698 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67fb90-6e4c-4cf4-b04b-3ce6b375e305 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:44.761487 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba111cf0-74a5-48b0-96a2-d37d5fb8b1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:44.762174 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba111cf0-74a5-48b0-96a2-d37d5fb8b1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:44.762457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba111cf0-74a5-48b0-96a2-d37d5fb8b1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:44.762732 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba111cf0-74a5-48b0-96a2-d37d5fb8b1fe admin admin] PATH_INFO: `/v3/users/dcb59e3091614e109eaa81aa2341fa4a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:44.764091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba111cf0-74a5-48b0-96a2-d37d5fb8b1fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb59e3091614e109eaa81aa2341fa4a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:44.766209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba111cf0-74a5-48b0-96a2-d37d5fb8b1fe admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:44.905340 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329f829-30be-4ee2-bb14-8caccad0d277 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:44.918129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329f829-30be-4ee2-bb14-8caccad0d277 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:44.923526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4aa36c-8e9f-4adb-be1c-5adb4081d46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:44.924019 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aa36c-8e9f-4adb-be1c-5adb4081d46e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:44.924307 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aa36c-8e9f-4adb-be1c-5adb4081d46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:44.924585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aa36c-8e9f-4adb-be1c-5adb4081d46e admin admin] PATH_INFO: `/v3/users/5874e910ad8c4ea8a709ba51b38dcf88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:44.926340 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4aa36c-8e9f-4adb-be1c-5adb4081d46e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5874e910ad8c4ea8a709ba51b38dcf88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:44.928282 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4aa36c-8e9f-4adb-be1c-5adb4081d46e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:44.932913 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ba111cf0-74a5-48b0-96a2-d37d5fb8b1fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb59e3091614e109eaa81aa2341fa4a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:44.933667 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ba111cf0-74a5-48b0-96a2-d37d5fb8b1fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb59e3091614e109eaa81aa2341fa4a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:44.948309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ba111cf0-74a5-48b0-96a2-d37d5fb8b1fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb59e3091614e109eaa81aa2341fa4a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:44.956155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ba111cf0-74a5-48b0-96a2-d37d5fb8b1fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb59e3091614e109eaa81aa2341fa4a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:44.956950 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ba111cf0-74a5-48b0-96a2-d37d5fb8b1fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb59e3091614e109eaa81aa2341fa4a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:45.054682 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1009/2040] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:44 2022] DELETE /identity/v3/users/dcb59e3091614e109eaa81aa2341fa4a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:45.059474 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8da386-9ca7-42c9-8b86-31828665ad80 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:45.059768 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8da386-9ca7-42c9-8b86-31828665ad80 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:45.060048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8da386-9ca7-42c9-8b86-31828665ad80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:45.080553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1f8da386-9ca7-42c9-8b86-31828665ad80 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:45.081797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1f8da386-9ca7-42c9-8b86-31828665ad80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:45.139354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1010/2041] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:45.149264 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8da386-9ca7-42c9-8b86-31828665ad80 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:45.150721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1f8da386-9ca7-42c9-8b86-31828665ad80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:45.170935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-cb4aa36c-8e9f-4adb-be1c-5adb4081d46e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5874e910ad8c4ea8a709ba51b38dcf88'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:45.213438 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8da386-9ca7-42c9-8b86-31828665ad80 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:45.217132 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f2aa0-dfdc-4e5d-b9b6-5850e8422f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:45.217764 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f2aa0-dfdc-4e5d-b9b6-5850e8422f81 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:45.218048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f2aa0-dfdc-4e5d-b9b6-5850e8422f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:45.218323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f2aa0-dfdc-4e5d-b9b6-5850e8422f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:45.228613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f2aa0-dfdc-4e5d-b9b6-5850e8422f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:45.230123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f2aa0-dfdc-4e5d-b9b6-5850e8422f81 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:45.240834 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1011/2042] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:06:45.255741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-cb4aa36c-8e9f-4adb-be1c-5adb4081d46e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5874e910ad8c4ea8a709ba51b38dcf88'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:45.272730 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-cb4aa36c-8e9f-4adb-be1c-5adb4081d46e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5874e910ad8c4ea8a709ba51b38dcf88'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:45.280701 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-cb4aa36c-8e9f-4adb-be1c-5adb4081d46e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5874e910ad8c4ea8a709ba51b38dcf88'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:45.281462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-cb4aa36c-8e9f-4adb-be1c-5adb4081d46e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5874e910ad8c4ea8a709ba51b38dcf88'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:45.291400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1032/2043] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:44 2022] DELETE /identity/v3/users/5874e910ad8c4ea8a709ba51b38dcf88 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:45.296028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fc364-505f-462f-bb68-d834144d6cdf None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:45.296321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fc364-505f-462f-bb68-d834144d6cdf None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:45.296602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fc364-505f-462f-bb68-d834144d6cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:45.326047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-245fc364-505f-462f-bb68-d834144d6cdf None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:45.327726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-245fc364-505f-462f-bb68-d834144d6cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:45.404365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1012/2044] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:45.414927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4aa36c-8e9f-4adb-be1c-5adb4081d46e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:45.416546 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-cb4aa36c-8e9f-4adb-be1c-5adb4081d46e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:45.429529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:45.480042 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4aa36c-8e9f-4adb-be1c-5adb4081d46e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:45.483706 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ae9bb-80da-499c-990e-359ad75089a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:45.484340 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ae9bb-80da-499c-990e-359ad75089a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:45.484620 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ae9bb-80da-499c-990e-359ad75089a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:45.484935 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ae9bb-80da-499c-990e-359ad75089a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:45.495041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ae9bb-80da-499c-990e-359ad75089a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:45.496577 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ae9bb-80da-499c-990e-359ad75089a2 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:45.506573 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1033/2045] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:45.862972 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fc364-505f-462f-bb68-d834144d6cdf None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:45.864674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-245fc364-505f-462f-bb68-d834144d6cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:45.879344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fc364-505f-462f-bb68-d834144d6cdf None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:45.885405 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b5744-5fb4-41e8-8e44-5c4048c6c899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:45.886212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b5744-5fb4-41e8-8e44-5c4048c6c899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:45.886499 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b5744-5fb4-41e8-8e44-5c4048c6c899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:45.888384 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b5744-5fb4-41e8-8e44-5c4048c6c899 admin admin] PATH_INFO: `/v3/projects/ad1c985074144005b54f8b6ae7e367a4` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:45.888645 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b5744-5fb4-41e8-8e44-5c4048c6c899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad1c985074144005b54f8b6ae7e367a4)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:45.890820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b5744-5fb4-41e8-8e44-5c4048c6c899 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:46.005823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ae9bb-80da-499c-990e-359ad75089a2 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:46.007270 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d40ae9bb-80da-499c-990e-359ad75089a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:46.022375 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ae9bb-80da-499c-990e-359ad75089a2 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:46.027837 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c31af8-c141-41a0-bd42-33ff568d5dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:46.028386 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c31af8-c141-41a0-bd42-33ff568d5dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:46.028668 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c31af8-c141-41a0-bd42-33ff568d5dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:46.028996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c31af8-c141-41a0-bd42-33ff568d5dcd admin admin] PATH_INFO: `/v3/projects/79ffdf409591498c836364074043c49c` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:46.030177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c31af8-c141-41a0-bd42-33ff568d5dcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=79ffdf409591498c836364074043c49c)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:46.032235 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c31af8-c141-41a0-bd42-33ff568d5dcd admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:46.065933 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e28b5744-5fb4-41e8-8e44-5c4048c6c899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad1c985074144005b54f8b6ae7e367a4', 'request_id': 'req-e28b5744-5fb4-41e8-8e44-5c4048c6c899'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:46.073751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e28b5744-5fb4-41e8-8e44-5c4048c6c899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad1c985074144005b54f8b6ae7e367a4', 'request_id': 'req-e28b5744-5fb4-41e8-8e44-5c4048c6c899'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:46.080148 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e28b5744-5fb4-41e8-8e44-5c4048c6c899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad1c985074144005b54f8b6ae7e367a4', 'request_id': 'req-e28b5744-5fb4-41e8-8e44-5c4048c6c899'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:46.196988 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e28b5744-5fb4-41e8-8e44-5c4048c6c899 admin admin] The token cache is being invalidate because project ad1c985074144005b54f8b6ae7e367a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:46.197286 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e28b5744-5fb4-41e8-8e44-5c4048c6c899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:46.197942 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e28b5744-5fb4-41e8-8e44-5c4048c6c899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:46.199585 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1013/2046] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:45 2022] DELETE /identity/v3/projects/ad1c985074144005b54f8b6ae7e367a4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:46.203746 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b5744-5fb4-41e8-8e44-5c4048c6c899 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:46.205299 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e28b5744-5fb4-41e8-8e44-5c4048c6c899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:46.213407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-54c31af8-c141-41a0-bd42-33ff568d5dcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79ffdf409591498c836364074043c49c', 'request_id': 'req-54c31af8-c141-41a0-bd42-33ff568d5dcd'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:46.273124 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b5744-5fb4-41e8-8e44-5c4048c6c899 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:46.300514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-54c31af8-c141-41a0-bd42-33ff568d5dcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79ffdf409591498c836364074043c49c', 'request_id': 'req-54c31af8-c141-41a0-bd42-33ff568d5dcd'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:46.306879 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-54c31af8-c141-41a0-bd42-33ff568d5dcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79ffdf409591498c836364074043c49c', 'request_id': 'req-54c31af8-c141-41a0-bd42-33ff568d5dcd'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:46.319393 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-54c31af8-c141-41a0-bd42-33ff568d5dcd admin admin] The token cache is being invalidate because project 79ffdf409591498c836364074043c49c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:46.319691 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-54c31af8-c141-41a0-bd42-33ff568d5dcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:46.320339 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-54c31af8-c141-41a0-bd42-33ff568d5dcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:46.322181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1034/2047] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:46 2022] DELETE /identity/v3/projects/79ffdf409591498c836364074043c49c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:46.322696 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c31af8-c141-41a0-bd42-33ff568d5dcd admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:46.326164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-54c31af8-c141-41a0-bd42-33ff568d5dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:46.332457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79aa654-5a51-4347-81f5-00b4b63cc204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:46.333145 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79aa654-5a51-4347-81f5-00b4b63cc204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:46.333432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79aa654-5a51-4347-81f5-00b4b63cc204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:46.333705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79aa654-5a51-4347-81f5-00b4b63cc204 admin admin] PATH_INFO: `/v3/users/7a882e4e10424fcea7112203b09917f5` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:46.335005 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79aa654-5a51-4347-81f5-00b4b63cc204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a882e4e10424fcea7112203b09917f5)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:46.336988 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79aa654-5a51-4347-81f5-00b4b63cc204 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:46.390676 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c31af8-c141-41a0-bd42-33ff568d5dcd admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:46.396185 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0ae8d-1400-4a06-8082-12b4a41128a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:46.396853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ae8d-1400-4a06-8082-12b4a41128a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:46.397137 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ae8d-1400-4a06-8082-12b4a41128a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:46.397412 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ae8d-1400-4a06-8082-12b4a41128a2 admin admin] PATH_INFO: `/v3/users/60069a4d38834d26bd71c5cf8344e826` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:46.398596 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0ae8d-1400-4a06-8082-12b4a41128a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60069a4d38834d26bd71c5cf8344e826)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:46.401112 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0ae8d-1400-4a06-8082-12b4a41128a2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:46.589740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f79aa654-5a51-4347-81f5-00b4b63cc204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a882e4e10424fcea7112203b09917f5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:46.590534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f79aa654-5a51-4347-81f5-00b4b63cc204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a882e4e10424fcea7112203b09917f5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:46.603530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f79aa654-5a51-4347-81f5-00b4b63cc204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a882e4e10424fcea7112203b09917f5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:46.610641 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f79aa654-5a51-4347-81f5-00b4b63cc204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a882e4e10424fcea7112203b09917f5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:46.611386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f79aa654-5a51-4347-81f5-00b4b63cc204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a882e4e10424fcea7112203b09917f5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:46.667050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e7b0ae8d-1400-4a06-8082-12b4a41128a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60069a4d38834d26bd71c5cf8344e826'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:46.733748 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1014/2048] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:46 2022] DELETE /identity/v3/users/7a882e4e10424fcea7112203b09917f5 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:46.734852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79aa654-5a51-4347-81f5-00b4b63cc204 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:46.736298 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f79aa654-5a51-4347-81f5-00b4b63cc204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:46.786533 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:46.828139 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79aa654-5a51-4347-81f5-00b4b63cc204 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:46.833737 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700113d8-29fc-4ed3-bf53-84030e8b171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:46.834415 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700113d8-29fc-4ed3-bf53-84030e8b171d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:46.835669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700113d8-29fc-4ed3-bf53-84030e8b171d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:46.835669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700113d8-29fc-4ed3-bf53-84030e8b171d admin admin] PATH_INFO: `/v3/users/26de5e8db90f4e9f9bf8c21a1ab0f96b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:46.836056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e7b0ae8d-1400-4a06-8082-12b4a41128a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60069a4d38834d26bd71c5cf8344e826'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:46.836329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700113d8-29fc-4ed3-bf53-84030e8b171d admin admin] RBAC: Authorizing `identity:delete_user(user_id=26de5e8db90f4e9f9bf8c21a1ab0f96b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:46.838952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700113d8-29fc-4ed3-bf53-84030e8b171d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:46.857579 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e7b0ae8d-1400-4a06-8082-12b4a41128a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60069a4d38834d26bd71c5cf8344e826'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:46.865232 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e7b0ae8d-1400-4a06-8082-12b4a41128a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60069a4d38834d26bd71c5cf8344e826'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:46.866331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e7b0ae8d-1400-4a06-8082-12b4a41128a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60069a4d38834d26bd71c5cf8344e826'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:46.873004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1035/2049] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:46 2022] DELETE /identity/v3/users/60069a4d38834d26bd71c5cf8344e826 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:46.877684 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e7b2a-70d7-40ee-bd83-5ad03deeffd9 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:46.877974 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e7b2a-70d7-40ee-bd83-5ad03deeffd9 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:46.878279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e7b2a-70d7-40ee-bd83-5ad03deeffd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:46.898246 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-025e7b2a-70d7-40ee-bd83-5ad03deeffd9 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:46.899471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-025e7b2a-70d7-40ee-bd83-5ad03deeffd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:46.962849 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:46.972491 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1036/2050] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:46.994202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e7b2a-70d7-40ee-bd83-5ad03deeffd9 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:46.995629 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-025e7b2a-70d7-40ee-bd83-5ad03deeffd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:47.041334 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-700113d8-29fc-4ed3-bf53-84030e8b171d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26de5e8db90f4e9f9bf8c21a1ab0f96b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:47.042134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-700113d8-29fc-4ed3-bf53-84030e8b171d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26de5e8db90f4e9f9bf8c21a1ab0f96b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:47.056072 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-700113d8-29fc-4ed3-bf53-84030e8b171d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26de5e8db90f4e9f9bf8c21a1ab0f96b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:47.064700 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-700113d8-29fc-4ed3-bf53-84030e8b171d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26de5e8db90f4e9f9bf8c21a1ab0f96b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:47.064700 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-700113d8-29fc-4ed3-bf53-84030e8b171d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26de5e8db90f4e9f9bf8c21a1ab0f96b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:47.088994 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e7b2a-70d7-40ee-bd83-5ad03deeffd9 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:47.093761 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bac1f4-60a1-4c34-b73e-b86fd2732115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:47.094401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bac1f4-60a1-4c34-b73e-b86fd2732115 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:47.094684 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bac1f4-60a1-4c34-b73e-b86fd2732115 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:47.096306 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bac1f4-60a1-4c34-b73e-b86fd2732115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:47.101246 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-11bac1f4-60a1-4c34-b73e-b86fd2732115 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:47.131270 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bac1f4-60a1-4c34-b73e-b86fd2732115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:47.134103 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bac1f4-60a1-4c34-b73e-b86fd2732115 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:47.162210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1037/2051] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:06:47.173790 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1015/2052] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:46 2022] DELETE /identity/v3/users/26de5e8db90f4e9f9bf8c21a1ab0f96b => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:47.298582 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bac1f4-60a1-4c34-b73e-b86fd2732115 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:47.300158 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-11bac1f4-60a1-4c34-b73e-b86fd2732115 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:47.313118 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bac1f4-60a1-4c34-b73e-b86fd2732115 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:47.421772 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5a445-6bc9-4a9d-a888-d398e801a5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:47.422725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5a445-6bc9-4a9d-a888-d398e801a5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:47.423004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5a445-6bc9-4a9d-a888-d398e801a5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:47.423448 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5a445-6bc9-4a9d-a888-d398e801a5f9 admin admin] PATH_INFO: `/v3/projects/c40f5d982a654e9baae2e57d233703d6` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:47.424666 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5a445-6bc9-4a9d-a888-d398e801a5f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c40f5d982a654e9baae2e57d233703d6)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:47.427216 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5a445-6bc9-4a9d-a888-d398e801a5f9 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:47.613563 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-29d5a445-6bc9-4a9d-a888-d398e801a5f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c40f5d982a654e9baae2e57d233703d6', 'request_id': 'req-29d5a445-6bc9-4a9d-a888-d398e801a5f9'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:47.690489 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-29d5a445-6bc9-4a9d-a888-d398e801a5f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c40f5d982a654e9baae2e57d233703d6', 'request_id': 'req-29d5a445-6bc9-4a9d-a888-d398e801a5f9'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:47.704700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-29d5a445-6bc9-4a9d-a888-d398e801a5f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c40f5d982a654e9baae2e57d233703d6', 'request_id': 'req-29d5a445-6bc9-4a9d-a888-d398e801a5f9'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:47.721305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-29d5a445-6bc9-4a9d-a888-d398e801a5f9 admin admin] The token cache is being invalidate because project c40f5d982a654e9baae2e57d233703d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:47.721906 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-29d5a445-6bc9-4a9d-a888-d398e801a5f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:47.722981 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-29d5a445-6bc9-4a9d-a888-d398e801a5f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:47.752086 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1038/2053] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:47 2022] DELETE /identity/v3/projects/c40f5d982a654e9baae2e57d233703d6 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:47.758352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8823b5-25ca-46e0-8590-9b53875884d1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:47.758648 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8823b5-25ca-46e0-8590-9b53875884d1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:47.758935 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8823b5-25ca-46e0-8590-9b53875884d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:47.787767 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6e8823b5-25ca-46e0-8590-9b53875884d1 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:47.789056 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6e8823b5-25ca-46e0-8590-9b53875884d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:47.870237 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1016/2054] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:47.881600 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369151e-303b-453b-b242-2ee892d6f9d0 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:47.881600 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369151e-303b-453b-b242-2ee892d6f9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:47.881600 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369151e-303b-453b-b242-2ee892d6f9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:47.900928 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-5369151e-303b-453b-b242-2ee892d6f9d0 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:47.902156 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5369151e-303b-453b-b242-2ee892d6f9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:47.910774 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1039/2055] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:47.915005 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8823b5-25ca-46e0-8590-9b53875884d1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:47.924864 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8823b5-25ca-46e0-8590-9b53875884d1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:47.930209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81dbd3-c281-4688-8fc5-3b06fddc43c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:47.930842 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81dbd3-c281-4688-8fc5-3b06fddc43c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:47.931120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81dbd3-c281-4688-8fc5-3b06fddc43c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:47.931390 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81dbd3-c281-4688-8fc5-3b06fddc43c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:47.932122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81dbd3-c281-4688-8fc5-3b06fddc43c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:06:47.932652 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81dbd3-c281-4688-8fc5-3b06fddc43c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:47.934403 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81dbd3-c281-4688-8fc5-3b06fddc43c9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:47.946854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1017/2056] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:06:47.951326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369151e-303b-453b-b242-2ee892d6f9d0 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:47.960636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369151e-303b-453b-b242-2ee892d6f9d0 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:47.965388 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53703230-4481-4349-be31-14481062a592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:47.966000 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53703230-4481-4349-be31-14481062a592 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:47.966289 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53703230-4481-4349-be31-14481062a592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:47.966566 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53703230-4481-4349-be31-14481062a592 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:47.967257 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53703230-4481-4349-be31-14481062a592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:47.969228 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53703230-4481-4349-be31-14481062a592 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:47.987073 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81dbd3-c281-4688-8fc5-3b06fddc43c9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:47.989424 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5a81dbd3-c281-4688-8fc5-3b06fddc43c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:48.004525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81dbd3-c281-4688-8fc5-3b06fddc43c9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:48.009586 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d680d9-0e98-4f1c-8a74-d09b5c4b50c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:48.010517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d680d9-0e98-4f1c-8a74-d09b5c4b50c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:48.010801 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d680d9-0e98-4f1c-8a74-d09b5c4b50c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:48.011711 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d680d9-0e98-4f1c-8a74-d09b5c4b50c5 admin admin] PATH_INFO: `/v3/projects/464f1c13916f463e8b980afd747629e9` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:48.013350 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d680d9-0e98-4f1c-8a74-d09b5c4b50c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=464f1c13916f463e8b980afd747629e9)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:48.015334 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d680d9-0e98-4f1c-8a74-d09b5c4b50c5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:48.094090 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1040/2057] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:47 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:48.094090 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53703230-4481-4349-be31-14481062a592 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:48.094090 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-53703230-4481-4349-be31-14481062a592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:48.136342 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-87d680d9-0e98-4f1c-8a74-d09b5c4b50c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '464f1c13916f463e8b980afd747629e9', 'request_id': 'req-87d680d9-0e98-4f1c-8a74-d09b5c4b50c5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:48.141925 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-87d680d9-0e98-4f1c-8a74-d09b5c4b50c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '464f1c13916f463e8b980afd747629e9', 'request_id': 'req-87d680d9-0e98-4f1c-8a74-d09b5c4b50c5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:48.148834 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-87d680d9-0e98-4f1c-8a74-d09b5c4b50c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '464f1c13916f463e8b980afd747629e9', 'request_id': 'req-87d680d9-0e98-4f1c-8a74-d09b5c4b50c5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:48.158740 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53703230-4481-4349-be31-14481062a592 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:48.194200 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:48.217396 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b7523-1be3-4b6f-a56f-717e880f38ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:48.218086 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b7523-1be3-4b6f-a56f-717e880f38ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:48.218451 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b7523-1be3-4b6f-a56f-717e880f38ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:48.218741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b7523-1be3-4b6f-a56f-717e880f38ff admin admin] PATH_INFO: `/v3/projects/216394ee69674e28a8e723a14043e550` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:48.220182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-87d680d9-0e98-4f1c-8a74-d09b5c4b50c5 admin admin] The token cache is being invalidate because project 464f1c13916f463e8b980afd747629e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:48.220302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b7523-1be3-4b6f-a56f-717e880f38ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=216394ee69674e28a8e723a14043e550)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:48.220486 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-87d680d9-0e98-4f1c-8a74-d09b5c4b50c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:48.221153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-87d680d9-0e98-4f1c-8a74-d09b5c4b50c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:48.222606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b7523-1be3-4b6f-a56f-717e880f38ff admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:48.222713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1018/2058] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:47 2022] DELETE /identity/v3/projects/464f1c13916f463e8b980afd747629e9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:48.223616 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d680d9-0e98-4f1c-8a74-d09b5c4b50c5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:48.225161 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-87d680d9-0e98-4f1c-8a74-d09b5c4b50c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:48.237602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d680d9-0e98-4f1c-8a74-d09b5c4b50c5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:48.243461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6fb44-5b98-48a0-9d8d-5cc69f2269a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:48.244081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6fb44-5b98-48a0-9d8d-5cc69f2269a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:48.244363 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6fb44-5b98-48a0-9d8d-5cc69f2269a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:48.244639 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6fb44-5b98-48a0-9d8d-5cc69f2269a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:48.245372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6fb44-5b98-48a0-9d8d-5cc69f2269a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:48.247274 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6fb44-5b98-48a0-9d8d-5cc69f2269a3 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:48.342964 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b78b7523-1be3-4b6f-a56f-717e880f38ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216394ee69674e28a8e723a14043e550', 'request_id': 'req-b78b7523-1be3-4b6f-a56f-717e880f38ff'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:48.370800 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1019/2059] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:48 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:48.372100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6fb44-5b98-48a0-9d8d-5cc69f2269a3 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:48.373991 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-26b6fb44-5b98-48a0-9d8d-5cc69f2269a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:48.387806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6fb44-5b98-48a0-9d8d-5cc69f2269a3 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:48.437784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b78b7523-1be3-4b6f-a56f-717e880f38ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216394ee69674e28a8e723a14043e550', 'request_id': 'req-b78b7523-1be3-4b6f-a56f-717e880f38ff'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:48.444147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b78b7523-1be3-4b6f-a56f-717e880f38ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216394ee69674e28a8e723a14043e550', 'request_id': 'req-b78b7523-1be3-4b6f-a56f-717e880f38ff'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:48.445167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cfb79-ec6a-43d7-b73a-6f741e80103d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:48.445796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cfb79-ec6a-43d7-b73a-6f741e80103d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:48.446140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cfb79-ec6a-43d7-b73a-6f741e80103d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:48.446474 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cfb79-ec6a-43d7-b73a-6f741e80103d admin admin] PATH_INFO: `/v3/users/fd6a5eccca214376b9e8d8a10dc580cf` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:48.447769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1cfb79-ec6a-43d7-b73a-6f741e80103d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd6a5eccca214376b9e8d8a10dc580cf)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:48.449869 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1cfb79-ec6a-43d7-b73a-6f741e80103d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:48.456324 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b78b7523-1be3-4b6f-a56f-717e880f38ff admin admin] The token cache is being invalidate because project 216394ee69674e28a8e723a14043e550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:48.456875 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b78b7523-1be3-4b6f-a56f-717e880f38ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:48.457739 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b78b7523-1be3-4b6f-a56f-717e880f38ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:48.459556 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1041/2060] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:48 2022] DELETE /identity/v3/projects/216394ee69674e28a8e723a14043e550 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:48.460484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b7523-1be3-4b6f-a56f-717e880f38ff admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:48.462000 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b78b7523-1be3-4b6f-a56f-717e880f38ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:48.476224 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b7523-1be3-4b6f-a56f-717e880f38ff admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:48.481183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e73595-cd3a-411e-8ec5-6d9d91914128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:48.490809 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e73595-cd3a-411e-8ec5-6d9d91914128 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:48.490809 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e73595-cd3a-411e-8ec5-6d9d91914128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:48.490809 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e73595-cd3a-411e-8ec5-6d9d91914128 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:48.490809 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e73595-cd3a-411e-8ec5-6d9d91914128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:48.490809 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e73595-cd3a-411e-8ec5-6d9d91914128 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:48.496514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1042/2061] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:48.497848 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e64ec-b10e-417e-bf52-fdfdde512756 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:48.498142 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e64ec-b10e-417e-bf52-fdfdde512756 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:48.498422 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e64ec-b10e-417e-bf52-fdfdde512756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:48.512246 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:48.524961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-ef9e64ec-b10e-417e-bf52-fdfdde512756 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:48.524961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ef9e64ec-b10e-417e-bf52-fdfdde512756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:48.535972 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1043/2062] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:48.535972 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e64ec-b10e-417e-bf52-fdfdde512756 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:48.539869 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e64ec-b10e-417e-bf52-fdfdde512756 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:48.544730 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc7090-946d-4f97-b353-20e74870cfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:48.545389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc7090-946d-4f97-b353-20e74870cfe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:48.545674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc7090-946d-4f97-b353-20e74870cfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:48.545951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc7090-946d-4f97-b353-20e74870cfe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:48.546665 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc7090-946d-4f97-b353-20e74870cfe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:48.548284 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc7090-946d-4f97-b353-20e74870cfe4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:48.559131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1044/2063] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:48.560391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d18a6-20eb-448c-87ac-668cd40b336c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:48.560681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d18a6-20eb-448c-87ac-668cd40b336c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:48.560987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d18a6-20eb-448c-87ac-668cd40b336c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:48.579973 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-da8d18a6-20eb-448c-87ac-668cd40b336c None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:48.581218 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-da8d18a6-20eb-448c-87ac-668cd40b336c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:48.589441 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1045/2064] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:48.590235 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d18a6-20eb-448c-87ac-668cd40b336c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:48.600681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d18a6-20eb-448c-87ac-668cd40b336c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:48.608272 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e22e0-1e64-49f6-ad3f-7e6379d47056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:48.609590 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e22e0-1e64-49f6-ad3f-7e6379d47056 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:48.609590 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e22e0-1e64-49f6-ad3f-7e6379d47056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:48.614168 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e22e0-1e64-49f6-ad3f-7e6379d47056 admin admin] PATH_INFO: `/v3/projects/0e2b0e5eb61749378ba30079d1b2f1cd/users/7ab4b7e7e6e548eba0d323d86f10ac75/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:48.625749 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e22e0-1e64-49f6-ad3f-7e6379d47056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2b0e5eb61749378ba30079d1b2f1cd, user_id=7ab4b7e7e6e548eba0d323d86f10ac75, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:48.628508 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e22e0-1e64-49f6-ad3f-7e6379d47056 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:48.709990 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fd1cfb79-ec6a-43d7-b73a-6f741e80103d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd6a5eccca214376b9e8d8a10dc580cf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:48.710630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fd1cfb79-ec6a-43d7-b73a-6f741e80103d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd6a5eccca214376b9e8d8a10dc580cf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:48.724146 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fd1cfb79-ec6a-43d7-b73a-6f741e80103d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd6a5eccca214376b9e8d8a10dc580cf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:48.731211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fd1cfb79-ec6a-43d7-b73a-6f741e80103d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd6a5eccca214376b9e8d8a10dc580cf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:48.731893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fd1cfb79-ec6a-43d7-b73a-6f741e80103d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd6a5eccca214376b9e8d8a10dc580cf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:48.741673 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1046/2065] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:48 2022] PUT /identity/v3/projects/0e2b0e5eb61749378ba30079d1b2f1cd/users/7ab4b7e7e6e548eba0d323d86f10ac75/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:48.746040 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e22e0-1e64-49f6-ad3f-7e6379d47056 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:48.746040 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-007e22e0-1e64-49f6-ad3f-7e6379d47056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:48.809121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e22e0-1e64-49f6-ad3f-7e6379d47056 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:48.813939 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5a947-26ba-479d-9124-e417f55e957f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:48.814563 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5a947-26ba-479d-9124-e417f55e957f admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:48.814850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5a947-26ba-479d-9124-e417f55e957f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:48.815125 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5a947-26ba-479d-9124-e417f55e957f admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:48.815838 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5a947-26ba-479d-9124-e417f55e957f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:06:48.816147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5a947-26ba-479d-9124-e417f55e957f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:48.818407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5a947-26ba-479d-9124-e417f55e957f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:48.829902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1047/2066] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:06:48.831265 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7180c3b-ddfb-4875-9fe7-8381a9181e3c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:48.831595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7180c3b-ddfb-4875-9fe7-8381a9181e3c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:48.831836 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7180c3b-ddfb-4875-9fe7-8381a9181e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:48.840304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1020/2067] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:48 2022] DELETE /identity/v3/users/fd6a5eccca214376b9e8d8a10dc580cf => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:48.841316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cfb79-ec6a-43d7-b73a-6f741e80103d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:48.862703 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c7180c3b-ddfb-4875-9fe7-8381a9181e3c None None] MFA Rules not processed for user `7ab4b7e7e6e548eba0d323d86f10ac75`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:48.864690 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c7180c3b-ddfb-4875-9fe7-8381a9181e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:48.959431 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cfb79-ec6a-43d7-b73a-6f741e80103d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:48.966240 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2a2b2-65b8-4611-be4b-379185c9a7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:48.971066 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2a2b2-65b8-4611-be4b-379185c9a7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:48.971066 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2a2b2-65b8-4611-be4b-379185c9a7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:48.971066 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2a2b2-65b8-4611-be4b-379185c9a7e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:48.971066 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2a2b2-65b8-4611-be4b-379185c9a7e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:48.971066 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2a2b2-65b8-4611-be4b-379185c9a7e0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:48.977588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1048/2068] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:48.982386 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7180c3b-ddfb-4875-9fe7-8381a9181e3c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:48.983948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c7180c3b-ddfb-4875-9fe7-8381a9181e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:49.002844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7180c3b-ddfb-4875-9fe7-8381a9181e3c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:49.007921 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366cdc4-0dd4-434d-aa4d-1a94e0afa338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:49.012115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366cdc4-0dd4-434d-aa4d-1a94e0afa338 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:49.012115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366cdc4-0dd4-434d-aa4d-1a94e0afa338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:49.012115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366cdc4-0dd4-434d-aa4d-1a94e0afa338 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:49.012115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366cdc4-0dd4-434d-aa4d-1a94e0afa338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:49.012115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366cdc4-0dd4-434d-aa4d-1a94e0afa338 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:49.090875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1021/2069] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:48 2022] POST /identity/v3/projects => generated 381 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:49.094937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2a2b2-65b8-4611-be4b-379185c9a7e0 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:49.134127 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1049/2070] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:48 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:49.140438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366cdc4-0dd4-434d-aa4d-1a94e0afa338 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:49.173463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2a2b2-65b8-4611-be4b-379185c9a7e0 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:49.219703 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366cdc4-0dd4-434d-aa4d-1a94e0afa338 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:49.225802 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dbde4-ad4c-40f3-8310-991dc4706ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:49.226520 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dbde4-ad4c-40f3-8310-991dc4706ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:49.226866 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dbde4-ad4c-40f3-8310-991dc4706ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:49.227219 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dbde4-ad4c-40f3-8310-991dc4706ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:49.227983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dbde4-ad4c-40f3-8310-991dc4706ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:49.230065 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dbde4-ad4c-40f3-8310-991dc4706ea4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:49.242840 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3d4bc-5cab-47f6-9c8c-a5e60b8683c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:49.243425 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3d4bc-5cab-47f6-9c8c-a5e60b8683c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:49.243706 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3d4bc-5cab-47f6-9c8c-a5e60b8683c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:49.243982 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3d4bc-5cab-47f6-9c8c-a5e60b8683c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:49.244677 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3d4bc-5cab-47f6-9c8c-a5e60b8683c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:49.246749 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3d4bc-5cab-47f6-9c8c-a5e60b8683c1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:49.341848 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1050/2071] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:49 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:49.345785 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dbde4-ad4c-40f3-8310-991dc4706ea4 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:49.356206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dbde4-ad4c-40f3-8310-991dc4706ea4 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:49.360861 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416263c3-ef06-435e-885a-541e0ab16c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:49.361460 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416263c3-ef06-435e-885a-541e0ab16c1e admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:49.361745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416263c3-ef06-435e-885a-541e0ab16c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:49.362022 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416263c3-ef06-435e-885a-541e0ab16c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:49.362746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416263c3-ef06-435e-885a-541e0ab16c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:49.364953 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416263c3-ef06-435e-885a-541e0ab16c1e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:49.375592 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1051/2072] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:06:49.379887 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416263c3-ef06-435e-885a-541e0ab16c1e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:49.389355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416263c3-ef06-435e-885a-541e0ab16c1e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:49.395389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3108c-fa6c-4961-a916-b030c57918b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:49.396140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3108c-fa6c-4961-a916-b030c57918b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:49.396406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3108c-fa6c-4961-a916-b030c57918b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:49.396684 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3108c-fa6c-4961-a916-b030c57918b0 admin admin] PATH_INFO: `/v3/projects/cf524c06d3f64d779bf26e1250d9afb1/users/50afb9f7d2384218986f721f0e031531/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:49.402026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1022/2073] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:49 2022] POST /identity/v3/users => generated 291 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:49.403143 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3d4bc-5cab-47f6-9c8c-a5e60b8683c1 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:49.412290 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3108c-fa6c-4961-a916-b030c57918b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf524c06d3f64d779bf26e1250d9afb1, user_id=50afb9f7d2384218986f721f0e031531, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:49.414004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3d4bc-5cab-47f6-9c8c-a5e60b8683c1 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:49.415028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3108c-fa6c-4961-a916-b030c57918b0 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:49.423760 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b88ff-fadf-4467-8999-9169e369e8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:49.423760 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b88ff-fadf-4467-8999-9169e369e8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:49.423760 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b88ff-fadf-4467-8999-9169e369e8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:49.423760 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b88ff-fadf-4467-8999-9169e369e8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:49.424166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b88ff-fadf-4467-8999-9169e369e8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:49.424166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b88ff-fadf-4467-8999-9169e369e8f3 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:49.433883 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1023/2074] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:49.437761 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b88ff-fadf-4467-8999-9169e369e8f3 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:49.447317 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b88ff-fadf-4467-8999-9169e369e8f3 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:49.452015 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d8852-ec22-4e31-bfe2-df87c84f8f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:49.452608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d8852-ec22-4e31-bfe2-df87c84f8f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:49.452936 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d8852-ec22-4e31-bfe2-df87c84f8f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:49.453218 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d8852-ec22-4e31-bfe2-df87c84f8f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:49.453895 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d8852-ec22-4e31-bfe2-df87c84f8f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:49.455451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d8852-ec22-4e31-bfe2-df87c84f8f78 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:49.466590 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1024/2075] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:06:49.470853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d8852-ec22-4e31-bfe2-df87c84f8f78 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:49.481698 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d8852-ec22-4e31-bfe2-df87c84f8f78 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:49.486636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7580c4f-db28-42ef-a894-b196a32368c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:49.487321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7580c4f-db28-42ef-a894-b196a32368c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:49.487652 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7580c4f-db28-42ef-a894-b196a32368c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:49.487938 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7580c4f-db28-42ef-a894-b196a32368c5 admin admin] PATH_INFO: `/v3/projects/c7cf1bb28a0f42b79579826d7407af6d/users/2c5e9e123a2440e2970d1c8f768b6794/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:49.509081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7580c4f-db28-42ef-a894-b196a32368c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7cf1bb28a0f42b79579826d7407af6d, user_id=2c5e9e123a2440e2970d1c8f768b6794, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:49.509081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7580c4f-db28-42ef-a894-b196a32368c5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:49.564173 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1052/2076] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:49 2022] PUT /identity/v3/projects/cf524c06d3f64d779bf26e1250d9afb1/users/50afb9f7d2384218986f721f0e031531/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:49.567992 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3108c-fa6c-4961-a916-b030c57918b0 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:49.567992 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5ed3108c-fa6c-4961-a916-b030c57918b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:49.633968 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3108c-fa6c-4961-a916-b030c57918b0 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:49.634646 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1025/2077] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:49 2022] PUT /identity/v3/projects/c7cf1bb28a0f42b79579826d7407af6d/users/2c5e9e123a2440e2970d1c8f768b6794/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:49.635505 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7580c4f-db28-42ef-a894-b196a32368c5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:49.702000 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396363c4-5948-4ac9-b48d-4dfb45695eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:49.702470 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7580c4f-db28-42ef-a894-b196a32368c5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:49.702587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396363c4-5948-4ac9-b48d-4dfb45695eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:49.703035 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396363c4-5948-4ac9-b48d-4dfb45695eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:49.703324 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396363c4-5948-4ac9-b48d-4dfb45695eab admin admin] PATH_INFO: `/v3/projects/472ab877710f4706bad31cd716c93d70` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:49.704568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396363c4-5948-4ac9-b48d-4dfb45695eab admin admin] RBAC: Authorizing `identity:delete_project(project_id=472ab877710f4706bad31cd716c93d70)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:49.706677 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396363c4-5948-4ac9-b48d-4dfb45695eab admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:49.708292 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6998b2f-79eb-409e-9cff-1bc7defd10f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:49.708989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6998b2f-79eb-409e-9cff-1bc7defd10f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:49.710264 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6998b2f-79eb-409e-9cff-1bc7defd10f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:49.710264 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6998b2f-79eb-409e-9cff-1bc7defd10f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:49.710264 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6998b2f-79eb-409e-9cff-1bc7defd10f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:49.711847 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6998b2f-79eb-409e-9cff-1bc7defd10f9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:49.722329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1026/2078] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:49.723545 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8a33e-8506-45b8-a615-27cb3002dafe None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:49.723832 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8a33e-8506-45b8-a615-27cb3002dafe None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:49.724109 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8a33e-8506-45b8-a615-27cb3002dafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:49.730482 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:49.757171 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-65f8a33e-8506-45b8-a615-27cb3002dafe None None] MFA Rules not processed for user `2c5e9e123a2440e2970d1c8f768b6794`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:49.758397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-65f8a33e-8506-45b8-a615-27cb3002dafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:49.823360 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1027/2079] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:49.824192 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8a33e-8506-45b8-a615-27cb3002dafe None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:49.833944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-396363c4-5948-4ac9-b48d-4dfb45695eab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '472ab877710f4706bad31cd716c93d70', 'request_id': 'req-396363c4-5948-4ac9-b48d-4dfb45695eab'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:49.834784 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8a33e-8506-45b8-a615-27cb3002dafe None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:49.889989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19590330-34b3-4a17-8b1c-e52ac5a53084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:49.890844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19590330-34b3-4a17-8b1c-e52ac5a53084 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:49.890979 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19590330-34b3-4a17-8b1c-e52ac5a53084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:49.891204 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19590330-34b3-4a17-8b1c-e52ac5a53084 admin admin] PATH_INFO: `/v3/projects/cf524c06d3f64d779bf26e1250d9afb1/users/50afb9f7d2384218986f721f0e031531/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:49.893194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19590330-34b3-4a17-8b1c-e52ac5a53084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf524c06d3f64d779bf26e1250d9afb1, user_id=50afb9f7d2384218986f721f0e031531, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:49.895858 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19590330-34b3-4a17-8b1c-e52ac5a53084 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:49.898837 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-396363c4-5948-4ac9-b48d-4dfb45695eab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '472ab877710f4706bad31cd716c93d70', 'request_id': 'req-396363c4-5948-4ac9-b48d-4dfb45695eab'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:49.905048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-396363c4-5948-4ac9-b48d-4dfb45695eab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '472ab877710f4706bad31cd716c93d70', 'request_id': 'req-396363c4-5948-4ac9-b48d-4dfb45695eab'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:49.908144 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1028/2080] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:49 2022] PUT /identity/v3/projects/cf524c06d3f64d779bf26e1250d9afb1/users/50afb9f7d2384218986f721f0e031531/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:49.908144 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19590330-34b3-4a17-8b1c-e52ac5a53084 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:49.917653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-396363c4-5948-4ac9-b48d-4dfb45695eab admin admin] The token cache is being invalidate because project 472ab877710f4706bad31cd716c93d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:49.917945 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-396363c4-5948-4ac9-b48d-4dfb45695eab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:49.918612 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-396363c4-5948-4ac9-b48d-4dfb45695eab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:49.920174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1053/2081] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:49 2022] DELETE /identity/v3/projects/472ab877710f4706bad31cd716c93d70 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:49.921450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fd02e-e4e8-4ee5-8db8-e148577b14d3 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:49.921732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fd02e-e4e8-4ee5-8db8-e148577b14d3 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:49.922007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fd02e-e4e8-4ee5-8db8-e148577b14d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:49.953644 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d61fd02e-e4e8-4ee5-8db8-e148577b14d3 None None] MFA Rules not processed for user `50afb9f7d2384218986f721f0e031531`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:49.955009 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d61fd02e-e4e8-4ee5-8db8-e148577b14d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:49.976384 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19590330-34b3-4a17-8b1c-e52ac5a53084 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:49.981181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30424c-4b42-46f7-87b2-9404181a1209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:49.981805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30424c-4b42-46f7-87b2-9404181a1209 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:49.982112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30424c-4b42-46f7-87b2-9404181a1209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:49.982388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30424c-4b42-46f7-87b2-9404181a1209 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:49.983054 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30424c-4b42-46f7-87b2-9404181a1209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:49.985189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30424c-4b42-46f7-87b2-9404181a1209 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:50.024367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1054/2082] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:50.025784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a9776-d918-4737-9cc2-adf327b23043 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:50.026082 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a9776-d918-4737-9cc2-adf327b23043 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:50.026364 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a9776-d918-4737-9cc2-adf327b23043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:50.046627 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-fc2a9776-d918-4737-9cc2-adf327b23043 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:50.047876 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fc2a9776-d918-4737-9cc2-adf327b23043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:50.056542 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1055/2083] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:50.057436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a9776-d918-4737-9cc2-adf327b23043 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:50.058755 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fc2a9776-d918-4737-9cc2-adf327b23043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:50.078039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1029/2084] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:49 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:50.079552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb7dc6-3b84-4078-bcce-61be52b8abe8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:50.079849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb7dc6-3b84-4078-bcce-61be52b8abe8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:50.081121 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb7dc6-3b84-4078-bcce-61be52b8abe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:50.100858 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-26bb7dc6-3b84-4078-bcce-61be52b8abe8 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:50.102060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-26bb7dc6-3b84-4078-bcce-61be52b8abe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:50.120609 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a9776-d918-4737-9cc2-adf327b23043 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:50.169869 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:50.176018 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1030/2085] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:50.176018 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb7dc6-3b84-4078-bcce-61be52b8abe8 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:50.176018 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-26bb7dc6-3b84-4078-bcce-61be52b8abe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:50.178301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d60952-456c-4275-bfcb-91fc87fcfcae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:50.178301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d60952-456c-4275-bfcb-91fc87fcfcae service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:50.178301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d60952-456c-4275-bfcb-91fc87fcfcae service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:50.178792 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d60952-456c-4275-bfcb-91fc87fcfcae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:50.180308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-83d60952-456c-4275-bfcb-91fc87fcfcae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:50.191877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb7dc6-3b84-4078-bcce-61be52b8abe8 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:50.197158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d8bf6-1a5b-4360-b6b2-e7f533084641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:50.197796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d8bf6-1a5b-4360-b6b2-e7f533084641 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:50.198081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d8bf6-1a5b-4360-b6b2-e7f533084641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:50.198361 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d8bf6-1a5b-4360-b6b2-e7f533084641 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:50.199230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d8bf6-1a5b-4360-b6b2-e7f533084641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:50.201331 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d8bf6-1a5b-4360-b6b2-e7f533084641 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:50.252123 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d60952-456c-4275-bfcb-91fc87fcfcae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:50.253741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d60952-456c-4275-bfcb-91fc87fcfcae service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:50.263834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1056/2086] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:50.264568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d60952-456c-4275-bfcb-91fc87fcfcae service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:50.275946 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d60952-456c-4275-bfcb-91fc87fcfcae service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:50.280997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20621a61-bce8-4ff0-b515-1259b78b834b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:50.281639 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20621a61-bce8-4ff0-b515-1259b78b834b admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:50.281927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20621a61-bce8-4ff0-b515-1259b78b834b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:50.282208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20621a61-bce8-4ff0-b515-1259b78b834b admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:50.282922 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20621a61-bce8-4ff0-b515-1259b78b834b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:06:50.283237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20621a61-bce8-4ff0-b515-1259b78b834b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:50.284965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20621a61-bce8-4ff0-b515-1259b78b834b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:50.286587 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1031/2087] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:50 2022] POST /identity/v3/users => generated 298 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:50.291155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d8bf6-1a5b-4360-b6b2-e7f533084641 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:50.316206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1057/2088] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:06:50.316458 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d8bf6-1a5b-4360-b6b2-e7f533084641 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:50.316458 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4090b-cdb0-443e-ab6f-973562493641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:50.317040 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4090b-cdb0-443e-ab6f-973562493641 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:50.317328 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4090b-cdb0-443e-ab6f-973562493641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:50.317605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4090b-cdb0-443e-ab6f-973562493641 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:50.318073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20621a61-bce8-4ff0-b515-1259b78b834b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:50.318313 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4090b-cdb0-443e-ab6f-973562493641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:50.320072 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4090b-cdb0-443e-ab6f-973562493641 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:50.329832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20621a61-bce8-4ff0-b515-1259b78b834b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:50.331751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1032/2089] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:50.336883 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4090b-cdb0-443e-ab6f-973562493641 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:50.348324 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ac839-a04f-4419-83df-89d431851488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:50.349623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ac839-a04f-4419-83df-89d431851488 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:50.349623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ac839-a04f-4419-83df-89d431851488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:50.350535 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ac839-a04f-4419-83df-89d431851488 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:50.350622 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ac839-a04f-4419-83df-89d431851488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:50.351383 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4090b-cdb0-443e-ab6f-973562493641 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:50.352547 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ac839-a04f-4419-83df-89d431851488 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:50.356382 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6e838-e727-4a91-9848-874f0481cef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:50.357237 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6e838-e727-4a91-9848-874f0481cef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:50.357884 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6e838-e727-4a91-9848-874f0481cef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:50.358374 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6e838-e727-4a91-9848-874f0481cef9 admin admin] PATH_INFO: `/v3/projects/539632fe58bd4cfd9f5be78faaeb4d05/users/8800f7099b724f19bf5819fb09d4945e/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:50.375939 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6e838-e727-4a91-9848-874f0481cef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=539632fe58bd4cfd9f5be78faaeb4d05, user_id=8800f7099b724f19bf5819fb09d4945e, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:50.378678 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6e838-e727-4a91-9848-874f0481cef9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:50.441694 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1058/2090] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:50 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:50.442699 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ac839-a04f-4419-83df-89d431851488 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:50.469499 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1033/2091] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:50 2022] PUT /identity/v3/projects/539632fe58bd4cfd9f5be78faaeb4d05/users/8800f7099b724f19bf5819fb09d4945e/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:50.474092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6e838-e727-4a91-9848-874f0481cef9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:50.513554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ac839-a04f-4419-83df-89d431851488 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:50.542707 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6e838-e727-4a91-9848-874f0481cef9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:50.547655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b5268-3649-485c-b4da-d6a1fdd80596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:50.548274 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b5268-3649-485c-b4da-d6a1fdd80596 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:50.548586 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b5268-3649-485c-b4da-d6a1fdd80596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:50.548890 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b5268-3649-485c-b4da-d6a1fdd80596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:50.549610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b5268-3649-485c-b4da-d6a1fdd80596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:50.551795 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b5268-3649-485c-b4da-d6a1fdd80596 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:50.561687 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1034/2092] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:06:50.565955 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b5268-3649-485c-b4da-d6a1fdd80596 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:50.571137 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1a541-6f46-4de4-a5f1-eb8f8f4d5854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:50.571763 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a541-6f46-4de4-a5f1-eb8f8f4d5854 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:50.572084 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a541-6f46-4de4-a5f1-eb8f8f4d5854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:50.576982 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a541-6f46-4de4-a5f1-eb8f8f4d5854 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:50.576982 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1a541-6f46-4de4-a5f1-eb8f8f4d5854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:50.576982 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1a541-6f46-4de4-a5f1-eb8f8f4d5854 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:50.578349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b5268-3649-485c-b4da-d6a1fdd80596 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:50.583352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e94b3-d166-405f-9584-b68045788ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:50.584040 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e94b3-d166-405f-9584-b68045788ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:50.584325 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e94b3-d166-405f-9584-b68045788ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:50.584601 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e94b3-d166-405f-9584-b68045788ee8 admin admin] PATH_INFO: `/v3/projects/539632fe58bd4cfd9f5be78faaeb4d05/users/8800f7099b724f19bf5819fb09d4945e/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:50.586764 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e94b3-d166-405f-9584-b68045788ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=539632fe58bd4cfd9f5be78faaeb4d05, user_id=8800f7099b724f19bf5819fb09d4945e, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:50.589357 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e94b3-d166-405f-9584-b68045788ee8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:50.600159 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1035/2093] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:50 2022] PUT /identity/v3/projects/539632fe58bd4cfd9f5be78faaeb4d05/users/8800f7099b724f19bf5819fb09d4945e/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:50.610150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd7a04-00c1-4038-acfc-94cc752a1175 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:50.610436 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd7a04-00c1-4038-acfc-94cc752a1175 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:50.610717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd7a04-00c1-4038-acfc-94cc752a1175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:50.638405 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6fbd7a04-00c1-4038-acfc-94cc752a1175 None None] MFA Rules not processed for user `8800f7099b724f19bf5819fb09d4945e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:50.639614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6fbd7a04-00c1-4038-acfc-94cc752a1175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:50.694116 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1059/2094] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:50 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:50.705541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1a541-6f46-4de4-a5f1-eb8f8f4d5854 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:50.716178 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1036/2095] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:50.722461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1a541-6f46-4de4-a5f1-eb8f8f4d5854 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:50.728107 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd7a04-00c1-4038-acfc-94cc752a1175 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:50.785560 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd7a04-00c1-4038-acfc-94cc752a1175 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:50.789131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4392f6-e913-4970-82da-45200efaa425 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:50.789751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4392f6-e913-4970-82da-45200efaa425 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:50.789865 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a65ab-3225-4846-a83f-f88a7d545e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:50.790028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4392f6-e913-4970-82da-45200efaa425 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:50.790341 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4392f6-e913-4970-82da-45200efaa425 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:50.790489 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a65ab-3225-4846-a83f-f88a7d545e64 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:50.790701 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a65ab-3225-4846-a83f-f88a7d545e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:50.790978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a65ab-3225-4846-a83f-f88a7d545e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:50.791701 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a65ab-3225-4846-a83f-f88a7d545e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:50.793389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a65ab-3225-4846-a83f-f88a7d545e64 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:50.799764 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4392f6-e913-4970-82da-45200efaa425 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:50.801792 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4392f6-e913-4970-82da-45200efaa425 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:50.804071 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1060/2096] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:50.808078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a65ab-3225-4846-a83f-f88a7d545e64 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:50.812352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1037/2097] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:06:50.818169 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a65ab-3225-4846-a83f-f88a7d545e64 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:50.823009 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f8181-eda9-45f1-8430-7f2364e30079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:50.823626 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f8181-eda9-45f1-8430-7f2364e30079 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:50.823911 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f8181-eda9-45f1-8430-7f2364e30079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:50.824187 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f8181-eda9-45f1-8430-7f2364e30079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:50.826325 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f8181-eda9-45f1-8430-7f2364e30079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:50.828213 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f8181-eda9-45f1-8430-7f2364e30079 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:50.831210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:50.842314 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1061/2098] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:06:50.846656 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4392f6-e913-4970-82da-45200efaa425 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:50.859098 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4392f6-e913-4970-82da-45200efaa425 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:50.864506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599b247-d23b-4b62-becb-f7a5d7f10520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:50.865213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599b247-d23b-4b62-becb-f7a5d7f10520 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:50.865750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599b247-d23b-4b62-becb-f7a5d7f10520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:50.866025 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599b247-d23b-4b62-becb-f7a5d7f10520 admin admin] PATH_INFO: `/v3/projects/ce1373d80ed948bfb28334ad208c35b3/users/8f0f26e3ceae4dfbbe204e61b8889704/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:50.881501 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599b247-d23b-4b62-becb-f7a5d7f10520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1373d80ed948bfb28334ad208c35b3, user_id=8f0f26e3ceae4dfbbe204e61b8889704, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:50.884179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599b247-d23b-4b62-becb-f7a5d7f10520 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:50.971517 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f8181-eda9-45f1-8430-7f2364e30079 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:50.982180 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f8181-eda9-45f1-8430-7f2364e30079 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:50.986998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe0a5f-91cc-4fc5-816e-a7858e6f4c0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:50.987654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe0a5f-91cc-4fc5-816e-a7858e6f4c0e service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:50.987938 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe0a5f-91cc-4fc5-816e-a7858e6f4c0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:50.988338 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe0a5f-91cc-4fc5-816e-a7858e6f4c0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:50.990132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fbfe0a5f-91cc-4fc5-816e-a7858e6f4c0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:50.992017 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1038/2099] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:50 2022] PUT /identity/v3/projects/ce1373d80ed948bfb28334ad208c35b3/users/8f0f26e3ceae4dfbbe204e61b8889704/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:51.008470 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563f45f-dde8-4151-a59d-6a65c727a804 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:51.009004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563f45f-dde8-4151-a59d-6a65c727a804 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:51.009726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563f45f-dde8-4151-a59d-6a65c727a804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:51.037910 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9563f45f-dde8-4151-a59d-6a65c727a804 None None] MFA Rules not processed for user `8f0f26e3ceae4dfbbe204e61b8889704`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:51.039063 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9563f45f-dde8-4151-a59d-6a65c727a804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:51.051334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe0a5f-91cc-4fc5-816e-a7858e6f4c0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:51.052813 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe0a5f-91cc-4fc5-816e-a7858e6f4c0e service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:51.061866 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1062/2100] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:51.120010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1039/2101] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:51.124681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe0a5f-91cc-4fc5-816e-a7858e6f4c0e service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:51.135775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe0a5f-91cc-4fc5-816e-a7858e6f4c0e service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:51.195051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437109a-dee0-4d42-9447-356dc281a660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:51.195689 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437109a-dee0-4d42-9447-356dc281a660 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:51.195963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437109a-dee0-4d42-9447-356dc281a660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:51.196238 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437109a-dee0-4d42-9447-356dc281a660 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:51.196946 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437109a-dee0-4d42-9447-356dc281a660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:51.198873 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437109a-dee0-4d42-9447-356dc281a660 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:51.348796 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1063/2102] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:51 2022] POST /identity/v3/projects => generated 383 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:51.354446 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563f45f-dde8-4151-a59d-6a65c727a804 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:51.374100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563f45f-dde8-4151-a59d-6a65c727a804 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:51.451644 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa8f7e-7dd9-4e5a-8371-6b90b7f626e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:51.452886 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa8f7e-7dd9-4e5a-8371-6b90b7f626e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:51.453246 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa8f7e-7dd9-4e5a-8371-6b90b7f626e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:51.453648 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa8f7e-7dd9-4e5a-8371-6b90b7f626e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:51.454397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa8f7e-7dd9-4e5a-8371-6b90b7f626e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:51.459666 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa8f7e-7dd9-4e5a-8371-6b90b7f626e3 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:51.564123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1040/2103] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:51 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:51.570896 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437109a-dee0-4d42-9447-356dc281a660 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:51.587231 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437109a-dee0-4d42-9447-356dc281a660 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:51.592424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdb2a5-eefb-48a6-9feb-b02dae1871a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:51.593308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdb2a5-eefb-48a6-9feb-b02dae1871a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:51.593753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdb2a5-eefb-48a6-9feb-b02dae1871a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:51.594029 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdb2a5-eefb-48a6-9feb-b02dae1871a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:51.599228 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdb2a5-eefb-48a6-9feb-b02dae1871a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:51.599228 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdb2a5-eefb-48a6-9feb-b02dae1871a8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:51.608275 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1064/2104] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:51.612433 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa8f7e-7dd9-4e5a-8371-6b90b7f626e3 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:51.623726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa8f7e-7dd9-4e5a-8371-6b90b7f626e3 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:51.628790 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa9b72-85d4-4e32-9f39-a329256bfc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:51.629658 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa9b72-85d4-4e32-9f39-a329256bfc4b admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:51.630012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa9b72-85d4-4e32-9f39-a329256bfc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:51.630357 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa9b72-85d4-4e32-9f39-a329256bfc4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:51.631264 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa9b72-85d4-4e32-9f39-a329256bfc4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:51.632898 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa9b72-85d4-4e32-9f39-a329256bfc4b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:51.643623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1041/2105] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:51.648314 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdb2a5-eefb-48a6-9feb-b02dae1871a8 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:51.658907 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdb2a5-eefb-48a6-9feb-b02dae1871a8 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:51.664153 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96507934-b349-4f43-807f-3096cc167530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:51.664855 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96507934-b349-4f43-807f-3096cc167530 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:51.665141 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96507934-b349-4f43-807f-3096cc167530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:51.665422 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96507934-b349-4f43-807f-3096cc167530 admin admin] PATH_INFO: `/v3/projects/b14ed1cf1487496b84f795ef13e44647/users/c3926429b0b9423abb1bf64e001535b9/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:51.680293 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96507934-b349-4f43-807f-3096cc167530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14ed1cf1487496b84f795ef13e44647, user_id=c3926429b0b9423abb1bf64e001535b9, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:51.683048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96507934-b349-4f43-807f-3096cc167530 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:51.726692 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa9b72-85d4-4e32-9f39-a329256bfc4b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:51.736917 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa9b72-85d4-4e32-9f39-a329256bfc4b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:51.742220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e12c8-e6c1-4975-bd78-c827023836dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:51.742863 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e12c8-e6c1-4975-bd78-c827023836dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:51.743143 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e12c8-e6c1-4975-bd78-c827023836dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:51.743417 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e12c8-e6c1-4975-bd78-c827023836dd admin admin] PATH_INFO: `/v3/users/2c5e9e123a2440e2970d1c8f768b6794` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:51.744601 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e12c8-e6c1-4975-bd78-c827023836dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c5e9e123a2440e2970d1c8f768b6794)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:51.746587 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e12c8-e6c1-4975-bd78-c827023836dd admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:51.780950 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1065/2106] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:51 2022] PUT /identity/v3/projects/b14ed1cf1487496b84f795ef13e44647/users/c3926429b0b9423abb1bf64e001535b9/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:51.793209 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6685e-1668-4bd0-ba8b-ccff036c85c6 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:51.793487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6685e-1668-4bd0-ba8b-ccff036c85c6 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:51.793791 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6685e-1668-4bd0-ba8b-ccff036c85c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:51.824564 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-a1e6685e-1668-4bd0-ba8b-ccff036c85c6 None None] MFA Rules not processed for user `c3926429b0b9423abb1bf64e001535b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:51.826360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a1e6685e-1668-4bd0-ba8b-ccff036c85c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:51.895213 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1066/2107] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:51.899765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6685e-1668-4bd0-ba8b-ccff036c85c6 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:51.901367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:51.961896 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6685e-1668-4bd0-ba8b-ccff036c85c6 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:51.966589 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef55551-ab13-47fa-9cf9-d9c6a28abf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:51.967218 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef55551-ab13-47fa-9cf9-d9c6a28abf33 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:51.967499 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef55551-ab13-47fa-9cf9-d9c6a28abf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:51.967777 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef55551-ab13-47fa-9cf9-d9c6a28abf33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:51.968470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef55551-ab13-47fa-9cf9-d9c6a28abf33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:51.970426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef55551-ab13-47fa-9cf9-d9c6a28abf33 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:52.073096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:52.090230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fb6e12c8-e6c1-4975-bd78-c827023836dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c5e9e123a2440e2970d1c8f768b6794'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:52.090942 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fb6e12c8-e6c1-4975-bd78-c827023836dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c5e9e123a2440e2970d1c8f768b6794'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:52.103767 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fb6e12c8-e6c1-4975-bd78-c827023836dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c5e9e123a2440e2970d1c8f768b6794'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:52.110504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fb6e12c8-e6c1-4975-bd78-c827023836dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c5e9e123a2440e2970d1c8f768b6794'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:52.111213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fb6e12c8-e6c1-4975-bd78-c827023836dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c5e9e123a2440e2970d1c8f768b6794'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:52.179947 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1067/2108] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:51 2022] POST /identity/v3/projects => generated 381 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:52.181532 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef55551-ab13-47fa-9cf9-d9c6a28abf33 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:52.183008 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7ef55551-ab13-47fa-9cf9-d9c6a28abf33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:52.226782 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1042/2109] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:51 2022] DELETE /identity/v3/users/2c5e9e123a2440e2970d1c8f768b6794 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:52.229495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e25b5e-86af-4118-bbc4-f3203142236d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:52.229782 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e25b5e-86af-4118-bbc4-f3203142236d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:52.230060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e25b5e-86af-4118-bbc4-f3203142236d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:52.252228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-03e25b5e-86af-4118-bbc4-f3203142236d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:52.253500 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-03e25b5e-86af-4118-bbc4-f3203142236d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:52.266873 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef55551-ab13-47fa-9cf9-d9c6a28abf33 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:52.318512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1043/2110] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:52.330273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df10ef-f2b3-4f98-9d28-94003f076e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:52.330920 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df10ef-f2b3-4f98-9d28-94003f076e43 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:52.331201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df10ef-f2b3-4f98-9d28-94003f076e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:52.331382 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e25b5e-86af-4118-bbc4-f3203142236d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:52.331484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df10ef-f2b3-4f98-9d28-94003f076e43 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:52.332183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df10ef-f2b3-4f98-9d28-94003f076e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:52.333569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-03e25b5e-86af-4118-bbc4-f3203142236d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:52.339984 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df10ef-f2b3-4f98-9d28-94003f076e43 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:52.405261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e25b5e-86af-4118-bbc4-f3203142236d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:52.409483 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba982d0-2192-4fbe-b849-f3046b854608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:52.410788 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba982d0-2192-4fbe-b849-f3046b854608 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:52.411069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba982d0-2192-4fbe-b849-f3046b854608 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:52.411339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba982d0-2192-4fbe-b849-f3046b854608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:52.421784 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba982d0-2192-4fbe-b849-f3046b854608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:52.423904 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba982d0-2192-4fbe-b849-f3046b854608 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:52.427229 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1068/2111] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:52 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:52.431287 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df10ef-f2b3-4f98-9d28-94003f076e43 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:52.438333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1044/2112] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:06:52.442348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df10ef-f2b3-4f98-9d28-94003f076e43 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:52.448665 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7ea6e-5545-4b66-960c-ec9890962700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:52.449746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7ea6e-5545-4b66-960c-ec9890962700 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:52.450180 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7ea6e-5545-4b66-960c-ec9890962700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:52.450609 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7ea6e-5545-4b66-960c-ec9890962700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:52.452017 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7ea6e-5545-4b66-960c-ec9890962700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:52.453828 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7ea6e-5545-4b66-960c-ec9890962700 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:52.469846 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1069/2113] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:06:52.471983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba982d0-2192-4fbe-b849-f3046b854608 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:52.484649 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba982d0-2192-4fbe-b849-f3046b854608 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:52.490652 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c561d8-2b73-4274-b4a7-97e7b9794962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:52.491505 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c561d8-2b73-4274-b4a7-97e7b9794962 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:52.491796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c561d8-2b73-4274-b4a7-97e7b9794962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:52.492082 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c561d8-2b73-4274-b4a7-97e7b9794962 admin admin] PATH_INFO: `/v3/projects/e31e6b2330bf4f94a1ebd011a3efb352/users/ec4d7923956448a48a4263d94e9fd5c9/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:52.509936 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c561d8-2b73-4274-b4a7-97e7b9794962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e31e6b2330bf4f94a1ebd011a3efb352, user_id=ec4d7923956448a48a4263d94e9fd5c9, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:52.512826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c561d8-2b73-4274-b4a7-97e7b9794962 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:52.624177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1045/2114] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:52 2022] PUT /identity/v3/projects/e31e6b2330bf4f94a1ebd011a3efb352/users/ec4d7923956448a48a4263d94e9fd5c9/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:52.628093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7ea6e-5545-4b66-960c-ec9890962700 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:52.650351 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7ea6e-5545-4b66-960c-ec9890962700 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:52.772244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df52af3-2924-409f-9609-6005149d2493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:52.773253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52af3-2924-409f-9609-6005149d2493 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:52.774652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52af3-2924-409f-9609-6005149d2493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:52.775203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52af3-2924-409f-9609-6005149d2493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:52.776304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df52af3-2924-409f-9609-6005149d2493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:52.778695 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df52af3-2924-409f-9609-6005149d2493 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:52.794273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1070/2115] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:06:52.799725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c561d8-2b73-4274-b4a7-97e7b9794962 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:52.816013 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c561d8-2b73-4274-b4a7-97e7b9794962 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:52.821752 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de5c44-e51a-4e77-b8a5-46be04374180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:52.822444 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de5c44-e51a-4e77-b8a5-46be04374180 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:52.822727 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de5c44-e51a-4e77-b8a5-46be04374180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:52.823001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de5c44-e51a-4e77-b8a5-46be04374180 admin admin] PATH_INFO: `/v3/projects/e31e6b2330bf4f94a1ebd011a3efb352/users/ec4d7923956448a48a4263d94e9fd5c9/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:52.825141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de5c44-e51a-4e77-b8a5-46be04374180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e31e6b2330bf4f94a1ebd011a3efb352, user_id=ec4d7923956448a48a4263d94e9fd5c9, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:52.827815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de5c44-e51a-4e77-b8a5-46be04374180 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:52.839822 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1046/2116] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:52 2022] PUT /identity/v3/projects/e31e6b2330bf4f94a1ebd011a3efb352/users/ec4d7923956448a48a4263d94e9fd5c9/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:52.851357 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ce39b-a95c-40b1-ab88-3b3625d2dbcf None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:52.851694 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ce39b-a95c-40b1-ab88-3b3625d2dbcf None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:52.851885 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ce39b-a95c-40b1-ab88-3b3625d2dbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:52.888162 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-2c1ce39b-a95c-40b1-ab88-3b3625d2dbcf None None] MFA Rules not processed for user `ec4d7923956448a48a4263d94e9fd5c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:52.889578 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2c1ce39b-a95c-40b1-ab88-3b3625d2dbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:52.963347 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1071/2117] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:52.975163 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de5c44-e51a-4e77-b8a5-46be04374180 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:52.977013 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a1de5c44-e51a-4e77-b8a5-46be04374180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:53.033478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de5c44-e51a-4e77-b8a5-46be04374180 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:53.038526 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d01ebc-9b0f-46b7-a100-0c1b1190ba35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:53.039575 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d01ebc-9b0f-46b7-a100-0c1b1190ba35 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:53.039881 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d01ebc-9b0f-46b7-a100-0c1b1190ba35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:53.040158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d01ebc-9b0f-46b7-a100-0c1b1190ba35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:53.042017 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f8d01ebc-9b0f-46b7-a100-0c1b1190ba35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:53.049768 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ce39b-a95c-40b1-ab88-3b3625d2dbcf None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:53.053828 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2c1ce39b-a95c-40b1-ab88-3b3625d2dbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:53.111133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d01ebc-9b0f-46b7-a100-0c1b1190ba35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:53.111133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d01ebc-9b0f-46b7-a100-0c1b1190ba35 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:53.123266 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1047/2118] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:53.128511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ce39b-a95c-40b1-ab88-3b3625d2dbcf None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:53.134326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3727d-af34-4305-b699-d6bda0f89823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:53.134326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3727d-af34-4305-b699-d6bda0f89823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:53.134326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3727d-af34-4305-b699-d6bda0f89823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:53.134589 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3727d-af34-4305-b699-d6bda0f89823 admin admin] PATH_INFO: `/v3/projects/c7cf1bb28a0f42b79579826d7407af6d` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:53.135765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3727d-af34-4305-b699-d6bda0f89823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7cf1bb28a0f42b79579826d7407af6d)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:53.137777 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3727d-af34-4305-b699-d6bda0f89823 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:53.290012 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0db3727d-af34-4305-b699-d6bda0f89823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7cf1bb28a0f42b79579826d7407af6d', 'request_id': 'req-0db3727d-af34-4305-b699-d6bda0f89823'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:53.367412 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0db3727d-af34-4305-b699-d6bda0f89823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7cf1bb28a0f42b79579826d7407af6d', 'request_id': 'req-0db3727d-af34-4305-b699-d6bda0f89823'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:53.367522 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:53.371633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0db3727d-af34-4305-b699-d6bda0f89823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7cf1bb28a0f42b79579826d7407af6d', 'request_id': 'req-0db3727d-af34-4305-b699-d6bda0f89823'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:53.383413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0db3727d-af34-4305-b699-d6bda0f89823 admin admin] The token cache is being invalidate because project c7cf1bb28a0f42b79579826d7407af6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:53.383854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0db3727d-af34-4305-b699-d6bda0f89823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:53.384531 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0db3727d-af34-4305-b699-d6bda0f89823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:53.386369 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1072/2119] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:53 2022] DELETE /identity/v3/projects/c7cf1bb28a0f42b79579826d7407af6d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:53.390229 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d01ebc-9b0f-46b7-a100-0c1b1190ba35 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:53.402365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d01ebc-9b0f-46b7-a100-0c1b1190ba35 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:53.462076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128af1d3-8aa2-4069-9fa5-35c45cf5bdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:53.463378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128af1d3-8aa2-4069-9fa5-35c45cf5bdc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:53.463665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128af1d3-8aa2-4069-9fa5-35c45cf5bdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:53.463937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128af1d3-8aa2-4069-9fa5-35c45cf5bdc0 admin admin] PATH_INFO: `/v3/users/8800f7099b724f19bf5819fb09d4945e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:53.465161 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128af1d3-8aa2-4069-9fa5-35c45cf5bdc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8800f7099b724f19bf5819fb09d4945e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:53.467237 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128af1d3-8aa2-4069-9fa5-35c45cf5bdc0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:53.478201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:53.687874 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-128af1d3-8aa2-4069-9fa5-35c45cf5bdc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8800f7099b724f19bf5819fb09d4945e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:53.688673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-128af1d3-8aa2-4069-9fa5-35c45cf5bdc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8800f7099b724f19bf5819fb09d4945e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:53.700795 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-128af1d3-8aa2-4069-9fa5-35c45cf5bdc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8800f7099b724f19bf5819fb09d4945e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:53.707777 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-128af1d3-8aa2-4069-9fa5-35c45cf5bdc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8800f7099b724f19bf5819fb09d4945e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:53.708483 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-128af1d3-8aa2-4069-9fa5-35c45cf5bdc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8800f7099b724f19bf5819fb09d4945e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:53.774592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1048/2120] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:53 2022] DELETE /identity/v3/users/8800f7099b724f19bf5819fb09d4945e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:54.456849 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3727d-af34-4305-b699-d6bda0f89823 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:54.459103 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0db3727d-af34-4305-b699-d6bda0f89823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:54.473454 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3727d-af34-4305-b699-d6bda0f89823 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:54.532942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df90ea5-8ae6-4a9f-aba3-28e6dcd971de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:54.533647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df90ea5-8ae6-4a9f-aba3-28e6dcd971de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:54.533933 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df90ea5-8ae6-4a9f-aba3-28e6dcd971de admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:54.534214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df90ea5-8ae6-4a9f-aba3-28e6dcd971de admin admin] PATH_INFO: `/v3/projects/539632fe58bd4cfd9f5be78faaeb4d05` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:54.535932 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df90ea5-8ae6-4a9f-aba3-28e6dcd971de admin admin] RBAC: Authorizing `identity:delete_project(project_id=539632fe58bd4cfd9f5be78faaeb4d05)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:54.537928 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df90ea5-8ae6-4a9f-aba3-28e6dcd971de admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:54.575396 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:54.638183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6df90ea5-8ae6-4a9f-aba3-28e6dcd971de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '539632fe58bd4cfd9f5be78faaeb4d05', 'request_id': 'req-6df90ea5-8ae6-4a9f-aba3-28e6dcd971de'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:54.643861 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:54.734992 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6df90ea5-8ae6-4a9f-aba3-28e6dcd971de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '539632fe58bd4cfd9f5be78faaeb4d05', 'request_id': 'req-6df90ea5-8ae6-4a9f-aba3-28e6dcd971de'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:54.741303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6df90ea5-8ae6-4a9f-aba3-28e6dcd971de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '539632fe58bd4cfd9f5be78faaeb4d05', 'request_id': 'req-6df90ea5-8ae6-4a9f-aba3-28e6dcd971de'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:54.752580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6df90ea5-8ae6-4a9f-aba3-28e6dcd971de admin admin] The token cache is being invalidate because project 539632fe58bd4cfd9f5be78faaeb4d05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:54.752909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6df90ea5-8ae6-4a9f-aba3-28e6dcd971de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:54.753583 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6df90ea5-8ae6-4a9f-aba3-28e6dcd971de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:54.755099 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1073/2121] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:54 2022] DELETE /identity/v3/projects/539632fe58bd4cfd9f5be78faaeb4d05 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:54.760077 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec0194-6a1f-40a8-968b-de05dba7cf96 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:54.760366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec0194-6a1f-40a8-968b-de05dba7cf96 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:54.760674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec0194-6a1f-40a8-968b-de05dba7cf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:54.786172 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0dec0194-6a1f-40a8-968b-de05dba7cf96 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:54.793812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0dec0194-6a1f-40a8-968b-de05dba7cf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:54.852217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1049/2122] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:54.920110 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d812-65c7-4612-9d34-e668415fbbb5 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:54.920405 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d812-65c7-4612-9d34-e668415fbbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:54.920690 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d812-65c7-4612-9d34-e668415fbbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:54.942133 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c741d812-65c7-4612-9d34-e668415fbbb5 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:54.943463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c741d812-65c7-4612-9d34-e668415fbbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:54.952774 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1074/2123] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:54.957396 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec0194-6a1f-40a8-968b-de05dba7cf96 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:54.967342 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec0194-6a1f-40a8-968b-de05dba7cf96 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:54.972522 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3037b8b-0138-4bbf-91d5-77404b5bd721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:54.973871 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3037b8b-0138-4bbf-91d5-77404b5bd721 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:54.974163 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3037b8b-0138-4bbf-91d5-77404b5bd721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:54.974444 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3037b8b-0138-4bbf-91d5-77404b5bd721 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:54.975154 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3037b8b-0138-4bbf-91d5-77404b5bd721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:06:54.975466 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3037b8b-0138-4bbf-91d5-77404b5bd721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:54.978990 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3037b8b-0138-4bbf-91d5-77404b5bd721 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:54.993291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1050/2124] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:06:54.994525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741d812-65c7-4612-9d34-e668415fbbb5 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:55.006261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741d812-65c7-4612-9d34-e668415fbbb5 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:55.011552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136856c9-04af-453c-86f3-3f9130fea618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:55.012295 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136856c9-04af-453c-86f3-3f9130fea618 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:55.012681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136856c9-04af-453c-86f3-3f9130fea618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:55.013083 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136856c9-04af-453c-86f3-3f9130fea618 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:55.013857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136856c9-04af-453c-86f3-3f9130fea618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:55.016032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136856c9-04af-453c-86f3-3f9130fea618 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:55.141341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1075/2125] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:54 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:55.146545 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3037b8b-0138-4bbf-91d5-77404b5bd721 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:55.156790 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3037b8b-0138-4bbf-91d5-77404b5bd721 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:55.217592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb161f0b-efd7-49d6-a087-f4b9eb7cf368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:55.218407 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb161f0b-efd7-49d6-a087-f4b9eb7cf368 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:55.218527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb161f0b-efd7-49d6-a087-f4b9eb7cf368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:55.218751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb161f0b-efd7-49d6-a087-f4b9eb7cf368 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:55.219434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb161f0b-efd7-49d6-a087-f4b9eb7cf368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:55.221479 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb161f0b-efd7-49d6-a087-f4b9eb7cf368 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:55.358618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1051/2126] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:55 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:55.362765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136856c9-04af-453c-86f3-3f9130fea618 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:55.373387 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136856c9-04af-453c-86f3-3f9130fea618 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:55.378019 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a26e60-e231-45cc-a820-72c6ee51109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:55.378636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a26e60-e231-45cc-a820-72c6ee51109b admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:55.379418 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a26e60-e231-45cc-a820-72c6ee51109b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:55.379697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a26e60-e231-45cc-a820-72c6ee51109b admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:55.380545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a26e60-e231-45cc-a820-72c6ee51109b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:55.382203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a26e60-e231-45cc-a820-72c6ee51109b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:55.392255 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1076/2127] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:55.397088 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb161f0b-efd7-49d6-a087-f4b9eb7cf368 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:55.407473 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb161f0b-efd7-49d6-a087-f4b9eb7cf368 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:55.412153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6eea63-38d7-42da-8652-8fb6fe1c550a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:55.412803 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eea63-38d7-42da-8652-8fb6fe1c550a admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:55.413133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eea63-38d7-42da-8652-8fb6fe1c550a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:55.413590 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eea63-38d7-42da-8652-8fb6fe1c550a admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:55.414295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6eea63-38d7-42da-8652-8fb6fe1c550a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:55.415894 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6eea63-38d7-42da-8652-8fb6fe1c550a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:55.427824 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1052/2128] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:55.432167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a26e60-e231-45cc-a820-72c6ee51109b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:55.443392 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a26e60-e231-45cc-a820-72c6ee51109b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:55.449081 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51bfb9-de5f-4157-a5b5-438bd1a63d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:55.449855 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51bfb9-de5f-4157-a5b5-438bd1a63d15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:55.450183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51bfb9-de5f-4157-a5b5-438bd1a63d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:55.450471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51bfb9-de5f-4157-a5b5-438bd1a63d15 admin admin] PATH_INFO: `/v3/projects/7e2de75896ba4fc8a2c53daa2c4ba187/users/549b516986024bf191bc2f11f9e3a6ab/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:55.465444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51bfb9-de5f-4157-a5b5-438bd1a63d15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2de75896ba4fc8a2c53daa2c4ba187, user_id=549b516986024bf191bc2f11f9e3a6ab, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:55.468170 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51bfb9-de5f-4157-a5b5-438bd1a63d15 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:55.540998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1077/2129] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:55 2022] PUT /identity/v3/projects/7e2de75896ba4fc8a2c53daa2c4ba187/users/549b516986024bf191bc2f11f9e3a6ab/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:55.545486 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:55.551462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf18954-37df-444f-b928-0e5a40c8e48f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:55.551819 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf18954-37df-444f-b928-0e5a40c8e48f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:55.558953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf18954-37df-444f-b928-0e5a40c8e48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:55.580091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-baf18954-37df-444f-b928-0e5a40c8e48f None None] MFA Rules not processed for user `549b516986024bf191bc2f11f9e3a6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:55.581248 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-baf18954-37df-444f-b928-0e5a40c8e48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:55.644440 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1053/2130] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:55.655615 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51bfb9-de5f-4157-a5b5-438bd1a63d15 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:55.657372 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-cb51bfb9-de5f-4157-a5b5-438bd1a63d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:55.720125 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51bfb9-de5f-4157-a5b5-438bd1a63d15 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:55.723917 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb679f-c67d-4f9c-8b1b-5b1cf4a24750 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:55.724540 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb679f-c67d-4f9c-8b1b-5b1cf4a24750 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:55.724871 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb679f-c67d-4f9c-8b1b-5b1cf4a24750 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:55.725149 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb679f-c67d-4f9c-8b1b-5b1cf4a24750 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:55.733486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb679f-c67d-4f9c-8b1b-5b1cf4a24750 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:55.736631 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb679f-c67d-4f9c-8b1b-5b1cf4a24750 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:55.744764 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1078/2131] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:55.768612 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf18954-37df-444f-b928-0e5a40c8e48f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:55.832966 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf18954-37df-444f-b928-0e5a40c8e48f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:55.837575 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a8116-7f50-496b-aa5c-017b32e3d55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:55.838242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a8116-7f50-496b-aa5c-017b32e3d55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:55.838525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a8116-7f50-496b-aa5c-017b32e3d55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:55.838799 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a8116-7f50-496b-aa5c-017b32e3d55c admin admin] PATH_INFO: `/v3/users/549b516986024bf191bc2f11f9e3a6ab` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:55.839971 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a8116-7f50-496b-aa5c-017b32e3d55c admin admin] RBAC: Authorizing `identity:delete_user(user_id=549b516986024bf191bc2f11f9e3a6ab)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:55.841923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a8116-7f50-496b-aa5c-017b32e3d55c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:55.912547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:55.962793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:56.081223 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-229a8116-7f50-496b-aa5c-017b32e3d55c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549b516986024bf191bc2f11f9e3a6ab'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:56.082293 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-229a8116-7f50-496b-aa5c-017b32e3d55c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549b516986024bf191bc2f11f9e3a6ab'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:56.101386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-229a8116-7f50-496b-aa5c-017b32e3d55c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549b516986024bf191bc2f11f9e3a6ab'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:56.117099 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-229a8116-7f50-496b-aa5c-017b32e3d55c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549b516986024bf191bc2f11f9e3a6ab'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:56.117099 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-229a8116-7f50-496b-aa5c-017b32e3d55c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549b516986024bf191bc2f11f9e3a6ab'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:56.241018 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1054/2132] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:55 2022] DELETE /identity/v3/users/549b516986024bf191bc2f11f9e3a6ab => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:56.248264 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa4945-756c-48b4-bf94-ef0a39539466 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:56.248660 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa4945-756c-48b4-bf94-ef0a39539466 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:56.249029 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa4945-756c-48b4-bf94-ef0a39539466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:56.268915 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-5caa4945-756c-48b4-bf94-ef0a39539466 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:56.275954 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5caa4945-756c-48b4-bf94-ef0a39539466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:56.295675 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:56.368532 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1079/2133] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:56.370959 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a8116-7f50-496b-aa5c-017b32e3d55c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:56.372797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-229a8116-7f50-496b-aa5c-017b32e3d55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:56.378575 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa4945-756c-48b4-bf94-ef0a39539466 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:56.380300 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5caa4945-756c-48b4-bf94-ef0a39539466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:56.435165 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a8116-7f50-496b-aa5c-017b32e3d55c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:56.440382 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304dd08-0175-4311-a39f-f7917b0a15dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:56.441115 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304dd08-0175-4311-a39f-f7917b0a15dc service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:56.441449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304dd08-0175-4311-a39f-f7917b0a15dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:56.441746 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304dd08-0175-4311-a39f-f7917b0a15dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:56.442633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa4945-756c-48b4-bf94-ef0a39539466 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:56.443710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b304dd08-0175-4311-a39f-f7917b0a15dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:56.446455 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3524a9-e87a-4368-9215-2d3e1e56e793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:56.447146 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3524a9-e87a-4368-9215-2d3e1e56e793 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:56.447357 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3524a9-e87a-4368-9215-2d3e1e56e793 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:56.447648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3524a9-e87a-4368-9215-2d3e1e56e793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:56.458105 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3524a9-e87a-4368-9215-2d3e1e56e793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:56.459567 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3524a9-e87a-4368-9215-2d3e1e56e793 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:56.469996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1080/2134] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:06:56.484744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:56.516003 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304dd08-0175-4311-a39f-f7917b0a15dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:56.517658 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304dd08-0175-4311-a39f-f7917b0a15dc service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:56.528415 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1055/2135] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:56.711391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:56.943523 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3524a9-e87a-4368-9215-2d3e1e56e793 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:56.945258 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6b3524a9-e87a-4368-9215-2d3e1e56e793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:56.962416 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3524a9-e87a-4368-9215-2d3e1e56e793 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:56.967624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9496e-230d-4d85-94c0-bab53b5fc79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:56.968273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9496e-230d-4d85-94c0-bab53b5fc79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:56.968556 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9496e-230d-4d85-94c0-bab53b5fc79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:56.968877 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9496e-230d-4d85-94c0-bab53b5fc79f admin admin] PATH_INFO: `/v3/projects/7e2de75896ba4fc8a2c53daa2c4ba187` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:56.970041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9496e-230d-4d85-94c0-bab53b5fc79f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e2de75896ba4fc8a2c53daa2c4ba187)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:56.972026 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9496e-230d-4d85-94c0-bab53b5fc79f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:57.147201 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-53e9496e-230d-4d85-94c0-bab53b5fc79f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e2de75896ba4fc8a2c53daa2c4ba187', 'request_id': 'req-53e9496e-230d-4d85-94c0-bab53b5fc79f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:57.223476 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:57.225533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-53e9496e-230d-4d85-94c0-bab53b5fc79f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e2de75896ba4fc8a2c53daa2c4ba187', 'request_id': 'req-53e9496e-230d-4d85-94c0-bab53b5fc79f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:57.232910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-53e9496e-230d-4d85-94c0-bab53b5fc79f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e2de75896ba4fc8a2c53daa2c4ba187', 'request_id': 'req-53e9496e-230d-4d85-94c0-bab53b5fc79f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:57.247123 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-53e9496e-230d-4d85-94c0-bab53b5fc79f admin admin] The token cache is being invalidate because project 7e2de75896ba4fc8a2c53daa2c4ba187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:57.247123 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-53e9496e-230d-4d85-94c0-bab53b5fc79f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:57.247333 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-53e9496e-230d-4d85-94c0-bab53b5fc79f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:57.248915 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1081/2136] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:56 2022] DELETE /identity/v3/projects/7e2de75896ba4fc8a2c53daa2c4ba187 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:57.586922 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:57.905471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:57.945415 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:58.384160 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304dd08-0175-4311-a39f-f7917b0a15dc service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:58.396486 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304dd08-0175-4311-a39f-f7917b0a15dc service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:58.448958 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629ffcb-85d0-4fa7-a877-9dfb256f539c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:58.449576 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629ffcb-85d0-4fa7-a877-9dfb256f539c service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:58.449857 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629ffcb-85d0-4fa7-a877-9dfb256f539c service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:58.450129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629ffcb-85d0-4fa7-a877-9dfb256f539c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:58.451904 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8629ffcb-85d0-4fa7-a877-9dfb256f539c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:58.517398 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629ffcb-85d0-4fa7-a877-9dfb256f539c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:58.518851 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629ffcb-85d0-4fa7-a877-9dfb256f539c service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:58.529236 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1056/2137] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:58.569840 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:58.649812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:59.239006 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:59.317673 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:59.541337 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:59.602740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:00.025455 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:00.111614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:00.384690 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9496e-230d-4d85-94c0-bab53b5fc79f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:00.386234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-53e9496e-230d-4d85-94c0-bab53b5fc79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:00.400098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9496e-230d-4d85-94c0-bab53b5fc79f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:00.403801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b0bec-111d-4103-b367-7597dbdee3c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:00.404413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b0bec-111d-4103-b367-7597dbdee3c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:00.404687 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b0bec-111d-4103-b367-7597dbdee3c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:00.404986 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b0bec-111d-4103-b367-7597dbdee3c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:00.406894 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0b3b0bec-111d-4103-b367-7597dbdee3c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:00.479175 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:00.483455 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b0bec-111d-4103-b367-7597dbdee3c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:00.483455 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b0bec-111d-4103-b367-7597dbdee3c6 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:00.494096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1082/2138] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:07:00.520806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629ffcb-85d0-4fa7-a877-9dfb256f539c service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:00.522267 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8629ffcb-85d0-4fa7-a877-9dfb256f539c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:00.534393 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629ffcb-85d0-4fa7-a877-9dfb256f539c service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:00.538834 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc0d56-a41e-4d61-8dbc-c3d5a58064e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:00.539508 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc0d56-a41e-4d61-8dbc-c3d5a58064e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:00.539845 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc0d56-a41e-4d61-8dbc-c3d5a58064e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:00.540127 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc0d56-a41e-4d61-8dbc-c3d5a58064e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:00.541907 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-79cc0d56-a41e-4d61-8dbc-c3d5a58064e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:00.548721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:00.613897 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc0d56-a41e-4d61-8dbc-c3d5a58064e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:00.615890 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc0d56-a41e-4d61-8dbc-c3d5a58064e7 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:00.636167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1057/2139] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:07:00.934479 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:01.297252 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:01.753256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:01.861571 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:02.478997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:02.591315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:02.764310 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:02.827204 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:04.159021 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:04.319292 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:04.873250 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:05.147357 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:05.621834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c782671-9f1b-4316-9c46-fe94ed918d05 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:05.622897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c782671-9f1b-4316-9c46-fe94ed918d05 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:05.623396 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c782671-9f1b-4316-9c46-fe94ed918d05 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:05.625266 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1083/2140] 10.222.0.75 () {54 vars in 921 bytes} [Thu Jul 28 18:07:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:07:05.681864 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271a1ea-8956-4a80-916a-c12665656481 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:05.682378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271a1ea-8956-4a80-916a-c12665656481 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:05.682466 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271a1ea-8956-4a80-916a-c12665656481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:05.702697 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a271a1ea-8956-4a80-916a-c12665656481 None None] MFA Rules not processed for user `cff43a72eaef462f86426ad3ceccd3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:05.704095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a271a1ea-8956-4a80-916a-c12665656481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:05.772031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1058/2141] 10.222.0.75 () {58 vars in 1018 bytes} [Thu Jul 28 18:07:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:07:05.798817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:05.806411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c782671-9f1b-4316-9c46-fe94ed918d05 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:05.808398 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8c782671-9f1b-4316-9c46-fe94ed918d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:05.829070 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c782671-9f1b-4316-9c46-fe94ed918d05 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:05.831941 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271a1ea-8956-4a80-916a-c12665656481 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:05.833495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a271a1ea-8956-4a80-916a-c12665656481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:05.835803 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1f970-614a-49e4-b5e8-6adef8fe8ee2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff43a72eaef462f86426ad3ceccd3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:05.836527 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1f970-614a-49e4-b5e8-6adef8fe8ee2 service placement] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:05.838266 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1f970-614a-49e4-b5e8-6adef8fe8ee2 service placement] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:05.838266 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1f970-614a-49e4-b5e8-6adef8fe8ee2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:05.870601 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1f970-614a-49e4-b5e8-6adef8fe8ee2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:05.872564 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1f970-614a-49e4-b5e8-6adef8fe8ee2 service placement] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:05.895865 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1084/2142] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:07:05.898597 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1f970-614a-49e4-b5e8-6adef8fe8ee2 service placement] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:05.903252 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-45e1f970-614a-49e4-b5e8-6adef8fe8ee2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:05.912286 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271a1ea-8956-4a80-916a-c12665656481 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:05.923826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1f970-614a-49e4-b5e8-6adef8fe8ee2 service placement] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:05.924625 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37af883-2468-44d1-8529-d30c6ea6be02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:05.925325 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37af883-2468-44d1-8529-d30c6ea6be02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:05.925609 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37af883-2468-44d1-8529-d30c6ea6be02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:05.926437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37af883-2468-44d1-8529-d30c6ea6be02 admin admin] PATH_INFO: `/v3/users/8f0f26e3ceae4dfbbe204e61b8889704` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:05.927699 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37af883-2468-44d1-8529-d30c6ea6be02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0f26e3ceae4dfbbe204e61b8889704)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:05.929696 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37af883-2468-44d1-8529-d30c6ea6be02 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:05.945883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc02b9-ced2-45cb-ab7c-41558d208727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:05.946558 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc02b9-ced2-45cb-ab7c-41558d208727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:05.947247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc02b9-ced2-45cb-ab7c-41558d208727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:05.947539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc02b9-ced2-45cb-ab7c-41558d208727 admin admin] PATH_INFO: `/v3/users/3a7b60d360154e5a912b165845acf6b3` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:05.948853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc02b9-ced2-45cb-ab7c-41558d208727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a7b60d360154e5a912b165845acf6b3)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:05.950971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc02b9-ced2-45cb-ab7c-41558d208727 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:05.969025 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:06.166929 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d37af883-2468-44d1-8529-d30c6ea6be02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0f26e3ceae4dfbbe204e61b8889704'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:06.167635 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d37af883-2468-44d1-8529-d30c6ea6be02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0f26e3ceae4dfbbe204e61b8889704'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:06.181228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d37af883-2468-44d1-8529-d30c6ea6be02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0f26e3ceae4dfbbe204e61b8889704'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:06.188320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d37af883-2468-44d1-8529-d30c6ea6be02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0f26e3ceae4dfbbe204e61b8889704'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:06.189068 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d37af883-2468-44d1-8529-d30c6ea6be02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0f26e3ceae4dfbbe204e61b8889704'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:06.252968 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d5fc02b9-ced2-45cb-ab7c-41558d208727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a7b60d360154e5a912b165845acf6b3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:06.278069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1059/2143] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:07:05 2022] DELETE /identity/v3/users/8f0f26e3ceae4dfbbe204e61b8889704 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:06.282854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c8b4d-3188-40ad-b942-9174a6ff2f70 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:06.283088 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c8b4d-3188-40ad-b942-9174a6ff2f70 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:06.283375 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c8b4d-3188-40ad-b942-9174a6ff2f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:06.303323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-206c8b4d-3188-40ad-b942-9174a6ff2f70 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:06.304542 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-206c8b4d-3188-40ad-b942-9174a6ff2f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:06.366426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1060/2144] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:07:06.375888 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c8b4d-3188-40ad-b942-9174a6ff2f70 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:06.377420 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-206c8b4d-3188-40ad-b942-9174a6ff2f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:06.382188 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d5fc02b9-ced2-45cb-ab7c-41558d208727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a7b60d360154e5a912b165845acf6b3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:06.399032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d5fc02b9-ced2-45cb-ab7c-41558d208727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a7b60d360154e5a912b165845acf6b3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:06.407092 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d5fc02b9-ced2-45cb-ab7c-41558d208727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a7b60d360154e5a912b165845acf6b3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:06.407928 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d5fc02b9-ced2-45cb-ab7c-41558d208727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a7b60d360154e5a912b165845acf6b3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:06.414895 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1085/2145] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:07:05 2022] DELETE /identity/v3/users/3a7b60d360154e5a912b165845acf6b3 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:06.475770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c8b4d-3188-40ad-b942-9174a6ff2f70 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:06.543365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60b9d5-a87c-4790-aa2c-fd8b47187d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:06.543991 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60b9d5-a87c-4790-aa2c-fd8b47187d90 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:06.544744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60b9d5-a87c-4790-aa2c-fd8b47187d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:06.545066 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60b9d5-a87c-4790-aa2c-fd8b47187d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:06.546971 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fe60b9d5-a87c-4790-aa2c-fd8b47187d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:06.620249 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60b9d5-a87c-4790-aa2c-fd8b47187d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:06.621775 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60b9d5-a87c-4790-aa2c-fd8b47187d90 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:06.632099 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1061/2146] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:07:06.687050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc02b9-ced2-45cb-ab7c-41558d208727 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:06.689083 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d5fc02b9-ced2-45cb-ab7c-41558d208727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:06.708056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc02b9-ced2-45cb-ab7c-41558d208727 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:06.714518 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11e405-350c-4016-a807-804eb093b832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:06.715918 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11e405-350c-4016-a807-804eb093b832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:06.716208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11e405-350c-4016-a807-804eb093b832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:06.716541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11e405-350c-4016-a807-804eb093b832 admin admin] PATH_INFO: `/v3/projects/bd5e8c19707d491f8c5c75d45f0a0c75` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:06.718350 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11e405-350c-4016-a807-804eb093b832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd5e8c19707d491f8c5c75d45f0a0c75)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:06.721019 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11e405-350c-4016-a807-804eb093b832 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:06.853540 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-be11e405-350c-4016-a807-804eb093b832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd5e8c19707d491f8c5c75d45f0a0c75', 'request_id': 'req-be11e405-350c-4016-a807-804eb093b832'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:06.957561 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-be11e405-350c-4016-a807-804eb093b832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd5e8c19707d491f8c5c75d45f0a0c75', 'request_id': 'req-be11e405-350c-4016-a807-804eb093b832'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:06.965397 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-be11e405-350c-4016-a807-804eb093b832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd5e8c19707d491f8c5c75d45f0a0c75', 'request_id': 'req-be11e405-350c-4016-a807-804eb093b832'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:06.981177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-be11e405-350c-4016-a807-804eb093b832 admin admin] The token cache is being invalidate because project bd5e8c19707d491f8c5c75d45f0a0c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:07:06.981486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-be11e405-350c-4016-a807-804eb093b832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:06.982532 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-be11e405-350c-4016-a807-804eb093b832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:06.984360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1086/2147] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:07:06 2022] DELETE /identity/v3/projects/bd5e8c19707d491f8c5c75d45f0a0c75 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:06.989701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab74c44-8efc-475a-a860-41a5ef76333a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:06.990242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab74c44-8efc-475a-a860-41a5ef76333a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:06.990343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab74c44-8efc-475a-a860-41a5ef76333a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:07.012479 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4ab74c44-8efc-475a-a860-41a5ef76333a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:07.013974 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4ab74c44-8efc-475a-a860-41a5ef76333a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:07.074147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1062/2148] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:07:07.081644 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f374ce0-9516-4505-932b-4b129445e6d2 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:07.082030 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f374ce0-9516-4505-932b-4b129445e6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:07.082838 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f374ce0-9516-4505-932b-4b129445e6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:07.103224 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-9f374ce0-9516-4505-932b-4b129445e6d2 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:07.104452 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9f374ce0-9516-4505-932b-4b129445e6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:07.113261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:07.113507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1087/2149] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:07:07.117578 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab74c44-8efc-475a-a860-41a5ef76333a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:07.122208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f374ce0-9516-4505-932b-4b129445e6d2 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:07.124180 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9f374ce0-9516-4505-932b-4b129445e6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:07.129343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab74c44-8efc-475a-a860-41a5ef76333a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:07.135908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b35ceb-a0a3-4b7e-94ff-35050c57c5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:07.136414 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b35ceb-a0a3-4b7e-94ff-35050c57c5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:07.136693 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b35ceb-a0a3-4b7e-94ff-35050c57c5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:07.137000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b35ceb-a0a3-4b7e-94ff-35050c57c5e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:07.137992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b35ceb-a0a3-4b7e-94ff-35050c57c5e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:07:07.138159 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b35ceb-a0a3-4b7e-94ff-35050c57c5e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:07.139553 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f374ce0-9516-4505-932b-4b129445e6d2 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:07.145531 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bfc4c-e14b-4445-8679-d3c4669b4a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:07.146328 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bfc4c-e14b-4445-8679-d3c4669b4a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:07.146814 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bfc4c-e14b-4445-8679-d3c4669b4a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:07.147277 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bfc4c-e14b-4445-8679-d3c4669b4a04 admin admin] PATH_INFO: `/v3/projects/ce1373d80ed948bfb28334ad208c35b3` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:07.148730 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17bfc4c-e14b-4445-8679-d3c4669b4a04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1373d80ed948bfb28334ad208c35b3)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:07.150724 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b35ceb-a0a3-4b7e-94ff-35050c57c5e5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:07.150866 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17bfc4c-e14b-4445-8679-d3c4669b4a04 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:07.172010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1063/2150] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:07:07.177133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b35ceb-a0a3-4b7e-94ff-35050c57c5e5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:07.189743 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b35ceb-a0a3-4b7e-94ff-35050c57c5e5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:07.194259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce710d-b1ea-49c9-a223-ebd824122309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:07.194816 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce710d-b1ea-49c9-a223-ebd824122309 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:07.195083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce710d-b1ea-49c9-a223-ebd824122309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:07.195355 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce710d-b1ea-49c9-a223-ebd824122309 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:07.196039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce710d-b1ea-49c9-a223-ebd824122309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:07.198062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce710d-b1ea-49c9-a223-ebd824122309 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:07.329061 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e17bfc4c-e14b-4445-8679-d3c4669b4a04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1373d80ed948bfb28334ad208c35b3', 'request_id': 'req-e17bfc4c-e14b-4445-8679-d3c4669b4a04'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:07.347323 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:07.354325 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1064/2151] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:07:07 2022] POST /identity/v3/projects => generated 393 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:07:07.358405 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce710d-b1ea-49c9-a223-ebd824122309 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:07.419089 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce710d-b1ea-49c9-a223-ebd824122309 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:07.424212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1ea52-7240-404f-a2c9-3367dbfb01e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:07.424867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1ea52-7240-404f-a2c9-3367dbfb01e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:07.425155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1ea52-7240-404f-a2c9-3367dbfb01e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:07.425436 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1ea52-7240-404f-a2c9-3367dbfb01e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:07.426660 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1ea52-7240-404f-a2c9-3367dbfb01e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:07.428572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1ea52-7240-404f-a2c9-3367dbfb01e5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:07.448246 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e17bfc4c-e14b-4445-8679-d3c4669b4a04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1373d80ed948bfb28334ad208c35b3', 'request_id': 'req-e17bfc4c-e14b-4445-8679-d3c4669b4a04'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:07.450885 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e17bfc4c-e14b-4445-8679-d3c4669b4a04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1373d80ed948bfb28334ad208c35b3', 'request_id': 'req-e17bfc4c-e14b-4445-8679-d3c4669b4a04'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:07.462038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e17bfc4c-e14b-4445-8679-d3c4669b4a04 admin admin] The token cache is being invalidate because project ce1373d80ed948bfb28334ad208c35b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:07:07.462341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e17bfc4c-e14b-4445-8679-d3c4669b4a04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:07.462984 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e17bfc4c-e14b-4445-8679-d3c4669b4a04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:07.464511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1088/2152] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:07:07 2022] DELETE /identity/v3/projects/ce1373d80ed948bfb28334ad208c35b3 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:07:07.468650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bfc4c-e14b-4445-8679-d3c4669b4a04 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:07.469974 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e17bfc4c-e14b-4445-8679-d3c4669b4a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:07.534813 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bfc4c-e14b-4445-8679-d3c4669b4a04 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:07.539667 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e03f66-3ff9-4c0d-b400-582254504539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:07.540316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e03f66-3ff9-4c0d-b400-582254504539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:07.540605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e03f66-3ff9-4c0d-b400-582254504539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:07.540924 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e03f66-3ff9-4c0d-b400-582254504539 admin admin] PATH_INFO: `/v3/users/c3926429b0b9423abb1bf64e001535b9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:07.542139 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e03f66-3ff9-4c0d-b400-582254504539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3926429b0b9423abb1bf64e001535b9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:07.544134 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e03f66-3ff9-4c0d-b400-582254504539 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:07.561357 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1065/2153] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:07:07 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:07:07.568678 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1ea52-7240-404f-a2c9-3367dbfb01e5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:07.568678 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c3a1ea52-7240-404f-a2c9-3367dbfb01e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:07.581276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1ea52-7240-404f-a2c9-3367dbfb01e5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:07.586940 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de228982-23cb-4fe3-9897-7fe490d94136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:07.587598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de228982-23cb-4fe3-9897-7fe490d94136 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:07.587875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de228982-23cb-4fe3-9897-7fe490d94136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:07.588149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de228982-23cb-4fe3-9897-7fe490d94136 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:07.588892 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de228982-23cb-4fe3-9897-7fe490d94136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:07.590487 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de228982-23cb-4fe3-9897-7fe490d94136 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:07.601716 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1066/2154] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:07:07.605601 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de228982-23cb-4fe3-9897-7fe490d94136 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:07.616850 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de228982-23cb-4fe3-9897-7fe490d94136 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:07.621561 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9918307-b906-41d7-a6ea-6feb9d70c946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:07.622198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9918307-b906-41d7-a6ea-6feb9d70c946 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:07.622487 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9918307-b906-41d7-a6ea-6feb9d70c946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:07.622764 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9918307-b906-41d7-a6ea-6feb9d70c946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:07.623453 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9918307-b906-41d7-a6ea-6feb9d70c946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:07.625077 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9918307-b906-41d7-a6ea-6feb9d70c946 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:07.636135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1067/2155] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:07:07.640159 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9918307-b906-41d7-a6ea-6feb9d70c946 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:07.649717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9918307-b906-41d7-a6ea-6feb9d70c946 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:07.654261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963507ca-7723-4b82-9c31-0dda8075b037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:07.654889 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963507ca-7723-4b82-9c31-0dda8075b037 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:07.655175 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963507ca-7723-4b82-9c31-0dda8075b037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:07.655456 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963507ca-7723-4b82-9c31-0dda8075b037 admin admin] PATH_INFO: `/v3/projects/c2fcb2737de84d1594f4d46684f00f34/users/6811352e7e4e44fcb5598bc5d900e0a7/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:07.670065 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963507ca-7723-4b82-9c31-0dda8075b037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2fcb2737de84d1594f4d46684f00f34, user_id=6811352e7e4e44fcb5598bc5d900e0a7, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:07.672894 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963507ca-7723-4b82-9c31-0dda8075b037 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:07.805628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1068/2156] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:07:07 2022] PUT /identity/v3/projects/c2fcb2737de84d1594f4d46684f00f34/users/6811352e7e4e44fcb5598bc5d900e0a7/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:07:07.810401 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe493c-70e9-48d1-9854-8ef56bccadf6 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:07.810687 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe493c-70e9-48d1-9854-8ef56bccadf6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:07.810967 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe493c-70e9-48d1-9854-8ef56bccadf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:07.829530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-5ebe493c-70e9-48d1-9854-8ef56bccadf6 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:07.830729 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5ebe493c-70e9-48d1-9854-8ef56bccadf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:07.889470 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1069/2157] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:07:07.893236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a0e03f66-3ff9-4c0d-b400-582254504539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3926429b0b9423abb1bf64e001535b9'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:07.901890 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe493c-70e9-48d1-9854-8ef56bccadf6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:07.903290 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5ebe493c-70e9-48d1-9854-8ef56bccadf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:07.960283 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe493c-70e9-48d1-9854-8ef56bccadf6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:07.963963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662ace0-07f8-453d-8ae5-3442e99b857e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:07.964745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662ace0-07f8-453d-8ae5-3442e99b857e service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:07.965057 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662ace0-07f8-453d-8ae5-3442e99b857e service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:07.965331 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662ace0-07f8-453d-8ae5-3442e99b857e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:07.976686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662ace0-07f8-453d-8ae5-3442e99b857e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:07.978140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662ace0-07f8-453d-8ae5-3442e99b857e service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:07.980727 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a0e03f66-3ff9-4c0d-b400-582254504539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3926429b0b9423abb1bf64e001535b9'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:07.990243 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1070/2158] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:07:07.996406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a0e03f66-3ff9-4c0d-b400-582254504539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3926429b0b9423abb1bf64e001535b9'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:08.005765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a0e03f66-3ff9-4c0d-b400-582254504539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3926429b0b9423abb1bf64e001535b9'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:08.006898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a0e03f66-3ff9-4c0d-b400-582254504539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3926429b0b9423abb1bf64e001535b9'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:08.013849 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1089/2159] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:07:07 2022] DELETE /identity/v3/users/c3926429b0b9423abb1bf64e001535b9 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:07:08.015069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662ace0-07f8-453d-8ae5-3442e99b857e service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:08.018146 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6662ace0-07f8-453d-8ae5-3442e99b857e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:08.031625 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662ace0-07f8-453d-8ae5-3442e99b857e service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:08.089749 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206bf62-7c16-4e8b-9544-df0e1ee43acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:08.090319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206bf62-7c16-4e8b-9544-df0e1ee43acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:08.090855 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206bf62-7c16-4e8b-9544-df0e1ee43acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:08.090855 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206bf62-7c16-4e8b-9544-df0e1ee43acd admin admin] PATH_INFO: `/v3/users/7ab4b7e7e6e548eba0d323d86f10ac75` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:08.092034 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206bf62-7c16-4e8b-9544-df0e1ee43acd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab4b7e7e6e548eba0d323d86f10ac75)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:08.094290 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206bf62-7c16-4e8b-9544-df0e1ee43acd admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:08.329286 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0206bf62-7c16-4e8b-9544-df0e1ee43acd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab4b7e7e6e548eba0d323d86f10ac75'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:08.330240 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0206bf62-7c16-4e8b-9544-df0e1ee43acd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab4b7e7e6e548eba0d323d86f10ac75'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:08.344705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0206bf62-7c16-4e8b-9544-df0e1ee43acd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab4b7e7e6e548eba0d323d86f10ac75'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:08.353943 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0206bf62-7c16-4e8b-9544-df0e1ee43acd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab4b7e7e6e548eba0d323d86f10ac75'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:08.356512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0206bf62-7c16-4e8b-9544-df0e1ee43acd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab4b7e7e6e548eba0d323d86f10ac75'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:08.381666 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:08.466838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1071/2160] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:07:08 2022] DELETE /identity/v3/users/7ab4b7e7e6e548eba0d323d86f10ac75 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:08.471348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f252d-8e09-455c-99e8-6b299d9c719d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:08.471643 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f252d-8e09-455c-99e8-6b299d9c719d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:08.471928 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f252d-8e09-455c-99e8-6b299d9c719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:08.491967 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-ae3f252d-8e09-455c-99e8-6b299d9c719d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:08.493208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ae3f252d-8e09-455c-99e8-6b299d9c719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:08.521338 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206bf62-7c16-4e8b-9544-df0e1ee43acd admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:08.522779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0206bf62-7c16-4e8b-9544-df0e1ee43acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:08.567096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1090/2161] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:08.575961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f252d-8e09-455c-99e8-6b299d9c719d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:08.577450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ae3f252d-8e09-455c-99e8-6b299d9c719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:08.609221 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206bf62-7c16-4e8b-9544-df0e1ee43acd admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:08.614786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e561f-8faa-42b3-b0e9-ab48ca0c2af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:08.615478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e561f-8faa-42b3-b0e9-ab48ca0c2af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:08.616021 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e561f-8faa-42b3-b0e9-ab48ca0c2af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:08.616295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e561f-8faa-42b3-b0e9-ab48ca0c2af5 admin admin] PATH_INFO: `/v3/projects/b14ed1cf1487496b84f795ef13e44647` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:08.617541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e561f-8faa-42b3-b0e9-ab48ca0c2af5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b14ed1cf1487496b84f795ef13e44647)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:08.619639 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e561f-8faa-42b3-b0e9-ab48ca0c2af5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:08.647149 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f252d-8e09-455c-99e8-6b299d9c719d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:08.650967 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd48653-2841-4249-8b49-e2c348040726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:08.652995 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd48653-2841-4249-8b49-e2c348040726 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:08.652995 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd48653-2841-4249-8b49-e2c348040726 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:08.652995 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd48653-2841-4249-8b49-e2c348040726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:08.661921 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd48653-2841-4249-8b49-e2c348040726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:08.663408 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd48653-2841-4249-8b49-e2c348040726 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:08.672739 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1091/2162] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:07:08.707502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:08.861833 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d10e561f-8faa-42b3-b0e9-ab48ca0c2af5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b14ed1cf1487496b84f795ef13e44647', 'request_id': 'req-d10e561f-8faa-42b3-b0e9-ab48ca0c2af5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:08.868043 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d10e561f-8faa-42b3-b0e9-ab48ca0c2af5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b14ed1cf1487496b84f795ef13e44647', 'request_id': 'req-d10e561f-8faa-42b3-b0e9-ab48ca0c2af5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:08.874272 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d10e561f-8faa-42b3-b0e9-ab48ca0c2af5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b14ed1cf1487496b84f795ef13e44647', 'request_id': 'req-d10e561f-8faa-42b3-b0e9-ab48ca0c2af5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:09.026463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d10e561f-8faa-42b3-b0e9-ab48ca0c2af5 admin admin] The token cache is being invalidate because project b14ed1cf1487496b84f795ef13e44647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:07:09.027054 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d10e561f-8faa-42b3-b0e9-ab48ca0c2af5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:09.027570 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d10e561f-8faa-42b3-b0e9-ab48ca0c2af5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:09.029755 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1072/2163] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:07:08 2022] DELETE /identity/v3/projects/b14ed1cf1487496b84f795ef13e44647 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:09.033925 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd48653-2841-4249-8b49-e2c348040726 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:09.044517 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd48653-2841-4249-8b49-e2c348040726 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:09.106861 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba70e0-ff0b-4867-a0ef-61985ba13512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:09.107586 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba70e0-ff0b-4867-a0ef-61985ba13512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:09.107872 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba70e0-ff0b-4867-a0ef-61985ba13512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:09.108147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba70e0-ff0b-4867-a0ef-61985ba13512 admin admin] PATH_INFO: `/v3/users/ec4d7923956448a48a4263d94e9fd5c9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:09.109410 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba70e0-ff0b-4867-a0ef-61985ba13512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec4d7923956448a48a4263d94e9fd5c9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:09.111569 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba70e0-ff0b-4867-a0ef-61985ba13512 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:09.373354 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f3ba70e0-ff0b-4867-a0ef-61985ba13512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec4d7923956448a48a4263d94e9fd5c9'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:09.448363 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e561f-8faa-42b3-b0e9-ab48ca0c2af5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:09.449837 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d10e561f-8faa-42b3-b0e9-ab48ca0c2af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:09.464001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e561f-8faa-42b3-b0e9-ab48ca0c2af5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:09.470146 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49551dd-8c1b-4f34-be0a-1a6236652439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:09.471029 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49551dd-8c1b-4f34-be0a-1a6236652439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:09.473672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49551dd-8c1b-4f34-be0a-1a6236652439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:09.473837 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f3ba70e0-ff0b-4867-a0ef-61985ba13512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec4d7923956448a48a4263d94e9fd5c9'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:09.482217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49551dd-8c1b-4f34-be0a-1a6236652439 admin admin] PATH_INFO: `/v3/projects/0e2b0e5eb61749378ba30079d1b2f1cd` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:09.482217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49551dd-8c1b-4f34-be0a-1a6236652439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e2b0e5eb61749378ba30079d1b2f1cd)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:09.482217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49551dd-8c1b-4f34-be0a-1a6236652439 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:09.490605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f3ba70e0-ff0b-4867-a0ef-61985ba13512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec4d7923956448a48a4263d94e9fd5c9'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:09.499225 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f3ba70e0-ff0b-4867-a0ef-61985ba13512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec4d7923956448a48a4263d94e9fd5c9'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:09.500061 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f3ba70e0-ff0b-4867-a0ef-61985ba13512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec4d7923956448a48a4263d94e9fd5c9'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:09.507600 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1092/2164] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:07:09 2022] DELETE /identity/v3/users/ec4d7923956448a48a4263d94e9fd5c9 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:09.633986 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f49551dd-8c1b-4f34-be0a-1a6236652439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e2b0e5eb61749378ba30079d1b2f1cd', 'request_id': 'req-f49551dd-8c1b-4f34-be0a-1a6236652439'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:09.639567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f49551dd-8c1b-4f34-be0a-1a6236652439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e2b0e5eb61749378ba30079d1b2f1cd', 'request_id': 'req-f49551dd-8c1b-4f34-be0a-1a6236652439'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:09.646543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f49551dd-8c1b-4f34-be0a-1a6236652439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e2b0e5eb61749378ba30079d1b2f1cd', 'request_id': 'req-f49551dd-8c1b-4f34-be0a-1a6236652439'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:09.747048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f49551dd-8c1b-4f34-be0a-1a6236652439 admin admin] The token cache is being invalidate because project 0e2b0e5eb61749378ba30079d1b2f1cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:07:09.747385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f49551dd-8c1b-4f34-be0a-1a6236652439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:09.748017 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f49551dd-8c1b-4f34-be0a-1a6236652439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:09.749767 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1073/2165] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:07:09 2022] DELETE /identity/v3/projects/0e2b0e5eb61749378ba30079d1b2f1cd => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:07:09.754571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba70e0-ff0b-4867-a0ef-61985ba13512 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:09.756165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f3ba70e0-ff0b-4867-a0ef-61985ba13512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:09.822499 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba70e0-ff0b-4867-a0ef-61985ba13512 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:09.878069 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2855b98-bd62-46ea-be4d-080639198ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:09.878721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2855b98-bd62-46ea-be4d-080639198ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:09.879560 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2855b98-bd62-46ea-be4d-080639198ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:09.879841 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2855b98-bd62-46ea-be4d-080639198ea3 admin admin] PATH_INFO: `/v3/users/50afb9f7d2384218986f721f0e031531` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:09.881083 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2855b98-bd62-46ea-be4d-080639198ea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50afb9f7d2384218986f721f0e031531)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:09.883263 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2855b98-bd62-46ea-be4d-080639198ea3 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:10.030152 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49551dd-8c1b-4f34-be0a-1a6236652439 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:10.032228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f49551dd-8c1b-4f34-be0a-1a6236652439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:10.045976 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49551dd-8c1b-4f34-be0a-1a6236652439 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:10.052305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507009e3-1c57-4ccc-9a14-309fedbf5a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:10.053241 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507009e3-1c57-4ccc-9a14-309fedbf5a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:10.053527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507009e3-1c57-4ccc-9a14-309fedbf5a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:10.053828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507009e3-1c57-4ccc-9a14-309fedbf5a4c admin admin] PATH_INFO: `/v3/projects/e31e6b2330bf4f94a1ebd011a3efb352` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:10.055046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507009e3-1c57-4ccc-9a14-309fedbf5a4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e31e6b2330bf4f94a1ebd011a3efb352)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:10.057026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507009e3-1c57-4ccc-9a14-309fedbf5a4c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:10.187214 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:10.253810 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-507009e3-1c57-4ccc-9a14-309fedbf5a4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e31e6b2330bf4f94a1ebd011a3efb352', 'request_id': 'req-507009e3-1c57-4ccc-9a14-309fedbf5a4c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:10.260044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-507009e3-1c57-4ccc-9a14-309fedbf5a4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e31e6b2330bf4f94a1ebd011a3efb352', 'request_id': 'req-507009e3-1c57-4ccc-9a14-309fedbf5a4c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:10.267096 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-507009e3-1c57-4ccc-9a14-309fedbf5a4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e31e6b2330bf4f94a1ebd011a3efb352', 'request_id': 'req-507009e3-1c57-4ccc-9a14-309fedbf5a4c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:10.270952 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a2855b98-bd62-46ea-be4d-080639198ea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50afb9f7d2384218986f721f0e031531'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:10.285771 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:10.364680 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-507009e3-1c57-4ccc-9a14-309fedbf5a4c admin admin] The token cache is being invalidate because project e31e6b2330bf4f94a1ebd011a3efb352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:07:10.364903 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-507009e3-1c57-4ccc-9a14-309fedbf5a4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:10.365497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-507009e3-1c57-4ccc-9a14-309fedbf5a4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:10.368105 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1074/2166] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:07:10 2022] DELETE /identity/v3/projects/e31e6b2330bf4f94a1ebd011a3efb352 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:07:10.372175 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e9112-8fc6-4442-80d1-b7ac856e37e8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:10.372464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e9112-8fc6-4442-80d1-b7ac856e37e8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:10.372768 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e9112-8fc6-4442-80d1-b7ac856e37e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:10.393215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d38e9112-8fc6-4442-80d1-b7ac856e37e8 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:10.395128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d38e9112-8fc6-4442-80d1-b7ac856e37e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:10.449497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a2855b98-bd62-46ea-be4d-080639198ea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50afb9f7d2384218986f721f0e031531'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:10.460377 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1075/2167] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:07:10.468451 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a2855b98-bd62-46ea-be4d-080639198ea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50afb9f7d2384218986f721f0e031531'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:10.470133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f75de4-298d-41e5-a87e-9c895cb6800e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:10.470426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f75de4-298d-41e5-a87e-9c895cb6800e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:10.470705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f75de4-298d-41e5-a87e-9c895cb6800e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:10.476649 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a2855b98-bd62-46ea-be4d-080639198ea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50afb9f7d2384218986f721f0e031531'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:10.477446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a2855b98-bd62-46ea-be4d-080639198ea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50afb9f7d2384218986f721f0e031531'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:10.484309 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1093/2168] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:07:09 2022] DELETE /identity/v3/users/50afb9f7d2384218986f721f0e031531 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:10.497384 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e2f75de4-298d-41e5-a87e-9c895cb6800e None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:10.498788 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e2f75de4-298d-41e5-a87e-9c895cb6800e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:10.565013 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1076/2169] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:10.569756 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2855b98-bd62-46ea-be4d-080639198ea3 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:10.580333 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2855b98-bd62-46ea-be4d-080639198ea3 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:10.588166 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510ec2d-bbeb-4cc0-87d5-05a1be0a4f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:10.588946 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510ec2d-bbeb-4cc0-87d5-05a1be0a4f7a admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:10.589307 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510ec2d-bbeb-4cc0-87d5-05a1be0a4f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:10.589660 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510ec2d-bbeb-4cc0-87d5-05a1be0a4f7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:10.590505 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510ec2d-bbeb-4cc0-87d5-05a1be0a4f7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:07:10.591572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510ec2d-bbeb-4cc0-87d5-05a1be0a4f7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:10.593821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510ec2d-bbeb-4cc0-87d5-05a1be0a4f7a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:10.608785 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1094/2170] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:07:10.612468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f75de4-298d-41e5-a87e-9c895cb6800e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:10.622345 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f75de4-298d-41e5-a87e-9c895cb6800e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:10.628991 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085654c7-963d-4a90-99ae-fc80d9256c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:10.629828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085654c7-963d-4a90-99ae-fc80d9256c25 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:10.630182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085654c7-963d-4a90-99ae-fc80d9256c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:10.630529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085654c7-963d-4a90-99ae-fc80d9256c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:10.632852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085654c7-963d-4a90-99ae-fc80d9256c25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:10.633324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085654c7-963d-4a90-99ae-fc80d9256c25 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:10.744206 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1077/2171] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:07:10 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:07:10.747960 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510ec2d-bbeb-4cc0-87d5-05a1be0a4f7a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:10.767361 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510ec2d-bbeb-4cc0-87d5-05a1be0a4f7a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:10.826146 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58e5bd-d6a6-4a23-b9c8-566a9c0df5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:10.826835 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58e5bd-d6a6-4a23-b9c8-566a9c0df5e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:10.827344 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58e5bd-d6a6-4a23-b9c8-566a9c0df5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:10.827631 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58e5bd-d6a6-4a23-b9c8-566a9c0df5e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:10.828305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58e5bd-d6a6-4a23-b9c8-566a9c0df5e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:10.830303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58e5bd-d6a6-4a23-b9c8-566a9c0df5e5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:10.954691 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1095/2172] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:07:10 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:07:10.963437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085654c7-963d-4a90-99ae-fc80d9256c25 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:10.975818 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085654c7-963d-4a90-99ae-fc80d9256c25 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:10.981553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113abbb4-fc3e-4453-a332-358cb240b55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:10.982196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113abbb4-fc3e-4453-a332-358cb240b55b admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:10.982482 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113abbb4-fc3e-4453-a332-358cb240b55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:10.982758 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113abbb4-fc3e-4453-a332-358cb240b55b admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:10.983612 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113abbb4-fc3e-4453-a332-358cb240b55b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:10.986356 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113abbb4-fc3e-4453-a332-358cb240b55b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:10.995261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58e5bd-d6a6-4a23-b9c8-566a9c0df5e5 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:10.997462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7f58e5bd-d6a6-4a23-b9c8-566a9c0df5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:11.000322 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1078/2173] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:07:11.009278 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113abbb4-fc3e-4453-a332-358cb240b55b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:11.013929 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58e5bd-d6a6-4a23-b9c8-566a9c0df5e5 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:11.022863 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105eb505-1b4e-431e-93b0-4149ff487409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:11.022863 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eb505-1b4e-431e-93b0-4149ff487409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:11.022863 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eb505-1b4e-431e-93b0-4149ff487409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:11.022863 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eb505-1b4e-431e-93b0-4149ff487409 admin admin] PATH_INFO: `/v3/projects/cf524c06d3f64d779bf26e1250d9afb1` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:11.023828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113abbb4-fc3e-4453-a332-358cb240b55b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:11.025175 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105eb505-1b4e-431e-93b0-4149ff487409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf524c06d3f64d779bf26e1250d9afb1)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:11.027355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105eb505-1b4e-431e-93b0-4149ff487409 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:11.042365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26a3eb-fdf2-4865-a751-5c074227b72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:11.043005 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26a3eb-fdf2-4865-a751-5c074227b72e admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:11.043402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26a3eb-fdf2-4865-a751-5c074227b72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:11.043884 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26a3eb-fdf2-4865-a751-5c074227b72e admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:11.044736 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26a3eb-fdf2-4865-a751-5c074227b72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:11.047497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26a3eb-fdf2-4865-a751-5c074227b72e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:11.060934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1079/2174] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:07:11.063582 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26a3eb-fdf2-4865-a751-5c074227b72e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:11.077704 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26a3eb-fdf2-4865-a751-5c074227b72e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:11.084453 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef95390-af6d-42f4-84dd-90d782e10a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:11.085629 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef95390-af6d-42f4-84dd-90d782e10a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:11.085629 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef95390-af6d-42f4-84dd-90d782e10a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:11.085838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef95390-af6d-42f4-84dd-90d782e10a12 admin admin] PATH_INFO: `/v3/projects/3959ea4aa9854b21b0a08f14b5ddd784/users/1c9e2dd190c8473db33c4e83e5d6c777/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:11.102417 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef95390-af6d-42f4-84dd-90d782e10a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3959ea4aa9854b21b0a08f14b5ddd784, user_id=1c9e2dd190c8473db33c4e83e5d6c777, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:11.105408 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef95390-af6d-42f4-84dd-90d782e10a12 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:11.189918 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1080/2175] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:07:11 2022] PUT /identity/v3/projects/3959ea4aa9854b21b0a08f14b5ddd784/users/1c9e2dd190c8473db33c4e83e5d6c777/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:11.201963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6947b9-c3a7-4100-ada8-fdae5d0afd44 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:11.202589 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6947b9-c3a7-4100-ada8-fdae5d0afd44 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:11.203115 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6947b9-c3a7-4100-ada8-fdae5d0afd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:11.209058 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-105eb505-1b4e-431e-93b0-4149ff487409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf524c06d3f64d779bf26e1250d9afb1', 'request_id': 'req-105eb505-1b4e-431e-93b0-4149ff487409'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:11.233401 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fe6947b9-c3a7-4100-ada8-fdae5d0afd44 None None] MFA Rules not processed for user `1c9e2dd190c8473db33c4e83e5d6c777`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:11.234646 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fe6947b9-c3a7-4100-ada8-fdae5d0afd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:11.278550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-105eb505-1b4e-431e-93b0-4149ff487409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf524c06d3f64d779bf26e1250d9afb1', 'request_id': 'req-105eb505-1b4e-431e-93b0-4149ff487409'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:11.286150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-105eb505-1b4e-431e-93b0-4149ff487409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf524c06d3f64d779bf26e1250d9afb1', 'request_id': 'req-105eb505-1b4e-431e-93b0-4149ff487409'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:11.299430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-105eb505-1b4e-431e-93b0-4149ff487409 admin admin] The token cache is being invalidate because project cf524c06d3f64d779bf26e1250d9afb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:07:11.299783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-105eb505-1b4e-431e-93b0-4149ff487409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:11.300452 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-105eb505-1b4e-431e-93b0-4149ff487409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:11.303028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1096/2176] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:07:10 2022] DELETE /identity/v3/projects/cf524c06d3f64d779bf26e1250d9afb1 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:07:11.308726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50bf8b-d8a7-41e4-b11d-172f7c58adab None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:11.309314 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50bf8b-d8a7-41e4-b11d-172f7c58adab None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:11.309749 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50bf8b-d8a7-41e4-b11d-172f7c58adab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:11.313158 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1081/2177] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:07:11.349212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6947b9-c3a7-4100-ada8-fdae5d0afd44 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:11.351700 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fe6947b9-c3a7-4100-ada8-fdae5d0afd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:11.358852 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6e50bf8b-d8a7-41e4-b11d-172f7c58adab None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:11.358852 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6e50bf8b-d8a7-41e4-b11d-172f7c58adab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:11.426076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6947b9-c3a7-4100-ada8-fdae5d0afd44 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:11.430128 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19ba70-28af-4d8a-a70b-a4b8ca329320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:11.430771 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19ba70-28af-4d8a-a70b-a4b8ca329320 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:11.431218 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19ba70-28af-4d8a-a70b-a4b8ca329320 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:11.431500 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19ba70-28af-4d8a-a70b-a4b8ca329320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:11.433590 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dd19ba70-28af-4d8a-a70b-a4b8ca329320 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:11.437097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1097/2178] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:11.447426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3f7e2-a3ae-413a-831b-8e77769341bd None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:11.447764 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3f7e2-a3ae-413a-831b-8e77769341bd None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:11.448172 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3f7e2-a3ae-413a-831b-8e77769341bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:11.450402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19ba70-28af-4d8a-a70b-a4b8ca329320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:11.451899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19ba70-28af-4d8a-a70b-a4b8ca329320 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:11.478246 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1082/2179] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:07:11.490975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f3b3f7e2-a3ae-413a-831b-8e77769341bd None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:11.492016 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f3b3f7e2-a3ae-413a-831b-8e77769341bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:11.499581 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19ba70-28af-4d8a-a70b-a4b8ca329320 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:11.501080 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dd19ba70-28af-4d8a-a70b-a4b8ca329320 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:11.513083 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1098/2180] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:11.518321 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3f7e2-a3ae-413a-831b-8e77769341bd None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:11.523059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19ba70-28af-4d8a-a70b-a4b8ca329320 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:11.529781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee95ac-eac6-4d98-be2e-ab4f2e66fccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:11.530381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee95ac-eac6-4d98-be2e-ab4f2e66fccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:11.530669 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee95ac-eac6-4d98-be2e-ab4f2e66fccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:11.530979 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee95ac-eac6-4d98-be2e-ab4f2e66fccd admin admin] PATH_INFO: `/v3/users/1c9e2dd190c8473db33c4e83e5d6c777` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:11.532300 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee95ac-eac6-4d98-be2e-ab4f2e66fccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c9e2dd190c8473db33c4e83e5d6c777)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:11.534694 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee95ac-eac6-4d98-be2e-ab4f2e66fccd admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:11.535938 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3f7e2-a3ae-413a-831b-8e77769341bd None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:11.541388 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24646f62-5c84-46b7-a5c7-9081eb1d2399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:11.542101 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24646f62-5c84-46b7-a5c7-9081eb1d2399 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:11.542538 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24646f62-5c84-46b7-a5c7-9081eb1d2399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:11.542858 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24646f62-5c84-46b7-a5c7-9081eb1d2399 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:11.543634 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24646f62-5c84-46b7-a5c7-9081eb1d2399 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:07:11.544005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24646f62-5c84-46b7-a5c7-9081eb1d2399 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:11.545830 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24646f62-5c84-46b7-a5c7-9081eb1d2399 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:11.563322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1099/2181] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:07:11.564307 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24646f62-5c84-46b7-a5c7-9081eb1d2399 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:11.574451 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24646f62-5c84-46b7-a5c7-9081eb1d2399 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:11.579276 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50440b26-e50b-432f-a430-5b7bbace3f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:11.580028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50440b26-e50b-432f-a430-5b7bbace3f63 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:11.580310 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50440b26-e50b-432f-a430-5b7bbace3f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:11.580591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50440b26-e50b-432f-a430-5b7bbace3f63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:11.581324 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50440b26-e50b-432f-a430-5b7bbace3f63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:11.583351 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50440b26-e50b-432f-a430-5b7bbace3f63 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:11.708677 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1100/2182] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:07:11 2022] POST /identity/v3/projects => generated 361 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:07:11.713158 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50440b26-e50b-432f-a430-5b7bbace3f63 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:11.758818 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2eee95ac-eac6-4d98-be2e-ab4f2e66fccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c9e2dd190c8473db33c4e83e5d6c777'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:11.759588 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2eee95ac-eac6-4d98-be2e-ab4f2e66fccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c9e2dd190c8473db33c4e83e5d6c777'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:11.775763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2eee95ac-eac6-4d98-be2e-ab4f2e66fccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c9e2dd190c8473db33c4e83e5d6c777'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:11.784883 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2eee95ac-eac6-4d98-be2e-ab4f2e66fccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c9e2dd190c8473db33c4e83e5d6c777'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:11.786584 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2eee95ac-eac6-4d98-be2e-ab4f2e66fccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c9e2dd190c8473db33c4e83e5d6c777'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:11.822074 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50440b26-e50b-432f-a430-5b7bbace3f63 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:11.831119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1d54f-6c5f-4fd4-8f07-12345fb2f1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:11.831985 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1d54f-6c5f-4fd4-8f07-12345fb2f1dd admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:11.832295 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1d54f-6c5f-4fd4-8f07-12345fb2f1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:11.832570 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1d54f-6c5f-4fd4-8f07-12345fb2f1dd admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:11.833290 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1d54f-6c5f-4fd4-8f07-12345fb2f1dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:11.835313 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1d54f-6c5f-4fd4-8f07-12345fb2f1dd admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:11.860605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1083/2183] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:07:11 2022] DELETE /identity/v3/users/1c9e2dd190c8473db33c4e83e5d6c777 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:11.862162 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d2bc2-2133-41da-843a-a7be3dc63a2c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:11.862460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d2bc2-2133-41da-843a-a7be3dc63a2c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:11.862736 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d2bc2-2133-41da-843a-a7be3dc63a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:11.889504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-338d2bc2-2133-41da-843a-a7be3dc63a2c None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:11.894164 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-338d2bc2-2133-41da-843a-a7be3dc63a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:11.950067 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1101/2184] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:07:11 2022] POST /identity/v3/users => generated 281 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:07:11.955038 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1d54f-6c5f-4fd4-8f07-12345fb2f1dd admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:11.961640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b4b1d54f-6c5f-4fd4-8f07-12345fb2f1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:11.977186 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1084/2185] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:11.987432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d2bc2-2133-41da-843a-a7be3dc63a2c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:11.990231 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-338d2bc2-2133-41da-843a-a7be3dc63a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:11.994792 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1d54f-6c5f-4fd4-8f07-12345fb2f1dd admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:12.008640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e7541-de35-441e-b7ef-5f56ec4ce2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:12.009744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e7541-de35-441e-b7ef-5f56ec4ce2ee admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:12.010235 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e7541-de35-441e-b7ef-5f56ec4ce2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:12.010740 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e7541-de35-441e-b7ef-5f56ec4ce2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:12.012125 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e7541-de35-441e-b7ef-5f56ec4ce2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:12.014177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e7541-de35-441e-b7ef-5f56ec4ce2ee admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:12.030242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1102/2186] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:07:12.031351 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e7541-de35-441e-b7ef-5f56ec4ce2ee admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:12.044981 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e7541-de35-441e-b7ef-5f56ec4ce2ee admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:12.049272 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cb1e3-750b-4bea-bbbe-c078ba24ab9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:12.050211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cb1e3-750b-4bea-bbbe-c078ba24ab9b admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:12.050716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cb1e3-750b-4bea-bbbe-c078ba24ab9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:12.051186 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cb1e3-750b-4bea-bbbe-c078ba24ab9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:12.052142 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45cb1e3-750b-4bea-bbbe-c078ba24ab9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:12.054528 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45cb1e3-750b-4bea-bbbe-c078ba24ab9b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:12.071191 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1103/2187] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:07:12.072546 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cb1e3-750b-4bea-bbbe-c078ba24ab9b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:12.078104 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d2bc2-2133-41da-843a-a7be3dc63a2c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:12.084212 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cb1e3-750b-4bea-bbbe-c078ba24ab9b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:12.088349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb8958-9b54-4892-8885-d2d20dc45e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:12.089519 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e668e2-c6e5-4456-86b6-6e76f8599e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:12.090199 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb8958-9b54-4892-8885-d2d20dc45e23 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:12.090310 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e668e2-c6e5-4456-86b6-6e76f8599e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:12.090512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e668e2-c6e5-4456-86b6-6e76f8599e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:12.090791 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e668e2-c6e5-4456-86b6-6e76f8599e30 admin admin] PATH_INFO: `/v3/projects/77f93bab1bcf4f3d9db7c2193d9d2405/users/f4f074c4152e4c9b81b135aabe60e458/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:12.091199 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb8958-9b54-4892-8885-d2d20dc45e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:12.091686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb8958-9b54-4892-8885-d2d20dc45e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:12.106053 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb8958-9b54-4892-8885-d2d20dc45e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:12.107592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb8958-9b54-4892-8885-d2d20dc45e23 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:12.109630 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e668e2-c6e5-4456-86b6-6e76f8599e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f93bab1bcf4f3d9db7c2193d9d2405, user_id=f4f074c4152e4c9b81b135aabe60e458, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:12.112448 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e668e2-c6e5-4456-86b6-6e76f8599e30 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:12.118828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1085/2188] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:07:12.366690 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1104/2189] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:07:12 2022] PUT /identity/v3/projects/77f93bab1bcf4f3d9db7c2193d9d2405/users/f4f074c4152e4c9b81b135aabe60e458/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:07:12.386175 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf41f5c-d973-45e5-8da6-6f2c1b0085cc None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:12.386548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf41f5c-d973-45e5-8da6-6f2c1b0085cc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:12.386908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf41f5c-d973-45e5-8da6-6f2c1b0085cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:12.422269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2bf41f5c-d973-45e5-8da6-6f2c1b0085cc None None] MFA Rules not processed for user `f4f074c4152e4c9b81b135aabe60e458`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:12.423915 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2bf41f5c-d973-45e5-8da6-6f2c1b0085cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:12.517316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:12.557109 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1086/2190] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:12.569405 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e668e2-c6e5-4456-86b6-6e76f8599e30 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:12.571233 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d7e668e2-c6e5-4456-86b6-6e76f8599e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:12.581727 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:12.652050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e668e2-c6e5-4456-86b6-6e76f8599e30 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:12.655780 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86554679-1ea4-4aaf-ada8-cf2adfb41682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:12.656406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86554679-1ea4-4aaf-ada8-cf2adfb41682 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:12.656692 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86554679-1ea4-4aaf-ada8-cf2adfb41682 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:12.657005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86554679-1ea4-4aaf-ada8-cf2adfb41682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:12.666392 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86554679-1ea4-4aaf-ada8-cf2adfb41682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:12.667863 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86554679-1ea4-4aaf-ada8-cf2adfb41682 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:12.679805 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1105/2191] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:07:12.695952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf41f5c-d973-45e5-8da6-6f2c1b0085cc None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:12.737619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86554679-1ea4-4aaf-ada8-cf2adfb41682 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:12.745259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-86554679-1ea4-4aaf-ada8-cf2adfb41682 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:12.827531 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf41f5c-d973-45e5-8da6-6f2c1b0085cc None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:12.833004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b974fc-ef55-42d4-aafd-38f7203e06ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:12.842592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b974fc-ef55-42d4-aafd-38f7203e06ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:12.842592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b974fc-ef55-42d4-aafd-38f7203e06ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:12.842592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b974fc-ef55-42d4-aafd-38f7203e06ac admin admin] PATH_INFO: `/v3/users/f4f074c4152e4c9b81b135aabe60e458` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:12.842592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b974fc-ef55-42d4-aafd-38f7203e06ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f074c4152e4c9b81b135aabe60e458)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:12.842592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b974fc-ef55-42d4-aafd-38f7203e06ac admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:12.872963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86554679-1ea4-4aaf-ada8-cf2adfb41682 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:12.881557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47228e4e-8e69-42b9-8a7c-84fd0a3b7a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:12.882261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47228e4e-8e69-42b9-8a7c-84fd0a3b7a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:12.882549 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47228e4e-8e69-42b9-8a7c-84fd0a3b7a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:12.882828 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47228e4e-8e69-42b9-8a7c-84fd0a3b7a9a admin admin] PATH_INFO: `/v3/projects/3959ea4aa9854b21b0a08f14b5ddd784` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:12.884129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47228e4e-8e69-42b9-8a7c-84fd0a3b7a9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3959ea4aa9854b21b0a08f14b5ddd784)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:12.886282 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47228e4e-8e69-42b9-8a7c-84fd0a3b7a9a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:13.170033 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-00b974fc-ef55-42d4-aafd-38f7203e06ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f074c4152e4c9b81b135aabe60e458'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:13.170944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-00b974fc-ef55-42d4-aafd-38f7203e06ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f074c4152e4c9b81b135aabe60e458'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:13.177228 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-47228e4e-8e69-42b9-8a7c-84fd0a3b7a9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3959ea4aa9854b21b0a08f14b5ddd784', 'request_id': 'req-47228e4e-8e69-42b9-8a7c-84fd0a3b7a9a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:13.185005 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-00b974fc-ef55-42d4-aafd-38f7203e06ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f074c4152e4c9b81b135aabe60e458'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:13.196265 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-00b974fc-ef55-42d4-aafd-38f7203e06ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f074c4152e4c9b81b135aabe60e458'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:13.196265 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-00b974fc-ef55-42d4-aafd-38f7203e06ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f074c4152e4c9b81b135aabe60e458'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:13.286507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-47228e4e-8e69-42b9-8a7c-84fd0a3b7a9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3959ea4aa9854b21b0a08f14b5ddd784', 'request_id': 'req-47228e4e-8e69-42b9-8a7c-84fd0a3b7a9a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:13.296374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-47228e4e-8e69-42b9-8a7c-84fd0a3b7a9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3959ea4aa9854b21b0a08f14b5ddd784', 'request_id': 'req-47228e4e-8e69-42b9-8a7c-84fd0a3b7a9a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:13.348528 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-47228e4e-8e69-42b9-8a7c-84fd0a3b7a9a admin admin] The token cache is being invalidate because project 3959ea4aa9854b21b0a08f14b5ddd784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:07:13.348855 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-47228e4e-8e69-42b9-8a7c-84fd0a3b7a9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:13.349539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-47228e4e-8e69-42b9-8a7c-84fd0a3b7a9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:13.351282 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1106/2192] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:07:12 2022] DELETE /identity/v3/projects/3959ea4aa9854b21b0a08f14b5ddd784 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:13.363195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394bb23-412c-497e-83da-0836cd47d747 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:13.364227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394bb23-412c-497e-83da-0836cd47d747 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:13.364721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394bb23-412c-497e-83da-0836cd47d747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:13.391823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1087/2193] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:07:12 2022] DELETE /identity/v3/users/f4f074c4152e4c9b81b135aabe60e458 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:13.397191 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916f103-bdd1-4978-a0df-2980903f365f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:13.398389 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916f103-bdd1-4978-a0df-2980903f365f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:13.398828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916f103-bdd1-4978-a0df-2980903f365f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:13.399270 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c394bb23-412c-497e-83da-0836cd47d747 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:13.401556 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c394bb23-412c-497e-83da-0836cd47d747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:13.432212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b916f103-bdd1-4978-a0df-2980903f365f None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:13.433698 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b916f103-bdd1-4978-a0df-2980903f365f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:13.512809 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1107/2194] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:13.518987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cfa13-8119-4a03-b044-3ec658256f0d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:13.520530 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cfa13-8119-4a03-b044-3ec658256f0d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:13.522055 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cfa13-8119-4a03-b044-3ec658256f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:13.529343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1088/2195] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:13.544814 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916f103-bdd1-4978-a0df-2980903f365f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:13.548369 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b916f103-bdd1-4978-a0df-2980903f365f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:13.553944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-a53cfa13-8119-4a03-b044-3ec658256f0d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:13.555059 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a53cfa13-8119-4a03-b044-3ec658256f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:13.571034 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1108/2196] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:13.572518 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cfa13-8119-4a03-b044-3ec658256f0d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:13.584352 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cfa13-8119-4a03-b044-3ec658256f0d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:13.594605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627fa4f-782b-413a-9280-b28892a71c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:13.595548 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627fa4f-782b-413a-9280-b28892a71c90 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:13.595672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627fa4f-782b-413a-9280-b28892a71c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:13.595897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627fa4f-782b-413a-9280-b28892a71c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:13.596615 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627fa4f-782b-413a-9280-b28892a71c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:07:13.596955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627fa4f-782b-413a-9280-b28892a71c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:13.599493 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627fa4f-782b-413a-9280-b28892a71c90 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:13.619674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1109/2197] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:07:13.619674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627fa4f-782b-413a-9280-b28892a71c90 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:13.636863 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627fa4f-782b-413a-9280-b28892a71c90 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:13.649169 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12f3b4-c5ff-4c75-8661-a985ff1f07ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:13.652132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12f3b4-c5ff-4c75-8661-a985ff1f07ba admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:13.653801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12f3b4-c5ff-4c75-8661-a985ff1f07ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:13.653801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12f3b4-c5ff-4c75-8661-a985ff1f07ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:13.655439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916f103-bdd1-4978-a0df-2980903f365f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:13.655662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12f3b4-c5ff-4c75-8661-a985ff1f07ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:13.658106 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12f3b4-c5ff-4c75-8661-a985ff1f07ba admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:13.667563 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62badbe3-ed00-40e2-a0aa-af862007cfc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:13.668490 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62badbe3-ed00-40e2-a0aa-af862007cfc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:13.668976 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62badbe3-ed00-40e2-a0aa-af862007cfc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:13.669510 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62badbe3-ed00-40e2-a0aa-af862007cfc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:13.712331 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62badbe3-ed00-40e2-a0aa-af862007cfc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:13.714009 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62badbe3-ed00-40e2-a0aa-af862007cfc9 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:13.729673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1089/2198] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:07:13.791184 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62badbe3-ed00-40e2-a0aa-af862007cfc9 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:13.797780 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1110/2199] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:07:13 2022] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:07:13.810110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62badbe3-ed00-40e2-a0aa-af862007cfc9 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:13.923161 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b1fb5-2859-4a6f-ab85-e966253e7169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:13.924184 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b1fb5-2859-4a6f-ab85-e966253e7169 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:13.924691 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b1fb5-2859-4a6f-ab85-e966253e7169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:13.925171 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b1fb5-2859-4a6f-ab85-e966253e7169 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:13.926231 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b1fb5-2859-4a6f-ab85-e966253e7169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:13.928464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b1fb5-2859-4a6f-ab85-e966253e7169 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:14.075856 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1090/2200] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:07:13 2022] POST /identity/v3/users => generated 288 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:07:14.079914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12f3b4-c5ff-4c75-8661-a985ff1f07ba admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:14.091042 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12f3b4-c5ff-4c75-8661-a985ff1f07ba admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:14.096744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee1a20-9cf9-40fd-8b16-4132d950bf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:14.098406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee1a20-9cf9-40fd-8b16-4132d950bf10 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:14.098406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee1a20-9cf9-40fd-8b16-4132d950bf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:14.098406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee1a20-9cf9-40fd-8b16-4132d950bf10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:14.098751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee1a20-9cf9-40fd-8b16-4132d950bf10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:14.100456 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee1a20-9cf9-40fd-8b16-4132d950bf10 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:14.111746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1111/2201] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:07:14.116216 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b1fb5-2859-4a6f-ab85-e966253e7169 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:14.142450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b1fb5-2859-4a6f-ab85-e966253e7169 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:14.142450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686e6bc-e6e3-43d3-96bb-5876f534970f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:14.142450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686e6bc-e6e3-43d3-96bb-5876f534970f admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:14.142450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686e6bc-e6e3-43d3-96bb-5876f534970f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:14.142844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686e6bc-e6e3-43d3-96bb-5876f534970f admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:14.142844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686e6bc-e6e3-43d3-96bb-5876f534970f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:14.142844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686e6bc-e6e3-43d3-96bb-5876f534970f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:14.151940 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1091/2202] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:07:14.153745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee1a20-9cf9-40fd-8b16-4132d950bf10 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:14.165233 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee1a20-9cf9-40fd-8b16-4132d950bf10 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:14.172022 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01aef7-11c2-4381-9f64-f36ed5f0b8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:14.172710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01aef7-11c2-4381-9f64-f36ed5f0b8a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:14.173042 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01aef7-11c2-4381-9f64-f36ed5f0b8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:14.173326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01aef7-11c2-4381-9f64-f36ed5f0b8a4 admin admin] PATH_INFO: `/v3/projects/f6490828f86e4a3fb004b2b334e56e71/users/477f446ea0324978b3c95ca85adfac25/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:14.190049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01aef7-11c2-4381-9f64-f36ed5f0b8a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6490828f86e4a3fb004b2b334e56e71, user_id=477f446ea0324978b3c95ca85adfac25, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:14.193573 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01aef7-11c2-4381-9f64-f36ed5f0b8a4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:14.323342 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1112/2203] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:07:14 2022] PUT /identity/v3/projects/f6490828f86e4a3fb004b2b334e56e71/users/477f446ea0324978b3c95ca85adfac25/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:07:14.337407 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686e6bc-e6e3-43d3-96bb-5876f534970f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:14.359247 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2686e6bc-e6e3-43d3-96bb-5876f534970f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:14.408060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c648f98-c71e-4f75-864c-b32dac581bbd None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:14.408855 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c648f98-c71e-4f75-864c-b32dac581bbd None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:14.408855 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c648f98-c71e-4f75-864c-b32dac581bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:14.414731 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686e6bc-e6e3-43d3-96bb-5876f534970f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:14.459389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6c648f98-c71e-4f75-864c-b32dac581bbd None None] MFA Rules not processed for user `477f446ea0324978b3c95ca85adfac25`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:14.461115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6c648f98-c71e-4f75-864c-b32dac581bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:14.504565 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57b6d0-79a0-45eb-9f59-0e658cfa8556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:14.505493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57b6d0-79a0-45eb-9f59-0e658cfa8556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:14.505858 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57b6d0-79a0-45eb-9f59-0e658cfa8556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:14.506230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57b6d0-79a0-45eb-9f59-0e658cfa8556 admin admin] PATH_INFO: `/v3/projects/77f93bab1bcf4f3d9db7c2193d9d2405` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:14.507889 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57b6d0-79a0-45eb-9f59-0e658cfa8556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f93bab1bcf4f3d9db7c2193d9d2405)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:14.510312 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57b6d0-79a0-45eb-9f59-0e658cfa8556 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:14.566414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1113/2204] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:14.577796 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c648f98-c71e-4f75-864c-b32dac581bbd None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:14.579224 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6c648f98-c71e-4f75-864c-b32dac581bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:14.667034 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ff57b6d0-79a0-45eb-9f59-0e658cfa8556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f93bab1bcf4f3d9db7c2193d9d2405', 'request_id': 'req-ff57b6d0-79a0-45eb-9f59-0e658cfa8556'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:14.677984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ff57b6d0-79a0-45eb-9f59-0e658cfa8556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f93bab1bcf4f3d9db7c2193d9d2405', 'request_id': 'req-ff57b6d0-79a0-45eb-9f59-0e658cfa8556'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:14.695941 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ff57b6d0-79a0-45eb-9f59-0e658cfa8556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f93bab1bcf4f3d9db7c2193d9d2405', 'request_id': 'req-ff57b6d0-79a0-45eb-9f59-0e658cfa8556'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:14.702671 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c648f98-c71e-4f75-864c-b32dac581bbd None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:14.707215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:14.769355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e7728-6f26-4b8e-afd1-0a66ae14a93d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:14.770150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e7728-6f26-4b8e-afd1-0a66ae14a93d service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:14.770520 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e7728-6f26-4b8e-afd1-0a66ae14a93d service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:14.770853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e7728-6f26-4b8e-afd1-0a66ae14a93d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:14.794280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ff57b6d0-79a0-45eb-9f59-0e658cfa8556 admin admin] The token cache is being invalidate because project 77f93bab1bcf4f3d9db7c2193d9d2405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:07:14.794789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ff57b6d0-79a0-45eb-9f59-0e658cfa8556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:14.801335 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ff57b6d0-79a0-45eb-9f59-0e658cfa8556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:14.803620 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1092/2205] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:07:14 2022] DELETE /identity/v3/projects/77f93bab1bcf4f3d9db7c2193d9d2405 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:14.805479 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139fb1-8938-4280-b6d3-c976c795986c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:14.805782 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139fb1-8938-4280-b6d3-c976c795986c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:14.806109 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139fb1-8938-4280-b6d3-c976c795986c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:14.856564 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-34139fb1-8938-4280-b6d3-c976c795986c None None] MFA Rules not processed for user `6811352e7e4e44fcb5598bc5d900e0a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:14.857863 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-34139fb1-8938-4280-b6d3-c976c795986c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:14.873439 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:14.876791 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e7728-6f26-4b8e-afd1-0a66ae14a93d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:14.879192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e7728-6f26-4b8e-afd1-0a66ae14a93d service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:14.891893 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1114/2206] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:07:14.893337 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aef2c1-241f-4e7c-ae36-7e219f046440 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:14.893812 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aef2c1-241f-4e7c-ae36-7e219f046440 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:14.894316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aef2c1-241f-4e7c-ae36-7e219f046440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:14.927526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-62aef2c1-241f-4e7c-ae36-7e219f046440 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:14.931657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-62aef2c1-241f-4e7c-ae36-7e219f046440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:14.947660 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1093/2207] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:14.960152 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeea4d7-1b03-4175-86b4-f72a9104f0b9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:14.960452 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeea4d7-1b03-4175-86b4-f72a9104f0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:14.960717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeea4d7-1b03-4175-86b4-f72a9104f0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:14.991973 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ffeea4d7-1b03-4175-86b4-f72a9104f0b9 None None] MFA Rules not processed for user `6811352e7e4e44fcb5598bc5d900e0a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:14.993267 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ffeea4d7-1b03-4175-86b4-f72a9104f0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:15.004409 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1094/2208] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:15.010529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1115/2209] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:15.019154 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeea4d7-1b03-4175-86b4-f72a9104f0b9 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:15.021221 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ffeea4d7-1b03-4175-86b4-f72a9104f0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:15.025549 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90181b2a-ffbe-40b5-83e9-9b722d26778a None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:15.025996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90181b2a-ffbe-40b5-83e9-9b722d26778a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:15.026284 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90181b2a-ffbe-40b5-83e9-9b722d26778a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:15.048545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-90181b2a-ffbe-40b5-83e9-9b722d26778a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:15.049853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-90181b2a-ffbe-40b5-83e9-9b722d26778a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:15.058816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1116/2210] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:15.062993 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90181b2a-ffbe-40b5-83e9-9b722d26778a None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:15.076192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90181b2a-ffbe-40b5-83e9-9b722d26778a None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:15.083137 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67a42f-d453-4b86-9014-45dc81f91013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:15.084296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67a42f-d453-4b86-9014-45dc81f91013 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:15.084890 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67a42f-d453-4b86-9014-45dc81f91013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:15.085173 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67a42f-d453-4b86-9014-45dc81f91013 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:15.085955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67a42f-d453-4b86-9014-45dc81f91013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:07:15.086282 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67a42f-d453-4b86-9014-45dc81f91013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:15.088170 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67a42f-d453-4b86-9014-45dc81f91013 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:15.105140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1117/2211] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:07:15.109863 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67a42f-d453-4b86-9014-45dc81f91013 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:15.122526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67a42f-d453-4b86-9014-45dc81f91013 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:15.127663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b13f06-6471-4d17-8fc2-31dc1caebf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:15.129403 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b13f06-6471-4d17-8fc2-31dc1caebf9b admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:15.132840 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b13f06-6471-4d17-8fc2-31dc1caebf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:15.132840 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b13f06-6471-4d17-8fc2-31dc1caebf9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:15.132840 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b13f06-6471-4d17-8fc2-31dc1caebf9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:15.133166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeea4d7-1b03-4175-86b4-f72a9104f0b9 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:15.133484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b13f06-6471-4d17-8fc2-31dc1caebf9b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:15.139852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638484d6-2322-4384-8ea9-58d522870af7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:15.140502 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638484d6-2322-4384-8ea9-58d522870af7 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:15.140866 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638484d6-2322-4384-8ea9-58d522870af7 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:15.141147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638484d6-2322-4384-8ea9-58d522870af7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:15.150377 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638484d6-2322-4384-8ea9-58d522870af7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:15.152342 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638484d6-2322-4384-8ea9-58d522870af7 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:15.164021 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1095/2212] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:07:15.252257 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1118/2213] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:07:15 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:07:15.257339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638484d6-2322-4384-8ea9-58d522870af7 service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:15.268645 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638484d6-2322-4384-8ea9-58d522870af7 service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:15.368349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cc53b-61e9-4604-a6df-26954eed5c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:15.369772 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cc53b-61e9-4604-a6df-26954eed5c89 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:15.370251 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cc53b-61e9-4604-a6df-26954eed5c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:15.370671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cc53b-61e9-4604-a6df-26954eed5c89 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:15.371491 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853cc53b-61e9-4604-a6df-26954eed5c89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:15.373611 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853cc53b-61e9-4604-a6df-26954eed5c89 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:15.527031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1096/2214] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:07:15 2022] POST /identity/v3/users => generated 287 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:07:15.531606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b13f06-6471-4d17-8fc2-31dc1caebf9b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:15.547545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b13f06-6471-4d17-8fc2-31dc1caebf9b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:15.552983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9983936-2cef-46ea-b6c1-25c1fa149257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:15.553628 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9983936-2cef-46ea-b6c1-25c1fa149257 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:15.553938 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9983936-2cef-46ea-b6c1-25c1fa149257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:15.554199 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9983936-2cef-46ea-b6c1-25c1fa149257 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:15.554908 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9983936-2cef-46ea-b6c1-25c1fa149257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:15.556628 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9983936-2cef-46ea-b6c1-25c1fa149257 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:15.571977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1119/2215] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:07:15.573441 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cc53b-61e9-4604-a6df-26954eed5c89 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:15.586550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cc53b-61e9-4604-a6df-26954eed5c89 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:15.591349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca318b0-2dd3-419d-a746-71a74e87e553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:15.591960 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca318b0-2dd3-419d-a746-71a74e87e553 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:15.592244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca318b0-2dd3-419d-a746-71a74e87e553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:15.592520 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca318b0-2dd3-419d-a746-71a74e87e553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:15.593295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca318b0-2dd3-419d-a746-71a74e87e553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:15.594915 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca318b0-2dd3-419d-a746-71a74e87e553 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:15.605832 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1097/2216] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:07:15.610059 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9983936-2cef-46ea-b6c1-25c1fa149257 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:15.621600 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9983936-2cef-46ea-b6c1-25c1fa149257 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:15.626941 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001ce19-ca53-4b3b-817f-fd3ff67eaa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:15.627657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001ce19-ca53-4b3b-817f-fd3ff67eaa38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:15.627939 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001ce19-ca53-4b3b-817f-fd3ff67eaa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:15.628216 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001ce19-ca53-4b3b-817f-fd3ff67eaa38 admin admin] PATH_INFO: `/v3/projects/16ecf10058ef4eb38898dda124282316/users/64f0dd228d8a4445a5dbe47a3bb34210/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:15.650655 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001ce19-ca53-4b3b-817f-fd3ff67eaa38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ecf10058ef4eb38898dda124282316, user_id=64f0dd228d8a4445a5dbe47a3bb34210, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:15.661194 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001ce19-ca53-4b3b-817f-fd3ff67eaa38 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:15.754766 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1120/2217] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:07:15 2022] PUT /identity/v3/projects/16ecf10058ef4eb38898dda124282316/users/64f0dd228d8a4445a5dbe47a3bb34210/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:15.766659 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa34dbb-3b3f-4595-b590-229d8a89a985 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:15.766950 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa34dbb-3b3f-4595-b590-229d8a89a985 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:15.767234 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa34dbb-3b3f-4595-b590-229d8a89a985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:15.804227 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8fa34dbb-3b3f-4595-b590-229d8a89a985 None None] MFA Rules not processed for user `64f0dd228d8a4445a5dbe47a3bb34210`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:15.805623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8fa34dbb-3b3f-4595-b590-229d8a89a985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:15.879949 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:15.901119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1098/2218] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:15.913425 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001ce19-ca53-4b3b-817f-fd3ff67eaa38 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:15.915328 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5001ce19-ca53-4b3b-817f-fd3ff67eaa38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:15.980235 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001ce19-ca53-4b3b-817f-fd3ff67eaa38 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:15.984100 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d9fab-622f-486b-84ed-b30c8ceca526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:15.984787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d9fab-622f-486b-84ed-b30c8ceca526 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:15.985188 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d9fab-622f-486b-84ed-b30c8ceca526 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:15.986330 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d9fab-622f-486b-84ed-b30c8ceca526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:15.996495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d9fab-622f-486b-84ed-b30c8ceca526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:15.998064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d9fab-622f-486b-84ed-b30c8ceca526 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:16.008864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1121/2219] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:07:16.084413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:16.264889 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe17d6-76f1-445f-8470-a56f05f0a8e2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:16.265259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe17d6-76f1-445f-8470-a56f05f0a8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:16.265612 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe17d6-76f1-445f-8470-a56f05f0a8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:16.287815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d4fe17d6-76f1-445f-8470-a56f05f0a8e2 None None] MFA Rules not processed for user `6811352e7e4e44fcb5598bc5d900e0a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:16.289442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d4fe17d6-76f1-445f-8470-a56f05f0a8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:16.378272 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1099/2220] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:17.133343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:17.860130 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:18.062233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:19.048431 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7e739-5f59-4d15-a497-f4f3fa51a154 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:19.048997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7e739-5f59-4d15-a497-f4f3fa51a154 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:19.049146 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7e739-5f59-4d15-a497-f4f3fa51a154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:19.070525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-bae7e739-5f59-4d15-a497-f4f3fa51a154 None None] MFA Rules not processed for user `64f0dd228d8a4445a5dbe47a3bb34210`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:19.071758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bae7e739-5f59-4d15-a497-f4f3fa51a154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:19.084732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1122/2221] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:19.376236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:20.422035 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:20.804712 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:21.863057 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:22.330674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:23.090381 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:23.787831 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:23.884656 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:24.772288 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:25.769715 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:26.913746 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:27.038670 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:27.380976 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:27.763711 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:27.886208 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:28.256134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:28.872952 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:29.107296 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:30.123850 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe17d6-76f1-445f-8470-a56f05f0a8e2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:30.125915 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d4fe17d6-76f1-445f-8470-a56f05f0a8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:30.210204 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe17d6-76f1-445f-8470-a56f05f0a8e2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:30.215037 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d3a3b-456e-4fec-bfe3-921421efb220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:30.215698 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d3a3b-456e-4fec-bfe3-921421efb220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:30.216182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d3a3b-456e-4fec-bfe3-921421efb220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:30.216640 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d3a3b-456e-4fec-bfe3-921421efb220 admin admin] PATH_INFO: `/v3/users/477f446ea0324978b3c95ca85adfac25` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:30.218288 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d3a3b-456e-4fec-bfe3-921421efb220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=477f446ea0324978b3c95ca85adfac25)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:30.220203 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d3a3b-456e-4fec-bfe3-921421efb220 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:30.404918 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:30.409047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-311d3a3b-456e-4fec-bfe3-921421efb220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '477f446ea0324978b3c95ca85adfac25'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:30.409840 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-311d3a3b-456e-4fec-bfe3-921421efb220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '477f446ea0324978b3c95ca85adfac25'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:30.423105 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-311d3a3b-456e-4fec-bfe3-921421efb220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '477f446ea0324978b3c95ca85adfac25'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:30.430333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-311d3a3b-456e-4fec-bfe3-921421efb220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '477f446ea0324978b3c95ca85adfac25'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:30.431062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-311d3a3b-456e-4fec-bfe3-921421efb220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '477f446ea0324978b3c95ca85adfac25'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:30.490037 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1100/2222] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:07:30 2022] DELETE /identity/v3/users/477f446ea0324978b3c95ca85adfac25 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:30.494992 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c3d42-41f3-4062-9c3d-644668a4d056 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:30.495428 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c3d42-41f3-4062-9c3d-644668a4d056 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:30.495766 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c3d42-41f3-4062-9c3d-644668a4d056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:30.516314 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-2b1c3d42-41f3-4062-9c3d-644668a4d056 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:30.517606 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2b1c3d42-41f3-4062-9c3d-644668a4d056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:30.581690 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1123/2223] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:07:30.593016 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d3a3b-456e-4fec-bfe3-921421efb220 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:30.594628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-311d3a3b-456e-4fec-bfe3-921421efb220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:30.614971 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:30.654220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d3a3b-456e-4fec-bfe3-921421efb220 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:30.658162 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ea9ea-928e-4d7d-8122-869335901c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:30.658625 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ea9ea-928e-4d7d-8122-869335901c7b service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:30.658904 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ea9ea-928e-4d7d-8122-869335901c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:30.659177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ea9ea-928e-4d7d-8122-869335901c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:30.668382 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ea9ea-928e-4d7d-8122-869335901c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:30.669851 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ea9ea-928e-4d7d-8122-869335901c7b service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:30.680430 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1101/2224] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:07:31.222945 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c3d42-41f3-4062-9c3d-644668a4d056 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:31.225200 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2b1c3d42-41f3-4062-9c3d-644668a4d056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:31.243183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c3d42-41f3-4062-9c3d-644668a4d056 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:31.243906 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc17a4-28f9-4246-bebd-6a7e6d4ed0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:31.244589 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc17a4-28f9-4246-bebd-6a7e6d4ed0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:31.244906 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc17a4-28f9-4246-bebd-6a7e6d4ed0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:31.245191 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc17a4-28f9-4246-bebd-6a7e6d4ed0be admin admin] PATH_INFO: `/v3/projects/f6490828f86e4a3fb004b2b334e56e71` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:31.246386 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc17a4-28f9-4246-bebd-6a7e6d4ed0be admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6490828f86e4a3fb004b2b334e56e71)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:31.248362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc17a4-28f9-4246-bebd-6a7e6d4ed0be admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:31.383233 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a2cc17a4-28f9-4246-bebd-6a7e6d4ed0be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6490828f86e4a3fb004b2b334e56e71', 'request_id': 'req-a2cc17a4-28f9-4246-bebd-6a7e6d4ed0be'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:31.398706 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:DELETE=16,keystone:SELECT=79,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:31.477248 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a2cc17a4-28f9-4246-bebd-6a7e6d4ed0be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6490828f86e4a3fb004b2b334e56e71', 'request_id': 'req-a2cc17a4-28f9-4246-bebd-6a7e6d4ed0be'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:31.483318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a2cc17a4-28f9-4246-bebd-6a7e6d4ed0be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6490828f86e4a3fb004b2b334e56e71', 'request_id': 'req-a2cc17a4-28f9-4246-bebd-6a7e6d4ed0be'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:31.495697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a2cc17a4-28f9-4246-bebd-6a7e6d4ed0be admin admin] The token cache is being invalidate because project f6490828f86e4a3fb004b2b334e56e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:07:31.495988 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a2cc17a4-28f9-4246-bebd-6a7e6d4ed0be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:31.496637 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a2cc17a4-28f9-4246-bebd-6a7e6d4ed0be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:31.501515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1124/2225] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:07:31 2022] DELETE /identity/v3/projects/f6490828f86e4a3fb004b2b334e56e71 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:31.503153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6b636-8970-4463-a037-8ecd3d4fdf32 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:31.503600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6b636-8970-4463-a037-8ecd3d4fdf32 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:31.503711 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6b636-8970-4463-a037-8ecd3d4fdf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:31.524745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ade6b636-8970-4463-a037-8ecd3d4fdf32 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:31.526042 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ade6b636-8970-4463-a037-8ecd3d4fdf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:31.586480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1102/2226] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:31.594563 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577c3cc-5eda-4720-8596-4c85a01f4a38 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:31.594953 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577c3cc-5eda-4720-8596-4c85a01f4a38 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:31.595405 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577c3cc-5eda-4720-8596-4c85a01f4a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:31.616411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-9577c3cc-5eda-4720-8596-4c85a01f4a38 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:31.617844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9577c3cc-5eda-4720-8596-4c85a01f4a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:31.625948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1125/2227] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:07:31.630065 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6b636-8970-4463-a037-8ecd3d4fdf32 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:31.639770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6b636-8970-4463-a037-8ecd3d4fdf32 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:31.644709 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80890bd-fc01-47db-8c18-6a69df2c2439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:31.645354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80890bd-fc01-47db-8c18-6a69df2c2439 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:31.645636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80890bd-fc01-47db-8c18-6a69df2c2439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:31.648632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80890bd-fc01-47db-8c18-6a69df2c2439 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:31.648632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80890bd-fc01-47db-8c18-6a69df2c2439 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:07:31.648632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80890bd-fc01-47db-8c18-6a69df2c2439 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:31.649109 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80890bd-fc01-47db-8c18-6a69df2c2439 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:31.660546 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1103/2228] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:07:31.665102 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577c3cc-5eda-4720-8596-4c85a01f4a38 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:31.674419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577c3cc-5eda-4720-8596-4c85a01f4a38 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:31.679622 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425500ab-2e02-45b0-81a8-84fe4883a644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:31.680253 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425500ab-2e02-45b0-81a8-84fe4883a644 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:31.683082 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425500ab-2e02-45b0-81a8-84fe4883a644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:31.683082 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425500ab-2e02-45b0-81a8-84fe4883a644 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:31.683082 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425500ab-2e02-45b0-81a8-84fe4883a644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:31.683428 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425500ab-2e02-45b0-81a8-84fe4883a644 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:31.800006 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1126/2229] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:07:31 2022] POST /identity/v3/projects => generated 399 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:07:31.805134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80890bd-fc01-47db-8c18-6a69df2c2439 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:31.809184 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:31.817375 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80890bd-fc01-47db-8c18-6a69df2c2439 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:31.891270 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773188a-ab72-4da2-bc6b-ae466134972b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:31.891901 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773188a-ab72-4da2-bc6b-ae466134972b admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:31.892185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773188a-ab72-4da2-bc6b-ae466134972b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:31.892502 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773188a-ab72-4da2-bc6b-ae466134972b admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:31.893196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773188a-ab72-4da2-bc6b-ae466134972b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:31.895232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773188a-ab72-4da2-bc6b-ae466134972b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:32.028002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1104/2230] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:07:31 2022] POST /identity/v3/users => generated 300 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:07:32.033865 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425500ab-2e02-45b0-81a8-84fe4883a644 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:32.044781 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425500ab-2e02-45b0-81a8-84fe4883a644 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:32.049275 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea043d6-1afe-4d37-ae6d-fe7bee72c1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:32.049888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea043d6-1afe-4d37-ae6d-fe7bee72c1bb admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:32.050216 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea043d6-1afe-4d37-ae6d-fe7bee72c1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:32.050437 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea043d6-1afe-4d37-ae6d-fe7bee72c1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:32.051124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea043d6-1afe-4d37-ae6d-fe7bee72c1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:32.053645 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea043d6-1afe-4d37-ae6d-fe7bee72c1bb admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:32.063674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1127/2231] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:07:32.067657 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773188a-ab72-4da2-bc6b-ae466134972b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:32.078194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773188a-ab72-4da2-bc6b-ae466134972b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:32.087045 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870b790-33b8-4b1f-932f-9bcaea6a7958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:32.087679 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870b790-33b8-4b1f-932f-9bcaea6a7958 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:32.088025 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870b790-33b8-4b1f-932f-9bcaea6a7958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:32.088315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870b790-33b8-4b1f-932f-9bcaea6a7958 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:32.089136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870b790-33b8-4b1f-932f-9bcaea6a7958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:32.090769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870b790-33b8-4b1f-932f-9bcaea6a7958 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:32.105674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1105/2232] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:07:32.106746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea043d6-1afe-4d37-ae6d-fe7bee72c1bb admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:32.117242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea043d6-1afe-4d37-ae6d-fe7bee72c1bb admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:32.122053 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a5dc8-fa28-44a7-8ee3-9fd6e7be3b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:32.122750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a5dc8-fa28-44a7-8ee3-9fd6e7be3b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:32.123062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a5dc8-fa28-44a7-8ee3-9fd6e7be3b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:32.123338 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a5dc8-fa28-44a7-8ee3-9fd6e7be3b11 admin admin] PATH_INFO: `/v3/projects/923479ace4404b7d97c72f8ba318b441/users/42e9f288b5314d7db45f3c366275830d/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:32.139295 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a5dc8-fa28-44a7-8ee3-9fd6e7be3b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=923479ace4404b7d97c72f8ba318b441, user_id=42e9f288b5314d7db45f3c366275830d, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:32.142062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a5dc8-fa28-44a7-8ee3-9fd6e7be3b11 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:32.245042 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1128/2233] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:07:32 2022] PUT /identity/v3/projects/923479ace4404b7d97c72f8ba318b441/users/42e9f288b5314d7db45f3c366275830d/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:32.256571 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3fd72-a771-4ef0-9717-1a2c8c1f6639 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:32.256902 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3fd72-a771-4ef0-9717-1a2c8c1f6639 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:32.257182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3fd72-a771-4ef0-9717-1a2c8c1f6639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:32.286463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1ed3fd72-a771-4ef0-9717-1a2c8c1f6639 None None] MFA Rules not processed for user `42e9f288b5314d7db45f3c366275830d`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:32.288346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1ed3fd72-a771-4ef0-9717-1a2c8c1f6639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:32.355167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1106/2234] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:32.367234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a5dc8-fa28-44a7-8ee3-9fd6e7be3b11 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:32.369299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-455a5dc8-fa28-44a7-8ee3-9fd6e7be3b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:32.427049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a5dc8-fa28-44a7-8ee3-9fd6e7be3b11 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:32.430835 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e280f-3bc0-47ec-b52a-3915f0fee2c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:32.431783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e280f-3bc0-47ec-b52a-3915f0fee2c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:32.432070 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e280f-3bc0-47ec-b52a-3915f0fee2c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:32.432348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e280f-3bc0-47ec-b52a-3915f0fee2c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:32.441026 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e280f-3bc0-47ec-b52a-3915f0fee2c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:32.442475 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e280f-3bc0-47ec-b52a-3915f0fee2c6 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:32.451345 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1129/2235] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:32 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:07:33.182324 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:33.359748 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:33.988394 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:34.246225 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3fd72-a771-4ef0-9717-1a2c8c1f6639 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:34.248140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1ed3fd72-a771-4ef0-9717-1a2c8c1f6639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:34.315845 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3fd72-a771-4ef0-9717-1a2c8c1f6639 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:34.320366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe63303-d308-4564-adf8-657f2632fe1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:34.321038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe63303-d308-4564-adf8-657f2632fe1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:34.321324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe63303-d308-4564-adf8-657f2632fe1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:34.321600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe63303-d308-4564-adf8-657f2632fe1a admin admin] PATH_INFO: `/v3/users/5154fb387db349b0904dc93b5d8b7664` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:34.322838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe63303-d308-4564-adf8-657f2632fe1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5154fb387db349b0904dc93b5d8b7664)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:34.324776 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe63303-d308-4564-adf8-657f2632fe1a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:34.972704 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5fe63303-d308-4564-adf8-657f2632fe1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5154fb387db349b0904dc93b5d8b7664'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:34.977369 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5fe63303-d308-4564-adf8-657f2632fe1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5154fb387db349b0904dc93b5d8b7664'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:34.991470 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5fe63303-d308-4564-adf8-657f2632fe1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5154fb387db349b0904dc93b5d8b7664'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:34.999191 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5fe63303-d308-4564-adf8-657f2632fe1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5154fb387db349b0904dc93b5d8b7664'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:35.001521 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5fe63303-d308-4564-adf8-657f2632fe1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5154fb387db349b0904dc93b5d8b7664'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:35.072094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:35.107252 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1107/2236] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:07:34 2022] DELETE /identity/v3/users/5154fb387db349b0904dc93b5d8b7664 => generated 0 bytes in 862 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:35.360278 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e280f-3bc0-47ec-b52a-3915f0fee2c6 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:35.373811 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e280f-3bc0-47ec-b52a-3915f0fee2c6 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:35.432209 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd90708-7d70-422c-a6fe-c8e9a3f174f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:35.434524 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd90708-7d70-422c-a6fe-c8e9a3f174f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:35.434524 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd90708-7d70-422c-a6fe-c8e9a3f174f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:35.434524 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd90708-7d70-422c-a6fe-c8e9a3f174f3 admin admin] PATH_INFO: `/v3/projects/fe06e7bcd26f4fee926fd2b229aa04fb` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:35.434801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd90708-7d70-422c-a6fe-c8e9a3f174f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe06e7bcd26f4fee926fd2b229aa04fb)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:35.436842 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd90708-7d70-422c-a6fe-c8e9a3f174f3 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:35.529908 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ebd90708-7d70-422c-a6fe-c8e9a3f174f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe06e7bcd26f4fee926fd2b229aa04fb', 'request_id': 'req-ebd90708-7d70-422c-a6fe-c8e9a3f174f3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:35.563591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:35.602892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ebd90708-7d70-422c-a6fe-c8e9a3f174f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe06e7bcd26f4fee926fd2b229aa04fb', 'request_id': 'req-ebd90708-7d70-422c-a6fe-c8e9a3f174f3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:35.611294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ebd90708-7d70-422c-a6fe-c8e9a3f174f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe06e7bcd26f4fee926fd2b229aa04fb', 'request_id': 'req-ebd90708-7d70-422c-a6fe-c8e9a3f174f3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:35.627291 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ebd90708-7d70-422c-a6fe-c8e9a3f174f3 admin admin] The token cache is being invalidate because project fe06e7bcd26f4fee926fd2b229aa04fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:07:35.627630 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ebd90708-7d70-422c-a6fe-c8e9a3f174f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:35.628262 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ebd90708-7d70-422c-a6fe-c8e9a3f174f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:35.634167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe63303-d308-4564-adf8-657f2632fe1a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:35.634656 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1130/2237] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:07:35 2022] DELETE /identity/v3/projects/fe06e7bcd26f4fee926fd2b229aa04fb => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:35.635587 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5fe63303-d308-4564-adf8-657f2632fe1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:35.653513 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe63303-d308-4564-adf8-657f2632fe1a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:35.714293 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c1a37-7f91-4d35-9a0a-d3c684f5fe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:35.714946 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c1a37-7f91-4d35-9a0a-d3c684f5fe24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:35.715228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c1a37-7f91-4d35-9a0a-d3c684f5fe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:35.715511 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c1a37-7f91-4d35-9a0a-d3c684f5fe24 admin admin] PATH_INFO: `/v3/users/f9d4d090e3f24e5b9d1629a3734de3b6` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:35.716828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c1a37-7f91-4d35-9a0a-d3c684f5fe24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9d4d090e3f24e5b9d1629a3734de3b6)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:35.718756 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c1a37-7f91-4d35-9a0a-d3c684f5fe24 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:35.920618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:35.923424 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0c8c1a37-7f91-4d35-9a0a-d3c684f5fe24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9d4d090e3f24e5b9d1629a3734de3b6'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:35.924110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0c8c1a37-7f91-4d35-9a0a-d3c684f5fe24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9d4d090e3f24e5b9d1629a3734de3b6'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:35.936827 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0c8c1a37-7f91-4d35-9a0a-d3c684f5fe24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9d4d090e3f24e5b9d1629a3734de3b6'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:35.943512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0c8c1a37-7f91-4d35-9a0a-d3c684f5fe24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9d4d090e3f24e5b9d1629a3734de3b6'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:35.944153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0c8c1a37-7f91-4d35-9a0a-d3c684f5fe24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9d4d090e3f24e5b9d1629a3734de3b6'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:36.061475 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1108/2238] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:07:35 2022] DELETE /identity/v3/users/f9d4d090e3f24e5b9d1629a3734de3b6 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:07:36.141928 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:36.290688 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd90708-7d70-422c-a6fe-c8e9a3f174f3 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:36.292297 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ebd90708-7d70-422c-a6fe-c8e9a3f174f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:36.307168 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd90708-7d70-422c-a6fe-c8e9a3f174f3 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:36.367880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffafed-9f15-4c8e-bd0e-916fe1a57075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:36.368652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffafed-9f15-4c8e-bd0e-916fe1a57075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:36.368910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffafed-9f15-4c8e-bd0e-916fe1a57075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:36.369190 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffafed-9f15-4c8e-bd0e-916fe1a57075 admin admin] PATH_INFO: `/v3/projects/32d5ec9ddd2b4c748711a67ed79f0902` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:36.370362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffafed-9f15-4c8e-bd0e-916fe1a57075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d5ec9ddd2b4c748711a67ed79f0902)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:36.372599 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffafed-9f15-4c8e-bd0e-916fe1a57075 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:36.421570 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:36.489962 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c9ffafed-9f15-4c8e-bd0e-916fe1a57075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d5ec9ddd2b4c748711a67ed79f0902', 'request_id': 'req-c9ffafed-9f15-4c8e-bd0e-916fe1a57075'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:36.490281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:36.545946 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c9ffafed-9f15-4c8e-bd0e-916fe1a57075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d5ec9ddd2b4c748711a67ed79f0902', 'request_id': 'req-c9ffafed-9f15-4c8e-bd0e-916fe1a57075'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:36.552857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c9ffafed-9f15-4c8e-bd0e-916fe1a57075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d5ec9ddd2b4c748711a67ed79f0902', 'request_id': 'req-c9ffafed-9f15-4c8e-bd0e-916fe1a57075'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:36.564188 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c9ffafed-9f15-4c8e-bd0e-916fe1a57075 admin admin] The token cache is being invalidate because project 32d5ec9ddd2b4c748711a67ed79f0902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:07:36.564483 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c9ffafed-9f15-4c8e-bd0e-916fe1a57075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:36.565170 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c9ffafed-9f15-4c8e-bd0e-916fe1a57075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:36.566716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1131/2239] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:07:36 2022] DELETE /identity/v3/projects/32d5ec9ddd2b4c748711a67ed79f0902 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:36.572170 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ca08e-7a6b-4a90-8ae5-3ae7178b630a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:36.577278 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ca08e-7a6b-4a90-8ae5-3ae7178b630a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:36.577278 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ca08e-7a6b-4a90-8ae5-3ae7178b630a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:36.595181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4d2ca08e-7a6b-4a90-8ae5-3ae7178b630a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:36.596415 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4d2ca08e-7a6b-4a90-8ae5-3ae7178b630a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:36.657996 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1109/2240] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:36.666050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a4d0d-4fd3-4ac4-b45b-a5a0ffa6aff7 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:36.666339 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a4d0d-4fd3-4ac4-b45b-a5a0ffa6aff7 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:36.666616 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a4d0d-4fd3-4ac4-b45b-a5a0ffa6aff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:36.686796 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-de8a4d0d-4fd3-4ac4-b45b-a5a0ffa6aff7 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:36.688032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-de8a4d0d-4fd3-4ac4-b45b-a5a0ffa6aff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:36.696659 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1132/2241] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:36.700958 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ca08e-7a6b-4a90-8ae5-3ae7178b630a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:36.710980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ca08e-7a6b-4a90-8ae5-3ae7178b630a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:36.716670 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e3319-5c07-456a-a947-3e412cdc1ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:36.717485 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e3319-5c07-456a-a947-3e412cdc1ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:36.717764 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e3319-5c07-456a-a947-3e412cdc1ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:36.718037 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e3319-5c07-456a-a947-3e412cdc1ff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:36.718743 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e3319-5c07-456a-a947-3e412cdc1ff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:07:36.719088 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e3319-5c07-456a-a947-3e412cdc1ff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:36.720831 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e3319-5c07-456a-a947-3e412cdc1ff9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:36.721383 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:36.735390 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1110/2242] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:07:36.740174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a4d0d-4fd3-4ac4-b45b-a5a0ffa6aff7 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:36.751009 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a4d0d-4fd3-4ac4-b45b-a5a0ffa6aff7 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:36.757967 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163bcbf-c5c3-4833-9890-1f14f9094063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:36.758725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163bcbf-c5c3-4833-9890-1f14f9094063 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:36.759084 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163bcbf-c5c3-4833-9890-1f14f9094063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:36.759436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163bcbf-c5c3-4833-9890-1f14f9094063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:36.760495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163bcbf-c5c3-4833-9890-1f14f9094063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:36.762913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163bcbf-c5c3-4833-9890-1f14f9094063 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:36.843552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:36.851165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1133/2243] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:07:36 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:07:36.855609 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e3319-5c07-456a-a947-3e412cdc1ff9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:36.866800 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e3319-5c07-456a-a947-3e412cdc1ff9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:36.924437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca10e39-f090-454a-ab9f-d0de42cf17d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:36.925129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca10e39-f090-454a-ab9f-d0de42cf17d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:36.925445 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca10e39-f090-454a-ab9f-d0de42cf17d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:36.925855 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca10e39-f090-454a-ab9f-d0de42cf17d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:36.926529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca10e39-f090-454a-ab9f-d0de42cf17d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:36.929079 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca10e39-f090-454a-ab9f-d0de42cf17d2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:37.027276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1111/2244] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:07:36 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:07:37.031489 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163bcbf-c5c3-4833-9890-1f14f9094063 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:37.042267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163bcbf-c5c3-4833-9890-1f14f9094063 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:37.046792 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a15cf8-3b9e-4939-9f41-eb5b89c9546d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:37.047399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a15cf8-3b9e-4939-9f41-eb5b89c9546d admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:37.047679 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a15cf8-3b9e-4939-9f41-eb5b89c9546d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:37.047947 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a15cf8-3b9e-4939-9f41-eb5b89c9546d admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:37.048639 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a15cf8-3b9e-4939-9f41-eb5b89c9546d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:37.050275 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a15cf8-3b9e-4939-9f41-eb5b89c9546d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:37.060931 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1134/2245] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:07:37.064963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca10e39-f090-454a-ab9f-d0de42cf17d2 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:37.075181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca10e39-f090-454a-ab9f-d0de42cf17d2 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:37.080644 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f50b52-66c2-486b-b629-241ff4732eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:37.081311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f50b52-66c2-486b-b629-241ff4732eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:37.081599 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f50b52-66c2-486b-b629-241ff4732eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:37.081881 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f50b52-66c2-486b-b629-241ff4732eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:37.082627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f50b52-66c2-486b-b629-241ff4732eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:37.084355 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f50b52-66c2-486b-b629-241ff4732eb3 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:37.095350 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1112/2246] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:07:37.101175 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a15cf8-3b9e-4939-9f41-eb5b89c9546d admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:37.111549 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a15cf8-3b9e-4939-9f41-eb5b89c9546d admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:37.116965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4b7cd-9eb4-4d0a-9cd7-727ed97b6db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:37.117638 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4b7cd-9eb4-4d0a-9cd7-727ed97b6db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:37.118025 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4b7cd-9eb4-4d0a-9cd7-727ed97b6db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:37.118351 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4b7cd-9eb4-4d0a-9cd7-727ed97b6db1 admin admin] PATH_INFO: `/v3/projects/30d7d3c8dd444d8c9cd606729291f514/users/80721054a2024f8b9f7921f65c709709/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:37.138582 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4b7cd-9eb4-4d0a-9cd7-727ed97b6db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d7d3c8dd444d8c9cd606729291f514, user_id=80721054a2024f8b9f7921f65c709709, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:37.138582 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4b7cd-9eb4-4d0a-9cd7-727ed97b6db1 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:37.187376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:37.222209 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1135/2247] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:07:37 2022] PUT /identity/v3/projects/30d7d3c8dd444d8c9cd606729291f514/users/80721054a2024f8b9f7921f65c709709/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:37.237219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6224ae-094e-427d-9d59-b7a0fe516816 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:37.238492 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6224ae-094e-427d-9d59-b7a0fe516816 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:37.238774 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6224ae-094e-427d-9d59-b7a0fe516816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:37.267930 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0a6224ae-094e-427d-9d59-b7a0fe516816 None None] MFA Rules not processed for user `80721054a2024f8b9f7921f65c709709`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:37.269271 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0a6224ae-094e-427d-9d59-b7a0fe516816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:37.297155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:37.345215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1113/2248] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:07:37.359008 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4b7cd-9eb4-4d0a-9cd7-727ed97b6db1 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:37.360788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-87f4b7cd-9eb4-4d0a-9cd7-727ed97b6db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:37.421732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4b7cd-9eb4-4d0a-9cd7-727ed97b6db1 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:37.425603 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2923aa3-2d75-4f8a-8ef6-f250f0bffc31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:37.426278 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2923aa3-2d75-4f8a-8ef6-f250f0bffc31 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:37.426572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2923aa3-2d75-4f8a-8ef6-f250f0bffc31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:37.426927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2923aa3-2d75-4f8a-8ef6-f250f0bffc31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:37.436039 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2923aa3-2d75-4f8a-8ef6-f250f0bffc31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:37.437531 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2923aa3-2d75-4f8a-8ef6-f250f0bffc31 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:37.447454 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1136/2249] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:07:37.466951 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:37.468202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6224ae-094e-427d-9d59-b7a0fe516816 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:37.530807 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6224ae-094e-427d-9d59-b7a0fe516816 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:37.535373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd0109-5651-423e-80af-7ea384d8b2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:37.536011 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd0109-5651-423e-80af-7ea384d8b2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:37.536292 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd0109-5651-423e-80af-7ea384d8b2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:37.536563 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd0109-5651-423e-80af-7ea384d8b2ee admin admin] PATH_INFO: `/v3/users/80721054a2024f8b9f7921f65c709709` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:37.538503 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd0109-5651-423e-80af-7ea384d8b2ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=80721054a2024f8b9f7921f65c709709)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:37.540453 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd0109-5651-423e-80af-7ea384d8b2ee admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:37.632664 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:37.680558 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-02dd0109-5651-423e-80af-7ea384d8b2ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80721054a2024f8b9f7921f65c709709'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:37.681274 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-02dd0109-5651-423e-80af-7ea384d8b2ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80721054a2024f8b9f7921f65c709709'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:37.693113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-02dd0109-5651-423e-80af-7ea384d8b2ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80721054a2024f8b9f7921f65c709709'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:37.700734 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-02dd0109-5651-423e-80af-7ea384d8b2ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80721054a2024f8b9f7921f65c709709'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:37.701442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-02dd0109-5651-423e-80af-7ea384d8b2ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80721054a2024f8b9f7921f65c709709'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:37.776175 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1114/2250] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:07:37 2022] DELETE /identity/v3/users/80721054a2024f8b9f7921f65c709709 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:37.781124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eedd8-9007-46f9-8d6f-7f4afe51a41a None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:37.781376 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:37.781665 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eedd8-9007-46f9-8d6f-7f4afe51a41a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:37.782113 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eedd8-9007-46f9-8d6f-7f4afe51a41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:37.801566 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-fa4eedd8-9007-46f9-8d6f-7f4afe51a41a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:37.802841 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fa4eedd8-9007-46f9-8d6f-7f4afe51a41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:37.844188 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:37.862704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1137/2251] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:37.872652 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd0109-5651-423e-80af-7ea384d8b2ee admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:37.874290 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-02dd0109-5651-423e-80af-7ea384d8b2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:37.946537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd0109-5651-423e-80af-7ea384d8b2ee admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:37.950206 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a24e71-54e2-4334-91f7-0f01239e4f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:37.950834 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a24e71-54e2-4334-91f7-0f01239e4f46 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:37.951116 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a24e71-54e2-4334-91f7-0f01239e4f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:37.951394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a24e71-54e2-4334-91f7-0f01239e4f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:37.961433 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a24e71-54e2-4334-91f7-0f01239e4f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:37.962873 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a24e71-54e2-4334-91f7-0f01239e4f46 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:37.972394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1115/2252] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:07:38.498639 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4eedd8-9007-46f9-8d6f-7f4afe51a41a None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:38.501897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fa4eedd8-9007-46f9-8d6f-7f4afe51a41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:38.530948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4eedd8-9007-46f9-8d6f-7f4afe51a41a None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:38.541176 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a1128-25bf-4969-b7b1-40a914b47a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:38.542132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a1128-25bf-4969-b7b1-40a914b47a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:38.543549 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a1128-25bf-4969-b7b1-40a914b47a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:38.543819 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a1128-25bf-4969-b7b1-40a914b47a0d admin admin] PATH_INFO: `/v3/projects/30d7d3c8dd444d8c9cd606729291f514` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:38.545307 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a1128-25bf-4969-b7b1-40a914b47a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d7d3c8dd444d8c9cd606729291f514)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:38.550401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a1128-25bf-4969-b7b1-40a914b47a0d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:38.682098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c67a1128-25bf-4969-b7b1-40a914b47a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d7d3c8dd444d8c9cd606729291f514', 'request_id': 'req-c67a1128-25bf-4969-b7b1-40a914b47a0d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:38.798921 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c67a1128-25bf-4969-b7b1-40a914b47a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d7d3c8dd444d8c9cd606729291f514', 'request_id': 'req-c67a1128-25bf-4969-b7b1-40a914b47a0d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:38.806060 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c67a1128-25bf-4969-b7b1-40a914b47a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d7d3c8dd444d8c9cd606729291f514', 'request_id': 'req-c67a1128-25bf-4969-b7b1-40a914b47a0d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:38.817510 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c67a1128-25bf-4969-b7b1-40a914b47a0d admin admin] The token cache is being invalidate because project 30d7d3c8dd444d8c9cd606729291f514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:07:38.817804 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c67a1128-25bf-4969-b7b1-40a914b47a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:38.818811 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c67a1128-25bf-4969-b7b1-40a914b47a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:38.820363 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1138/2253] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:07:38 2022] DELETE /identity/v3/projects/30d7d3c8dd444d8c9cd606729291f514 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:38.825318 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e1805-90d6-4120-a008-c3aadbe38b09 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:38.825817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e1805-90d6-4120-a008-c3aadbe38b09 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:38.825919 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e1805-90d6-4120-a008-c3aadbe38b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:38.845524 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-973e1805-90d6-4120-a008-c3aadbe38b09 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:38.846719 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-973e1805-90d6-4120-a008-c3aadbe38b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:38.880031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:38.911861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1116/2254] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:38.920202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e7779-823a-4355-9a7a-a7d9d91cffd1 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:38.920502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e7779-823a-4355-9a7a-a7d9d91cffd1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:38.920815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e7779-823a-4355-9a7a-a7d9d91cffd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:38.940992 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-ab9e7779-823a-4355-9a7a-a7d9d91cffd1 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:38.947703 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ab9e7779-823a-4355-9a7a-a7d9d91cffd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:38.950502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1139/2255] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:38.954752 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e1805-90d6-4120-a008-c3aadbe38b09 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:38.965327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e1805-90d6-4120-a008-c3aadbe38b09 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:38.970059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414f9b7-e8a7-4d0b-a335-072d9bdf6975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:38.970689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414f9b7-e8a7-4d0b-a335-072d9bdf6975 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:38.970973 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414f9b7-e8a7-4d0b-a335-072d9bdf6975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:38.971249 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414f9b7-e8a7-4d0b-a335-072d9bdf6975 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:38.971953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414f9b7-e8a7-4d0b-a335-072d9bdf6975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:07:38.972270 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414f9b7-e8a7-4d0b-a335-072d9bdf6975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:38.973903 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414f9b7-e8a7-4d0b-a335-072d9bdf6975 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:38.986806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1117/2256] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:07:38.991667 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e7779-823a-4355-9a7a-a7d9d91cffd1 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:39.000973 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e7779-823a-4355-9a7a-a7d9d91cffd1 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:39.005760 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46023a-9a9e-41c0-8138-d86aaed6ed04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:39.006398 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46023a-9a9e-41c0-8138-d86aaed6ed04 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:39.006683 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46023a-9a9e-41c0-8138-d86aaed6ed04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:39.006961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46023a-9a9e-41c0-8138-d86aaed6ed04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:39.007630 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46023a-9a9e-41c0-8138-d86aaed6ed04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:39.009677 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46023a-9a9e-41c0-8138-d86aaed6ed04 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:39.019465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:39.177912 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1140/2257] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:07:38 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:07:39.183126 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414f9b7-e8a7-4d0b-a335-072d9bdf6975 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:39.194621 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414f9b7-e8a7-4d0b-a335-072d9bdf6975 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:39.262605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e7cb0-2419-4d28-9d71-db2eef84abdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:39.263312 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e7cb0-2419-4d28-9d71-db2eef84abdc admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:39.263584 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e7cb0-2419-4d28-9d71-db2eef84abdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:39.263857 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e7cb0-2419-4d28-9d71-db2eef84abdc admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:39.264528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e7cb0-2419-4d28-9d71-db2eef84abdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:39.266493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e7cb0-2419-4d28-9d71-db2eef84abdc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:39.388202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1118/2258] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:07:39 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:07:39.392464 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46023a-9a9e-41c0-8138-d86aaed6ed04 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:39.403916 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46023a-9a9e-41c0-8138-d86aaed6ed04 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:39.408864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e6a30-cfe5-4152-ac3b-3a6d73db0640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:39.409478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e6a30-cfe5-4152-ac3b-3a6d73db0640 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:39.409763 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e6a30-cfe5-4152-ac3b-3a6d73db0640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:39.410043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e6a30-cfe5-4152-ac3b-3a6d73db0640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:39.410753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e6a30-cfe5-4152-ac3b-3a6d73db0640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:39.412401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e6a30-cfe5-4152-ac3b-3a6d73db0640 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:39.422889 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1141/2259] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:07:39.426904 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e7cb0-2419-4d28-9d71-db2eef84abdc admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:39.438133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e7cb0-2419-4d28-9d71-db2eef84abdc admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:39.443047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d16dfa-1531-49b2-baeb-07a9f7e89db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:39.443750 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d16dfa-1531-49b2-baeb-07a9f7e89db7 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:39.444644 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d16dfa-1531-49b2-baeb-07a9f7e89db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:39.444993 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d16dfa-1531-49b2-baeb-07a9f7e89db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:39.445728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d16dfa-1531-49b2-baeb-07a9f7e89db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:39.447386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d16dfa-1531-49b2-baeb-07a9f7e89db7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:39.462068 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1119/2260] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:07:39.467206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e6a30-cfe5-4152-ac3b-3a6d73db0640 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:39.477589 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e6a30-cfe5-4152-ac3b-3a6d73db0640 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:39.482078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e7c64-8d9d-4637-8425-dc7b9e91983f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:39.482801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e7c64-8d9d-4637-8425-dc7b9e91983f admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:39.483089 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e7c64-8d9d-4637-8425-dc7b9e91983f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:39.483373 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e7c64-8d9d-4637-8425-dc7b9e91983f admin admin] PATH_INFO: `/v3/projects/fc9ce99238eb474190173f8d3179ab3b/users/a86982bdc0cf41d8a63d1cb49d859fbf/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:39.499196 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e7c64-8d9d-4637-8425-dc7b9e91983f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc9ce99238eb474190173f8d3179ab3b, user_id=a86982bdc0cf41d8a63d1cb49d859fbf, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:39.501951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e7c64-8d9d-4637-8425-dc7b9e91983f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:39.604022 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1142/2261] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:07:39 2022] PUT /identity/v3/projects/fc9ce99238eb474190173f8d3179ab3b/users/a86982bdc0cf41d8a63d1cb49d859fbf/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:39.615280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d7226-c2d2-4f68-85b3-489414c784ac None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:39.615609 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d7226-c2d2-4f68-85b3-489414c784ac None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:39.616694 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d7226-c2d2-4f68-85b3-489414c784ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:39.644707 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fd2d7226-c2d2-4f68-85b3-489414c784ac None None] MFA Rules not processed for user `a86982bdc0cf41d8a63d1cb49d859fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:39.645954 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fd2d7226-c2d2-4f68-85b3-489414c784ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:39.713410 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1120/2262] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:39.717897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e7c64-8d9d-4637-8425-dc7b9e91983f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:39.760488 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d7226-c2d2-4f68-85b3-489414c784ac None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:39.761959 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fd2d7226-c2d2-4f68-85b3-489414c784ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:39.788958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e7c64-8d9d-4637-8425-dc7b9e91983f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:39.794486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b055e-9855-484c-a621-214a17f172bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:39.795367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b055e-9855-484c-a621-214a17f172bc admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:39.795659 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b055e-9855-484c-a621-214a17f172bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:39.795941 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b055e-9855-484c-a621-214a17f172bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:39.796625 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b055e-9855-484c-a621-214a17f172bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:39.799050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b055e-9855-484c-a621-214a17f172bc admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:39.807506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:39.841980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d7226-c2d2-4f68-85b3-489414c784ac None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:39.847026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6386e-4aeb-4f34-ac22-c946757af243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:39.847867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6386e-4aeb-4f34-ac22-c946757af243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:39.848417 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6386e-4aeb-4f34-ac22-c946757af243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:39.848947 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6386e-4aeb-4f34-ac22-c946757af243 admin admin] PATH_INFO: `/v3/users/42e9f288b5314d7db45f3c366275830d` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:39.850623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6386e-4aeb-4f34-ac22-c946757af243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42e9f288b5314d7db45f3c366275830d)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:39.852657 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6386e-4aeb-4f34-ac22-c946757af243 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:39.911319 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1143/2263] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:07:39 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:07:39.915361 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b055e-9855-484c-a621-214a17f172bc admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:39.989547 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b055e-9855-484c-a621-214a17f172bc admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:39.995157 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b56f97-c6b6-4946-8700-2e6f849abe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:39.995775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b56f97-c6b6-4946-8700-2e6f849abe85 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:39.996080 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b56f97-c6b6-4946-8700-2e6f849abe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:39.996356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b56f97-c6b6-4946-8700-2e6f849abe85 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:39.997125 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b56f97-c6b6-4946-8700-2e6f849abe85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:39.999120 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b56f97-c6b6-4946-8700-2e6f849abe85 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:40.110438 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-41e6386e-4aeb-4f34-ac22-c946757af243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42e9f288b5314d7db45f3c366275830d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:40.111159 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-41e6386e-4aeb-4f34-ac22-c946757af243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42e9f288b5314d7db45f3c366275830d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:40.113449 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1144/2264] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:07:39 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:07:40.118220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b56f97-c6b6-4946-8700-2e6f849abe85 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:40.125153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-41e6386e-4aeb-4f34-ac22-c946757af243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42e9f288b5314d7db45f3c366275830d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:40.128148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b56f97-c6b6-4946-8700-2e6f849abe85 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:40.132142 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-41e6386e-4aeb-4f34-ac22-c946757af243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42e9f288b5314d7db45f3c366275830d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:40.132848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-41e6386e-4aeb-4f34-ac22-c946757af243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42e9f288b5314d7db45f3c366275830d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:40.133638 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045cfba-0b16-4d44-a024-ed415d3d576e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:40.134355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045cfba-0b16-4d44-a024-ed415d3d576e admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:40.134650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045cfba-0b16-4d44-a024-ed415d3d576e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:40.134961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045cfba-0b16-4d44-a024-ed415d3d576e admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:40.135664 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045cfba-0b16-4d44-a024-ed415d3d576e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:40.137381 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045cfba-0b16-4d44-a024-ed415d3d576e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:40.148058 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1145/2265] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:07:40.151889 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045cfba-0b16-4d44-a024-ed415d3d576e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:40.153583 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a045cfba-0b16-4d44-a024-ed415d3d576e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:40.166677 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045cfba-0b16-4d44-a024-ed415d3d576e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:40.171282 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ea609-1e59-452b-a6eb-fc9f5b229c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:40.171863 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ea609-1e59-452b-a6eb-fc9f5b229c47 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:40.172142 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ea609-1e59-452b-a6eb-fc9f5b229c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:40.172414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ea609-1e59-452b-a6eb-fc9f5b229c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:40.173115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ea609-1e59-452b-a6eb-fc9f5b229c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:40.174687 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ea609-1e59-452b-a6eb-fc9f5b229c47 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:40.185110 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1146/2266] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:07:40.189117 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ea609-1e59-452b-a6eb-fc9f5b229c47 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:40.198348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ea609-1e59-452b-a6eb-fc9f5b229c47 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:40.202915 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d950aa2-8bca-4280-b636-57bb8954e45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:40.203507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d950aa2-8bca-4280-b636-57bb8954e45d admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:40.203786 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d950aa2-8bca-4280-b636-57bb8954e45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:40.204059 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d950aa2-8bca-4280-b636-57bb8954e45d admin admin] PATH_INFO: `/v3/projects/4b9b388dfb0a41fb8aff3c29ce1b6061/users/626c1b0c4f654ab8815ef3390b46f479/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:40.206378 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:40.210487 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1121/2267] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:07:39 2022] DELETE /identity/v3/users/42e9f288b5314d7db45f3c366275830d => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:07:40.214970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfae7e-9ec3-4867-b7d5-2013c34e813d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:40.216456 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfae7e-9ec3-4867-b7d5-2013c34e813d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:40.216456 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfae7e-9ec3-4867-b7d5-2013c34e813d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:40.220179 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d950aa2-8bca-4280-b636-57bb8954e45d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9b388dfb0a41fb8aff3c29ce1b6061, user_id=626c1b0c4f654ab8815ef3390b46f479, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:40.223051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d950aa2-8bca-4280-b636-57bb8954e45d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:40.235849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-66bfae7e-9ec3-4867-b7d5-2013c34e813d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:40.237103 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-66bfae7e-9ec3-4867-b7d5-2013c34e813d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:40.301116 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1122/2268] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:07:40.308632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1147/2269] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:07:40 2022] PUT /identity/v3/projects/4b9b388dfb0a41fb8aff3c29ce1b6061/users/626c1b0c4f654ab8815ef3390b46f479/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:07:40.313364 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfae7e-9ec3-4867-b7d5-2013c34e813d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:40.317944 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-66bfae7e-9ec3-4867-b7d5-2013c34e813d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:40.319336 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ef802-c4e0-4800-93fb-a8386bcb5fe3 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:40.319725 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ef802-c4e0-4800-93fb-a8386bcb5fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:40.320076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ef802-c4e0-4800-93fb-a8386bcb5fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:40.354521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b75ef802-c4e0-4800-93fb-a8386bcb5fe3 None None] MFA Rules not processed for user `626c1b0c4f654ab8815ef3390b46f479`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:40.355588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b75ef802-c4e0-4800-93fb-a8386bcb5fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:40.382365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfae7e-9ec3-4867-b7d5-2013c34e813d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:40.386402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:40.433259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1148/2270] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:07:40.437808 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ef802-c4e0-4800-93fb-a8386bcb5fe3 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:40.501873 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912534fd-f2f5-44d8-a619-abb006d1a5c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:40.502578 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912534fd-f2f5-44d8-a619-abb006d1a5c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:40.502842 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912534fd-f2f5-44d8-a619-abb006d1a5c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:40.503151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912534fd-f2f5-44d8-a619-abb006d1a5c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:40.511711 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ef802-c4e0-4800-93fb-a8386bcb5fe3 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:40.513210 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912534fd-f2f5-44d8-a619-abb006d1a5c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:40.514707 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912534fd-f2f5-44d8-a619-abb006d1a5c1 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:40.516332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad1c70-a83c-4174-8907-68d42afc91fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:40.517093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1c70-a83c-4174-8907-68d42afc91fa admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:40.517613 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1c70-a83c-4174-8907-68d42afc91fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:40.517734 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1c70-a83c-4174-8907-68d42afc91fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:40.518338 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad1c70-a83c-4174-8907-68d42afc91fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:40.520582 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad1c70-a83c-4174-8907-68d42afc91fa admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:40.525439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1123/2271] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:07:40.641139 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1149/2272] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:07:40 2022] POST /identity/v3/projects => generated 377 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:07:40.645391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912534fd-f2f5-44d8-a619-abb006d1a5c1 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:40.655127 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912534fd-f2f5-44d8-a619-abb006d1a5c1 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:40.717156 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bca7d5-bfbb-4bd1-8caa-2621c7974767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:40.717788 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bca7d5-bfbb-4bd1-8caa-2621c7974767 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:40.718071 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bca7d5-bfbb-4bd1-8caa-2621c7974767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:40.718377 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bca7d5-bfbb-4bd1-8caa-2621c7974767 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:40.719050 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bca7d5-bfbb-4bd1-8caa-2621c7974767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:40.721019 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bca7d5-bfbb-4bd1-8caa-2621c7974767 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:40.839329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1124/2273] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:07:40 2022] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:07:40.843860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad1c70-a83c-4174-8907-68d42afc91fa admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:40.855533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad1c70-a83c-4174-8907-68d42afc91fa admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:40.860773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2640b-7663-4884-945f-6b6515bda326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:40.861404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2640b-7663-4884-945f-6b6515bda326 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:40.861687 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2640b-7663-4884-945f-6b6515bda326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:40.861962 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2640b-7663-4884-945f-6b6515bda326 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:40.862670 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2640b-7663-4884-945f-6b6515bda326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:40.864318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2640b-7663-4884-945f-6b6515bda326 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:40.876482 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1150/2274] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:07:40.881113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bca7d5-bfbb-4bd1-8caa-2621c7974767 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:40.893975 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bca7d5-bfbb-4bd1-8caa-2621c7974767 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:40.898727 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fdecd-9009-4ac6-a442-6e7fb4ad8a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:40.900828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fdecd-9009-4ac6-a442-6e7fb4ad8a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:40.900828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fdecd-9009-4ac6-a442-6e7fb4ad8a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:40.900828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fdecd-9009-4ac6-a442-6e7fb4ad8a13 admin admin] PATH_INFO: `/v3/projects/19013cb2af6a4a238b6617345af30bea/users/3793b5a56e8d4ae4bc40da2c2f0cd3c3/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:40.916041 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fdecd-9009-4ac6-a442-6e7fb4ad8a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19013cb2af6a4a238b6617345af30bea, user_id=3793b5a56e8d4ae4bc40da2c2f0cd3c3, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:40.918893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fdecd-9009-4ac6-a442-6e7fb4ad8a13 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:40.932491 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2640b-7663-4884-945f-6b6515bda326 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:40.937530 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-33d2640b-7663-4884-945f-6b6515bda326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:40.948339 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2640b-7663-4884-945f-6b6515bda326 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:40.953600 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1660268-6a58-4dc1-ba9b-e6af32d37d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:40.954245 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1660268-6a58-4dc1-ba9b-e6af32d37d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:40.954579 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1660268-6a58-4dc1-ba9b-e6af32d37d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:40.954862 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1660268-6a58-4dc1-ba9b-e6af32d37d3f admin admin] PATH_INFO: `/v3/projects/923479ace4404b7d97c72f8ba318b441` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:40.956525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1660268-6a58-4dc1-ba9b-e6af32d37d3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=923479ace4404b7d97c72f8ba318b441)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:40.958217 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1660268-6a58-4dc1-ba9b-e6af32d37d3f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:41.014019 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1125/2275] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:07:40 2022] PUT /identity/v3/projects/19013cb2af6a4a238b6617345af30bea/users/3793b5a56e8d4ae4bc40da2c2f0cd3c3/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:41.018952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fdecd-9009-4ac6-a442-6e7fb4ad8a13 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:41.067042 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:41.073105 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e1660268-6a58-4dc1-ba9b-e6af32d37d3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '923479ace4404b7d97c72f8ba318b441', 'request_id': 'req-e1660268-6a58-4dc1-ba9b-e6af32d37d3f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:41.087735 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fdecd-9009-4ac6-a442-6e7fb4ad8a13 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:41.106419 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:41.147602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9876ca-2761-4882-b93a-bd2dbe174262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:41.148227 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9876ca-2761-4882-b93a-bd2dbe174262 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:41.148512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9876ca-2761-4882-b93a-bd2dbe174262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:41.148804 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9876ca-2761-4882-b93a-bd2dbe174262 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:41.149512 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9876ca-2761-4882-b93a-bd2dbe174262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:41.151109 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9876ca-2761-4882-b93a-bd2dbe174262 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:41.164950 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1126/2276] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:07:41.165987 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9876ca-2761-4882-b93a-bd2dbe174262 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:41.175789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9876ca-2761-4882-b93a-bd2dbe174262 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:41.181345 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d5580-0bc6-4f36-ad3b-4401ae01dbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:41.182019 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d5580-0bc6-4f36-ad3b-4401ae01dbb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:41.182304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d5580-0bc6-4f36-ad3b-4401ae01dbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:41.182603 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d5580-0bc6-4f36-ad3b-4401ae01dbb5 admin admin] PATH_INFO: `/v3/projects/19013cb2af6a4a238b6617345af30bea/users/3793b5a56e8d4ae4bc40da2c2f0cd3c3/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:41.184564 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d5580-0bc6-4f36-ad3b-4401ae01dbb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19013cb2af6a4a238b6617345af30bea, user_id=3793b5a56e8d4ae4bc40da2c2f0cd3c3, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:41.187256 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d5580-0bc6-4f36-ad3b-4401ae01dbb5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:41.193301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e1660268-6a58-4dc1-ba9b-e6af32d37d3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '923479ace4404b7d97c72f8ba318b441', 'request_id': 'req-e1660268-6a58-4dc1-ba9b-e6af32d37d3f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:41.198905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1127/2277] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:07:41 2022] PUT /identity/v3/projects/19013cb2af6a4a238b6617345af30bea/users/3793b5a56e8d4ae4bc40da2c2f0cd3c3/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:41.201156 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e1660268-6a58-4dc1-ba9b-e6af32d37d3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '923479ace4404b7d97c72f8ba318b441', 'request_id': 'req-e1660268-6a58-4dc1-ba9b-e6af32d37d3f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:41.237193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f9253-90c2-423f-a766-b1e7bd4554a1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:41.237193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f9253-90c2-423f-a766-b1e7bd4554a1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:41.237193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f9253-90c2-423f-a766-b1e7bd4554a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:41.237543 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e1660268-6a58-4dc1-ba9b-e6af32d37d3f admin admin] The token cache is being invalidate because project 923479ace4404b7d97c72f8ba318b441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:07:41.237543 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e1660268-6a58-4dc1-ba9b-e6af32d37d3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:41.237543 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e1660268-6a58-4dc1-ba9b-e6af32d37d3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:41.237543 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1151/2278] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:07:40 2022] DELETE /identity/v3/projects/923479ace4404b7d97c72f8ba318b441 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:41.248194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-983f9253-90c2-423f-a766-b1e7bd4554a1 None None] MFA Rules not processed for user `3793b5a56e8d4ae4bc40da2c2f0cd3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:41.249496 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-983f9253-90c2-423f-a766-b1e7bd4554a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:41.335985 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1128/2279] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:41.353528 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1660268-6a58-4dc1-ba9b-e6af32d37d3f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:41.355927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e1660268-6a58-4dc1-ba9b-e6af32d37d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:41.426497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1660268-6a58-4dc1-ba9b-e6af32d37d3f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:41.482078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a3475-5458-4e3b-b646-4ef3626534cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:41.482713 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a3475-5458-4e3b-b646-4ef3626534cb service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:41.483001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a3475-5458-4e3b-b646-4ef3626534cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:41.483279 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a3475-5458-4e3b-b646-4ef3626534cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:41.485097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-be3a3475-5458-4e3b-b646-4ef3626534cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:41.548669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a3475-5458-4e3b-b646-4ef3626534cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:41.550212 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a3475-5458-4e3b-b646-4ef3626534cb service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:41.559500 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1152/2280] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:07:44.565720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f9253-90c2-423f-a766-b1e7bd4554a1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:44.575746 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f9253-90c2-423f-a766-b1e7bd4554a1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:44.579274 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b127c-4cde-4c2d-bf85-2b80bfca9a05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:44.579886 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b127c-4cde-4c2d-bf85-2b80bfca9a05 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:44.580193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b127c-4cde-4c2d-bf85-2b80bfca9a05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:44.580464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b127c-4cde-4c2d-bf85-2b80bfca9a05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:44.582293 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-230b127c-4cde-4c2d-bf85-2b80bfca9a05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:44.669129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b127c-4cde-4c2d-bf85-2b80bfca9a05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:44.670689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b127c-4cde-4c2d-bf85-2b80bfca9a05 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:44.680691 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1129/2281] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:07:46.348620 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a3475-5458-4e3b-b646-4ef3626534cb service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:46.358453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a3475-5458-4e3b-b646-4ef3626534cb service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:46.362673 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696a8bc-4307-41f6-8cf6-d3ff4a04b104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:46.363302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696a8bc-4307-41f6-8cf6-d3ff4a04b104 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:46.363587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696a8bc-4307-41f6-8cf6-d3ff4a04b104 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:46.363892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696a8bc-4307-41f6-8cf6-d3ff4a04b104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:46.375298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696a8bc-4307-41f6-8cf6-d3ff4a04b104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:46.376791 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696a8bc-4307-41f6-8cf6-d3ff4a04b104 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:46.389007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1153/2282] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:07:52.029924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b127c-4cde-4c2d-bf85-2b80bfca9a05 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:52.031378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-230b127c-4cde-4c2d-bf85-2b80bfca9a05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:52.076924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:52.109724 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b127c-4cde-4c2d-bf85-2b80bfca9a05 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:52.114283 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0ccf4-defb-4b78-aeef-38fd0522c098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:52.114920 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0ccf4-defb-4b78-aeef-38fd0522c098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:52.115201 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0ccf4-defb-4b78-aeef-38fd0522c098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:52.115477 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0ccf4-defb-4b78-aeef-38fd0522c098 admin admin] PATH_INFO: `/v3/users/a86982bdc0cf41d8a63d1cb49d859fbf` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:52.116993 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0ccf4-defb-4b78-aeef-38fd0522c098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86982bdc0cf41d8a63d1cb49d859fbf)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:52.118923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0ccf4-defb-4b78-aeef-38fd0522c098 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:52.326245 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fce0ccf4-defb-4b78-aeef-38fd0522c098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86982bdc0cf41d8a63d1cb49d859fbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:52.326914 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fce0ccf4-defb-4b78-aeef-38fd0522c098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86982bdc0cf41d8a63d1cb49d859fbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:52.347377 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fce0ccf4-defb-4b78-aeef-38fd0522c098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86982bdc0cf41d8a63d1cb49d859fbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:52.354829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fce0ccf4-defb-4b78-aeef-38fd0522c098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86982bdc0cf41d8a63d1cb49d859fbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:52.355562 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fce0ccf4-defb-4b78-aeef-38fd0522c098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86982bdc0cf41d8a63d1cb49d859fbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:52.450661 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1130/2283] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:07:52 2022] DELETE /identity/v3/users/a86982bdc0cf41d8a63d1cb49d859fbf => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:52.455018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a10840-686e-4551-9e95-d92bb0e2606e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:52.459164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a10840-686e-4551-9e95-d92bb0e2606e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:52.459164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a10840-686e-4551-9e95-d92bb0e2606e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:52.474305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-75a10840-686e-4551-9e95-d92bb0e2606e None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:52.475447 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-75a10840-686e-4551-9e95-d92bb0e2606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:52.496032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:52.534170 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1154/2284] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:52.543924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0ccf4-defb-4b78-aeef-38fd0522c098 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:52.545362 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fce0ccf4-defb-4b78-aeef-38fd0522c098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:52.603425 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0ccf4-defb-4b78-aeef-38fd0522c098 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:52.607012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7b30b-44c4-402c-8cc7-fcef142f3857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:52.607632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7b30b-44c4-402c-8cc7-fcef142f3857 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:52.607916 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7b30b-44c4-402c-8cc7-fcef142f3857 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:52.608192 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7b30b-44c4-402c-8cc7-fcef142f3857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:52.617675 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7b30b-44c4-402c-8cc7-fcef142f3857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:52.619111 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7b30b-44c4-402c-8cc7-fcef142f3857 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:52.628598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1131/2285] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:07:53.027943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae0cee-7237-47b5-bf8a-d6fe35c5cf9d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:53.028234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae0cee-7237-47b5-bf8a-d6fe35c5cf9d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:53.028513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae0cee-7237-47b5-bf8a-d6fe35c5cf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:53.048023 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0cae0cee-7237-47b5-bf8a-d6fe35c5cf9d None None] MFA Rules not processed for user `1cbbfdda843a4ab98ff9cf0742513f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:53.049174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0cae0cee-7237-47b5-bf8a-d6fe35c5cf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:53.070878 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7b30b-44c4-402c-8cc7-fcef142f3857 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:53.073927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6fe7b30b-44c4-402c-8cc7-fcef142f3857 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:53.087193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7b30b-44c4-402c-8cc7-fcef142f3857 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:53.093139 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291280a-d18a-4e2f-ac78-b4a3f6a1e963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:53.093872 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291280a-d18a-4e2f-ac78-b4a3f6a1e963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:53.094190 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291280a-d18a-4e2f-ac78-b4a3f6a1e963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:53.094465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291280a-d18a-4e2f-ac78-b4a3f6a1e963 admin admin] PATH_INFO: `/v3/projects/fc9ce99238eb474190173f8d3179ab3b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:53.103107 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291280a-d18a-4e2f-ac78-b4a3f6a1e963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc9ce99238eb474190173f8d3179ab3b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:53.105226 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291280a-d18a-4e2f-ac78-b4a3f6a1e963 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:53.119988 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1155/2286] 10.222.0.75 () {58 vars in 1009 bytes} [Thu Jul 28 18:07:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:53.160760 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae0cee-7237-47b5-bf8a-d6fe35c5cf9d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:53.162187 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0cae0cee-7237-47b5-bf8a-d6fe35c5cf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:53.232663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae0cee-7237-47b5-bf8a-d6fe35c5cf9d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:53.237838 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6366b3-d35e-4c40-bce4-593fde2fd310 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77b4fcb974d48a0bda4852c8d304511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:53.238462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6366b3-d35e-4c40-bce4-593fde2fd310 service swift] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:53.238747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6366b3-d35e-4c40-bce4-593fde2fd310 service swift] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:53.239025 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6366b3-d35e-4c40-bce4-593fde2fd310 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:53.247946 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6366b3-d35e-4c40-bce4-593fde2fd310 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:53.249317 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:53.249651 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6366b3-d35e-4c40-bce4-593fde2fd310 service swift] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:53.252236 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9291280a-d18a-4e2f-ac78-b4a3f6a1e963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc9ce99238eb474190173f8d3179ab3b', 'request_id': 'req-9291280a-d18a-4e2f-ac78-b4a3f6a1e963'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:53.258356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1156/2287] 10.222.0.75 () {60 vars in 1384 bytes} [Thu Jul 28 18:07:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 18:07:53.259168 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9291280a-d18a-4e2f-ac78-b4a3f6a1e963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc9ce99238eb474190173f8d3179ab3b', 'request_id': 'req-9291280a-d18a-4e2f-ac78-b4a3f6a1e963'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:53.266178 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9291280a-d18a-4e2f-ac78-b4a3f6a1e963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc9ce99238eb474190173f8d3179ab3b', 'request_id': 'req-9291280a-d18a-4e2f-ac78-b4a3f6a1e963'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:53.376013 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9291280a-d18a-4e2f-ac78-b4a3f6a1e963 admin admin] The token cache is being invalidate because project fc9ce99238eb474190173f8d3179ab3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:07:53.376307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9291280a-d18a-4e2f-ac78-b4a3f6a1e963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:53.376957 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9291280a-d18a-4e2f-ac78-b4a3f6a1e963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:53.378482 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1132/2288] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:07:53 2022] DELETE /identity/v3/projects/fc9ce99238eb474190173f8d3179ab3b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:53.383061 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6366b3-d35e-4c40-bce4-593fde2fd310 service swift] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:53.393730 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6366b3-d35e-4c40-bce4-593fde2fd310 service swift] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:53.466202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f01cf-cdb9-40a1-a550-f47bbf634288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:53.466908 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f01cf-cdb9-40a1-a550-f47bbf634288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:53.467261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f01cf-cdb9-40a1-a550-f47bbf634288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:53.467544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f01cf-cdb9-40a1-a550-f47bbf634288 admin admin] PATH_INFO: `/v3/users/626c1b0c4f654ab8815ef3390b46f479` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:53.468792 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f01cf-cdb9-40a1-a550-f47bbf634288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=626c1b0c4f654ab8815ef3390b46f479)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:53.470768 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f01cf-cdb9-40a1-a550-f47bbf634288 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:53.473497 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:53.680875 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-916f01cf-cdb9-40a1-a550-f47bbf634288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '626c1b0c4f654ab8815ef3390b46f479'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:53.764411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-916f01cf-cdb9-40a1-a550-f47bbf634288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '626c1b0c4f654ab8815ef3390b46f479'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:53.781417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-916f01cf-cdb9-40a1-a550-f47bbf634288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '626c1b0c4f654ab8815ef3390b46f479'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:53.794067 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-916f01cf-cdb9-40a1-a550-f47bbf634288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '626c1b0c4f654ab8815ef3390b46f479'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:53.794882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-916f01cf-cdb9-40a1-a550-f47bbf634288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '626c1b0c4f654ab8815ef3390b46f479'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:53.804307 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1157/2289] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:07:53 2022] DELETE /identity/v3/users/626c1b0c4f654ab8815ef3390b46f479 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:07:54.231321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291280a-d18a-4e2f-ac78-b4a3f6a1e963 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:54.231321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9291280a-d18a-4e2f-ac78-b4a3f6a1e963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:54.235871 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46134abf-25a3-48db-adea-6f27f40e7e0b None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:54.236168 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46134abf-25a3-48db-adea-6f27f40e7e0b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:54.236452 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46134abf-25a3-48db-adea-6f27f40e7e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:54.244904 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291280a-d18a-4e2f-ac78-b4a3f6a1e963 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:54.259190 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-46134abf-25a3-48db-adea-6f27f40e7e0b None None] MFA Rules not processed for user `1cbbfdda843a4ab98ff9cf0742513f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:54.260456 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-46134abf-25a3-48db-adea-6f27f40e7e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:54.305493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f845841-a50d-40db-90ab-2bccf48b6488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:54.306214 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f845841-a50d-40db-90ab-2bccf48b6488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:54.306632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f845841-a50d-40db-90ab-2bccf48b6488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:54.306970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f845841-a50d-40db-90ab-2bccf48b6488 admin admin] PATH_INFO: `/v3/projects/4b9b388dfb0a41fb8aff3c29ce1b6061` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:54.308236 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f845841-a50d-40db-90ab-2bccf48b6488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9b388dfb0a41fb8aff3c29ce1b6061)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:54.310253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f845841-a50d-40db-90ab-2bccf48b6488 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:54.320921 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1158/2290] 10.222.0.75 () {58 vars in 967 bytes} [Thu Jul 28 18:07:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:07:54.334472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46134abf-25a3-48db-adea-6f27f40e7e0b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:54.340357 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-46134abf-25a3-48db-adea-6f27f40e7e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:54.409271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46134abf-25a3-48db-adea-6f27f40e7e0b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:54.414943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377edadb-b50e-4869-9c75-218b4c581f11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77b4fcb974d48a0bda4852c8d304511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:54.415602 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377edadb-b50e-4869-9c75-218b4c581f11 service swift] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:54.415887 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377edadb-b50e-4869-9c75-218b4c581f11 service swift] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:54.416168 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377edadb-b50e-4869-9c75-218b4c581f11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:54.424379 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377edadb-b50e-4869-9c75-218b4c581f11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:54.426040 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377edadb-b50e-4869-9c75-218b4c581f11 service swift] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:54.434594 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1159/2291] 10.222.0.75 () {60 vars in 1384 bytes} [Thu Jul 28 18:07:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 18:07:54.498779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2f845841-a50d-40db-90ab-2bccf48b6488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9b388dfb0a41fb8aff3c29ce1b6061', 'request_id': 'req-2f845841-a50d-40db-90ab-2bccf48b6488'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:54.504263 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2f845841-a50d-40db-90ab-2bccf48b6488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9b388dfb0a41fb8aff3c29ce1b6061', 'request_id': 'req-2f845841-a50d-40db-90ab-2bccf48b6488'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:54.511120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2f845841-a50d-40db-90ab-2bccf48b6488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9b388dfb0a41fb8aff3c29ce1b6061', 'request_id': 'req-2f845841-a50d-40db-90ab-2bccf48b6488'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:54.668836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2f845841-a50d-40db-90ab-2bccf48b6488 admin admin] The token cache is being invalidate because project 4b9b388dfb0a41fb8aff3c29ce1b6061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:07:54.669144 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2f845841-a50d-40db-90ab-2bccf48b6488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:54.669795 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2f845841-a50d-40db-90ab-2bccf48b6488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:54.671329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1133/2292] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:07:54 2022] DELETE /identity/v3/projects/4b9b388dfb0a41fb8aff3c29ce1b6061 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:54.675444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377edadb-b50e-4869-9c75-218b4c581f11 service swift] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:54.677020 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-377edadb-b50e-4869-9c75-218b4c581f11 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:54.695246 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377edadb-b50e-4869-9c75-218b4c581f11 service swift] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:54.708346 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:54.756236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8a150-4a5a-4207-9c7f-497664b7dbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:54.757498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8a150-4a5a-4207-9c7f-497664b7dbcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:54.757790 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8a150-4a5a-4207-9c7f-497664b7dbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:54.758103 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8a150-4a5a-4207-9c7f-497664b7dbcd admin admin] PATH_INFO: `/v3/users/3793b5a56e8d4ae4bc40da2c2f0cd3c3` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:54.759350 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8a150-4a5a-4207-9c7f-497664b7dbcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3793b5a56e8d4ae4bc40da2c2f0cd3c3)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:54.761342 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8a150-4a5a-4207-9c7f-497664b7dbcd admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:54.967590 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7eb8a150-4a5a-4207-9c7f-497664b7dbcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3793b5a56e8d4ae4bc40da2c2f0cd3c3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:55.049035 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7eb8a150-4a5a-4207-9c7f-497664b7dbcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3793b5a56e8d4ae4bc40da2c2f0cd3c3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:55.063754 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7eb8a150-4a5a-4207-9c7f-497664b7dbcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3793b5a56e8d4ae4bc40da2c2f0cd3c3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:55.070208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7eb8a150-4a5a-4207-9c7f-497664b7dbcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3793b5a56e8d4ae4bc40da2c2f0cd3c3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:55.070973 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7eb8a150-4a5a-4207-9c7f-497664b7dbcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3793b5a56e8d4ae4bc40da2c2f0cd3c3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:55.077451 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1160/2293] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:07:54 2022] DELETE /identity/v3/users/3793b5a56e8d4ae4bc40da2c2f0cd3c3 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:55.257476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25ca60-2a14-4b6f-9901-bf184484f6bc None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:55.258589 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25ca60-2a14-4b6f-9901-bf184484f6bc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:55.259001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25ca60-2a14-4b6f-9901-bf184484f6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:55.280279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ee25ca60-2a14-4b6f-9901-bf184484f6bc None None] MFA Rules not processed for user `1cbbfdda843a4ab98ff9cf0742513f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:55.281629 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ee25ca60-2a14-4b6f-9901-bf184484f6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:55.353663 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1134/2294] 10.222.0.75 () {58 vars in 1009 bytes} [Thu Jul 28 18:07:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:07:55.366923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8a150-4a5a-4207-9c7f-497664b7dbcd admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:55.368621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7eb8a150-4a5a-4207-9c7f-497664b7dbcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:55.441232 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8a150-4a5a-4207-9c7f-497664b7dbcd admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:55.449127 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba79866-2221-4135-bb31-7865fe1c6689 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77b4fcb974d48a0bda4852c8d304511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:55.450811 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79866-2221-4135-bb31-7865fe1c6689 service swift] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:55.451120 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79866-2221-4135-bb31-7865fe1c6689 service swift] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:55.451412 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79866-2221-4135-bb31-7865fe1c6689 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:55.466674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba79866-2221-4135-bb31-7865fe1c6689 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:55.468299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba79866-2221-4135-bb31-7865fe1c6689 service swift] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:55.476367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1161/2295] 10.222.0.75 () {60 vars in 1384 bytes} [Thu Jul 28 18:07:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:07:55.498219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25ca60-2a14-4b6f-9901-bf184484f6bc None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:55.499681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ee25ca60-2a14-4b6f-9901-bf184484f6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:55.513800 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:55.573410 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25ca60-2a14-4b6f-9901-bf184484f6bc None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:55.578089 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b794d4-0032-4b55-850a-9e338b0d8cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:55.578733 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b794d4-0032-4b55-850a-9e338b0d8cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:55.579011 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b794d4-0032-4b55-850a-9e338b0d8cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:55.579283 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b794d4-0032-4b55-850a-9e338b0d8cd6 admin admin] PATH_INFO: `/v3/projects/19013cb2af6a4a238b6617345af30bea` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:55.580504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b794d4-0032-4b55-850a-9e338b0d8cd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19013cb2af6a4a238b6617345af30bea)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:55.582691 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b794d4-0032-4b55-850a-9e338b0d8cd6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:55.702355 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-14b794d4-0032-4b55-850a-9e338b0d8cd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19013cb2af6a4a238b6617345af30bea', 'request_id': 'req-14b794d4-0032-4b55-850a-9e338b0d8cd6'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:55.707843 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-14b794d4-0032-4b55-850a-9e338b0d8cd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19013cb2af6a4a238b6617345af30bea', 'request_id': 'req-14b794d4-0032-4b55-850a-9e338b0d8cd6'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:55.718870 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-14b794d4-0032-4b55-850a-9e338b0d8cd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19013cb2af6a4a238b6617345af30bea', 'request_id': 'req-14b794d4-0032-4b55-850a-9e338b0d8cd6'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:55.809989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-14b794d4-0032-4b55-850a-9e338b0d8cd6 admin admin] The token cache is being invalidate because project 19013cb2af6a4a238b6617345af30bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:07:55.810285 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-14b794d4-0032-4b55-850a-9e338b0d8cd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:55.810925 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-14b794d4-0032-4b55-850a-9e338b0d8cd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:55.812533 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1135/2296] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:07:55 2022] DELETE /identity/v3/projects/19013cb2af6a4a238b6617345af30bea => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:55.817512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efae82-8094-43ab-ba8f-ac36efa8f6dc None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:55.817979 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efae82-8094-43ab-ba8f-ac36efa8f6dc None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:55.818070 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efae82-8094-43ab-ba8f-ac36efa8f6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:55.840158 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-62efae82-8094-43ab-ba8f-ac36efa8f6dc None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:55.841394 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-62efae82-8094-43ab-ba8f-ac36efa8f6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:55.862756 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:55.910852 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1162/2297] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:55.919648 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a1ad8-5aa2-488f-8fb8-7fcf82aa4bee None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:55.920135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a1ad8-5aa2-488f-8fb8-7fcf82aa4bee None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:55.920593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a1ad8-5aa2-488f-8fb8-7fcf82aa4bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:55.941701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-be1a1ad8-5aa2-488f-8fb8-7fcf82aa4bee None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:55.942928 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-be1a1ad8-5aa2-488f-8fb8-7fcf82aa4bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:55.952188 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1136/2298] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:55.956458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efae82-8094-43ab-ba8f-ac36efa8f6dc None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:55.966864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efae82-8094-43ab-ba8f-ac36efa8f6dc None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:55.971519 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbc343-e0e3-4dee-8aaa-e30cda71fa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:55.972135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbc343-e0e3-4dee-8aaa-e30cda71fa79 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:55.972418 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbc343-e0e3-4dee-8aaa-e30cda71fa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:55.972692 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbc343-e0e3-4dee-8aaa-e30cda71fa79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:55.973427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbc343-e0e3-4dee-8aaa-e30cda71fa79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:07:55.973734 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbc343-e0e3-4dee-8aaa-e30cda71fa79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:55.975359 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbc343-e0e3-4dee-8aaa-e30cda71fa79 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:55.991162 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1163/2299] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:07:55.992493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a1ad8-5aa2-488f-8fb8-7fcf82aa4bee None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:56.002324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a1ad8-5aa2-488f-8fb8-7fcf82aa4bee None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:56.007493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb2202-ceb7-4093-89cc-1002b8834b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:56.013383 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb2202-ceb7-4093-89cc-1002b8834b92 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:56.013383 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb2202-ceb7-4093-89cc-1002b8834b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:56.013383 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb2202-ceb7-4093-89cc-1002b8834b92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:56.013383 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb2202-ceb7-4093-89cc-1002b8834b92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:56.013383 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb2202-ceb7-4093-89cc-1002b8834b92 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:56.110090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1137/2300] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:07:55 2022] POST /identity/v3/projects => generated 363 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:07:56.114823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbc343-e0e3-4dee-8aaa-e30cda71fa79 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:56.125447 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbc343-e0e3-4dee-8aaa-e30cda71fa79 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:56.134636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddf9e6-12b4-48e0-8b1b-7d16eec2e4db None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:56.134925 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddf9e6-12b4-48e0-8b1b-7d16eec2e4db None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:56.135205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddf9e6-12b4-48e0-8b1b-7d16eec2e4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:56.154163 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-52ddf9e6-12b4-48e0-8b1b-7d16eec2e4db None None] MFA Rules not processed for user `1cbbfdda843a4ab98ff9cf0742513f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:56.155386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-52ddf9e6-12b4-48e0-8b1b-7d16eec2e4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:56.185781 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610a87a-cb83-492f-a260-92a7e796bed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:56.186505 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610a87a-cb83-492f-a260-92a7e796bed9 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:56.186783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610a87a-cb83-492f-a260-92a7e796bed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:56.187058 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610a87a-cb83-492f-a260-92a7e796bed9 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:56.187734 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610a87a-cb83-492f-a260-92a7e796bed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:56.189705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610a87a-cb83-492f-a260-92a7e796bed9 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:56.217268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1138/2301] 10.222.0.75 () {58 vars in 967 bytes} [Thu Jul 28 18:07:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:07:56.226798 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddf9e6-12b4-48e0-8b1b-7d16eec2e4db None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:56.228150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-52ddf9e6-12b4-48e0-8b1b-7d16eec2e4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:56.246372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:56.293537 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1164/2302] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:07:56 2022] POST /identity/v3/users => generated 282 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:07:56.294699 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610a87a-cb83-492f-a260-92a7e796bed9 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:56.299450 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddf9e6-12b4-48e0-8b1b-7d16eec2e4db None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:56.305301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610a87a-cb83-492f-a260-92a7e796bed9 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:56.305437 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdead1a-a69e-45dc-a2ab-207801631d73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77b4fcb974d48a0bda4852c8d304511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:56.306036 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdead1a-a69e-45dc-a2ab-207801631d73 service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:56.306650 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdead1a-a69e-45dc-a2ab-207801631d73 service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:56.306650 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdead1a-a69e-45dc-a2ab-207801631d73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:56.310204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722dd26c-7417-4d01-a716-d3e160068a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:56.310822 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dd26c-7417-4d01-a716-d3e160068a1a admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:56.311108 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dd26c-7417-4d01-a716-d3e160068a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:56.311387 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dd26c-7417-4d01-a716-d3e160068a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:56.312118 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722dd26c-7417-4d01-a716-d3e160068a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:56.313764 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722dd26c-7417-4d01-a716-d3e160068a1a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:56.315229 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdead1a-a69e-45dc-a2ab-207801631d73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:56.317331 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdead1a-a69e-45dc-a2ab-207801631d73 service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:56.326303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1165/2303] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:07:56.327050 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1139/2304] 10.222.0.75 () {60 vars in 1384 bytes} [Thu Jul 28 18:07:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 18:07:56.330319 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722dd26c-7417-4d01-a716-d3e160068a1a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:56.341467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722dd26c-7417-4d01-a716-d3e160068a1a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:56.346847 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ea309-759e-4d48-9654-18b59f6cd89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:56.347482 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ea309-759e-4d48-9654-18b59f6cd89b admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:56.347764 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ea309-759e-4d48-9654-18b59f6cd89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:56.348116 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ea309-759e-4d48-9654-18b59f6cd89b admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:56.349296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ea309-759e-4d48-9654-18b59f6cd89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:56.350414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ea309-759e-4d48-9654-18b59f6cd89b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:56.361712 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1166/2305] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:07:56.366003 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdead1a-a69e-45dc-a2ab-207801631d73 service swift] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:56.376790 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdead1a-a69e-45dc-a2ab-207801631d73 service swift] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:56.381415 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dbac8-92e4-4c6b-9e8e-3c7c61a7293f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:56.382662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dbac8-92e4-4c6b-9e8e-3c7c61a7293f admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:56.382940 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dbac8-92e4-4c6b-9e8e-3c7c61a7293f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:56.383210 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dbac8-92e4-4c6b-9e8e-3c7c61a7293f admin admin] PATH_INFO: `/v3/projects/dee9910c850043cf86f1dcbeb01cf985/users/a37ffcdb7e494b088bdc411c26b45207/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:56.398355 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dbac8-92e4-4c6b-9e8e-3c7c61a7293f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee9910c850043cf86f1dcbeb01cf985, user_id=a37ffcdb7e494b088bdc411c26b45207, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:56.401142 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dbac8-92e4-4c6b-9e8e-3c7c61a7293f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:56.468321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1140/2306] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:07:56 2022] PUT /identity/v3/projects/dee9910c850043cf86f1dcbeb01cf985/users/a37ffcdb7e494b088bdc411c26b45207/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:56.479228 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8338b97-94b2-4385-bf82-f881ef8eb4b1 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:56.479495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8338b97-94b2-4385-bf82-f881ef8eb4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:56.479770 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8338b97-94b2-4385-bf82-f881ef8eb4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:56.507620 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e8338b97-94b2-4385-bf82-f881ef8eb4b1 None None] MFA Rules not processed for user `a37ffcdb7e494b088bdc411c26b45207`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:56.508970 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e8338b97-94b2-4385-bf82-f881ef8eb4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:56.573835 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1167/2307] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:07:56.585627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dbac8-92e4-4c6b-9e8e-3c7c61a7293f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:56.587377 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a16dbac8-92e4-4c6b-9e8e-3c7c61a7293f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:56.645379 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dbac8-92e4-4c6b-9e8e-3c7c61a7293f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:56.649613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7699ad-7381-4e83-af91-46baff92265b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:56.650223 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7699ad-7381-4e83-af91-46baff92265b service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:56.650508 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7699ad-7381-4e83-af91-46baff92265b service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:56.650771 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7699ad-7381-4e83-af91-46baff92265b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:56.660247 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7699ad-7381-4e83-af91-46baff92265b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:56.661764 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7699ad-7381-4e83-af91-46baff92265b service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:56.671273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1141/2308] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:56 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:07:59.216079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8338b97-94b2-4385-bf82-f881ef8eb4b1 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:59.217556 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e8338b97-94b2-4385-bf82-f881ef8eb4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:59.228857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:59.283758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8338b97-94b2-4385-bf82-f881ef8eb4b1 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:59.289478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48db79e-bf4b-4c09-a763-f24a8558bf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:59.290367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48db79e-bf4b-4c09-a763-f24a8558bf4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:59.290749 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48db79e-bf4b-4c09-a763-f24a8558bf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:59.291131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48db79e-bf4b-4c09-a763-f24a8558bf4e admin admin] PATH_INFO: `/v3/users/64f0dd228d8a4445a5dbe47a3bb34210` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:59.292359 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48db79e-bf4b-4c09-a763-f24a8558bf4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=64f0dd228d8a4445a5dbe47a3bb34210)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:59.294763 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48db79e-bf4b-4c09-a763-f24a8558bf4e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:59.502306 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a48db79e-bf4b-4c09-a763-f24a8558bf4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64f0dd228d8a4445a5dbe47a3bb34210'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:59.609226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a48db79e-bf4b-4c09-a763-f24a8558bf4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64f0dd228d8a4445a5dbe47a3bb34210'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:59.625104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a48db79e-bf4b-4c09-a763-f24a8558bf4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64f0dd228d8a4445a5dbe47a3bb34210'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:59.633231 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a48db79e-bf4b-4c09-a763-f24a8558bf4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64f0dd228d8a4445a5dbe47a3bb34210'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:59.633965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a48db79e-bf4b-4c09-a763-f24a8558bf4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64f0dd228d8a4445a5dbe47a3bb34210'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:07:59.640051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1168/2309] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:07:59 2022] DELETE /identity/v3/users/64f0dd228d8a4445a5dbe47a3bb34210 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:07:59.645137 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f08116-b331-427d-af02-490bba432899 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:59.645630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f08116-b331-427d-af02-490bba432899 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:59.645630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f08116-b331-427d-af02-490bba432899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:59.665769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c6f08116-b331-427d-af02-490bba432899 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:07:59.667161 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c6f08116-b331-427d-af02-490bba432899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:59.733267 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1142/2310] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:07:59.743986 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48db79e-bf4b-4c09-a763-f24a8558bf4e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:07:59.745550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a48db79e-bf4b-4c09-a763-f24a8558bf4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:07:59.803159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48db79e-bf4b-4c09-a763-f24a8558bf4e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:07:59.807347 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1486738-5fa5-49d6-ab97-6f3ed952174c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:07:59.807968 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1486738-5fa5-49d6-ab97-6f3ed952174c service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:07:59.808249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1486738-5fa5-49d6-ab97-6f3ed952174c service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:07:59.808523 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1486738-5fa5-49d6-ab97-6f3ed952174c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:07:59.817539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1486738-5fa5-49d6-ab97-6f3ed952174c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:07:59.818984 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1486738-5fa5-49d6-ab97-6f3ed952174c service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:07:59.828387 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1169/2311] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:00.074503 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f08116-b331-427d-af02-490bba432899 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:00.075935 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c6f08116-b331-427d-af02-490bba432899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:00.088521 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f08116-b331-427d-af02-490bba432899 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:00.093787 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d1447-7cfd-4401-99a1-a86144c853bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:00.094480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d1447-7cfd-4401-99a1-a86144c853bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:00.094771 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d1447-7cfd-4401-99a1-a86144c853bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:00.095049 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d1447-7cfd-4401-99a1-a86144c853bb admin admin] PATH_INFO: `/v3/projects/16ecf10058ef4eb38898dda124282316` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:00.096247 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d1447-7cfd-4401-99a1-a86144c853bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ecf10058ef4eb38898dda124282316)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:00.098196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d1447-7cfd-4401-99a1-a86144c853bb admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:00.126104 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:00.274313 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-779d1447-7cfd-4401-99a1-a86144c853bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ecf10058ef4eb38898dda124282316', 'request_id': 'req-779d1447-7cfd-4401-99a1-a86144c853bb'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:00.279726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-779d1447-7cfd-4401-99a1-a86144c853bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ecf10058ef4eb38898dda124282316', 'request_id': 'req-779d1447-7cfd-4401-99a1-a86144c853bb'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:00.285956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-779d1447-7cfd-4401-99a1-a86144c853bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ecf10058ef4eb38898dda124282316', 'request_id': 'req-779d1447-7cfd-4401-99a1-a86144c853bb'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:00.369717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-779d1447-7cfd-4401-99a1-a86144c853bb admin admin] The token cache is being invalidate because project 16ecf10058ef4eb38898dda124282316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:08:00.370077 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-779d1447-7cfd-4401-99a1-a86144c853bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:00.370711 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-779d1447-7cfd-4401-99a1-a86144c853bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:00.372230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1143/2312] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:08:00 2022] DELETE /identity/v3/projects/16ecf10058ef4eb38898dda124282316 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:09.824105 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=75,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:10.365965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:51.295225 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1486738-5fa5-49d6-ab97-6f3ed952174c service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:51.296663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b1486738-5fa5-49d6-ab97-6f3ed952174c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:51.309573 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1486738-5fa5-49d6-ab97-6f3ed952174c service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:51.373629 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004807fd-4119-4dde-abcf-4fbdf35f2244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:51.374285 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004807fd-4119-4dde-abcf-4fbdf35f2244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:51.378902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004807fd-4119-4dde-abcf-4fbdf35f2244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:51.378902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004807fd-4119-4dde-abcf-4fbdf35f2244 admin admin] PATH_INFO: `/v3/users/a37ffcdb7e494b088bdc411c26b45207` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:51.378902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004807fd-4119-4dde-abcf-4fbdf35f2244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a37ffcdb7e494b088bdc411c26b45207)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:51.378902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004807fd-4119-4dde-abcf-4fbdf35f2244 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:51.694223 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-004807fd-4119-4dde-abcf-4fbdf35f2244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a37ffcdb7e494b088bdc411c26b45207'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:51.822701 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-004807fd-4119-4dde-abcf-4fbdf35f2244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a37ffcdb7e494b088bdc411c26b45207'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:51.836146 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-004807fd-4119-4dde-abcf-4fbdf35f2244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a37ffcdb7e494b088bdc411c26b45207'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:51.843330 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-004807fd-4119-4dde-abcf-4fbdf35f2244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a37ffcdb7e494b088bdc411c26b45207'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:51.844045 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-004807fd-4119-4dde-abcf-4fbdf35f2244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a37ffcdb7e494b088bdc411c26b45207'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:51.850244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1170/2313] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:08:51 2022] DELETE /identity/v3/users/a37ffcdb7e494b088bdc411c26b45207 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:51.854840 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed49ba7-0d16-4785-9c53-9f2a6ac73587 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:51.855340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed49ba7-0d16-4785-9c53-9f2a6ac73587 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:51.855446 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed49ba7-0d16-4785-9c53-9f2a6ac73587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:51.878315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0ed49ba7-0d16-4785-9c53-9f2a6ac73587 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:51.879545 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0ed49ba7-0d16-4785-9c53-9f2a6ac73587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:51.938977 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1144/2314] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:08:51.948869 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004807fd-4119-4dde-abcf-4fbdf35f2244 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:51.950334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-004807fd-4119-4dde-abcf-4fbdf35f2244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:52.015300 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004807fd-4119-4dde-abcf-4fbdf35f2244 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:52.019849 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf1900-2791-464c-8d28-4d67a48244ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:52.020492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf1900-2791-464c-8d28-4d67a48244ea service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:52.020880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf1900-2791-464c-8d28-4d67a48244ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:52.021123 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf1900-2791-464c-8d28-4d67a48244ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:52.033139 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf1900-2791-464c-8d28-4d67a48244ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:52.034903 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf1900-2791-464c-8d28-4d67a48244ea service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:52.048511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1171/2315] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:52.435019 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caada4-837a-4ee0-afe8-bc0aa76f9679 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:52.435314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caada4-837a-4ee0-afe8-bc0aa76f9679 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:52.435592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caada4-837a-4ee0-afe8-bc0aa76f9679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:52.454402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a5caada4-837a-4ee0-afe8-bc0aa76f9679 None None] MFA Rules not processed for user `6811352e7e4e44fcb5598bc5d900e0a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:52.455671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a5caada4-837a-4ee0-afe8-bc0aa76f9679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:52.515796 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf1900-2791-464c-8d28-4d67a48244ea service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:52.517401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5dbf1900-2791-464c-8d28-4d67a48244ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:52.517799 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1145/2316] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:08:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:52.534460 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf1900-2791-464c-8d28-4d67a48244ea service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:52.539235 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e94a8-b4d3-461e-a8b7-62e8f25a412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:52.540025 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e94a8-b4d3-461e-a8b7-62e8f25a412b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:52.540641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e94a8-b4d3-461e-a8b7-62e8f25a412b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:52.541617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e94a8-b4d3-461e-a8b7-62e8f25a412b admin admin] PATH_INFO: `/v3/projects/dee9910c850043cf86f1dcbeb01cf985` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:52.546485 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e94a8-b4d3-461e-a8b7-62e8f25a412b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee9910c850043cf86f1dcbeb01cf985)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:52.554664 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e94a8-b4d3-461e-a8b7-62e8f25a412b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:52.573646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:52.722107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2b1e94a8-b4d3-461e-a8b7-62e8f25a412b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee9910c850043cf86f1dcbeb01cf985', 'request_id': 'req-2b1e94a8-b4d3-461e-a8b7-62e8f25a412b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:52.849978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2b1e94a8-b4d3-461e-a8b7-62e8f25a412b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee9910c850043cf86f1dcbeb01cf985', 'request_id': 'req-2b1e94a8-b4d3-461e-a8b7-62e8f25a412b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:52.856194 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2b1e94a8-b4d3-461e-a8b7-62e8f25a412b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee9910c850043cf86f1dcbeb01cf985', 'request_id': 'req-2b1e94a8-b4d3-461e-a8b7-62e8f25a412b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:52.877404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2b1e94a8-b4d3-461e-a8b7-62e8f25a412b admin admin] The token cache is being invalidate because project dee9910c850043cf86f1dcbeb01cf985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:08:52.877829 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2b1e94a8-b4d3-461e-a8b7-62e8f25a412b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:52.878579 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2b1e94a8-b4d3-461e-a8b7-62e8f25a412b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:52.898199 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1172/2317] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:08:52 2022] DELETE /identity/v3/projects/dee9910c850043cf86f1dcbeb01cf985 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:52.903309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1df07-a6c4-4d67-8c7b-a5a5848677f2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:52.904464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1df07-a6c4-4d67-8c7b-a5a5848677f2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:52.904464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1df07-a6c4-4d67-8c7b-a5a5848677f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:52.926025 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ffe1df07-a6c4-4d67-8c7b-a5a5848677f2 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:52.927267 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ffe1df07-a6c4-4d67-8c7b-a5a5848677f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:52.996186 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1146/2318] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:53.063196 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cf426-cf46-4adf-aafe-d96641d189a0 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:53.063501 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cf426-cf46-4adf-aafe-d96641d189a0 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:53.063779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cf426-cf46-4adf-aafe-d96641d189a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:53.088768 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-a73cf426-cf46-4adf-aafe-d96641d189a0 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:53.090021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a73cf426-cf46-4adf-aafe-d96641d189a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:53.098280 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1173/2319] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:08:53.102904 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1df07-a6c4-4d67-8c7b-a5a5848677f2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:53.114034 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1df07-a6c4-4d67-8c7b-a5a5848677f2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:53.118964 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708dde0f-5734-4637-b106-a6ae53a6ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:53.119614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dde0f-5734-4637-b106-a6ae53a6ae1e admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:53.119897 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dde0f-5734-4637-b106-a6ae53a6ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:53.120171 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dde0f-5734-4637-b106-a6ae53a6ae1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:53.120909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708dde0f-5734-4637-b106-a6ae53a6ae1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:08:53.121275 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708dde0f-5734-4637-b106-a6ae53a6ae1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:53.123408 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708dde0f-5734-4637-b106-a6ae53a6ae1e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:53.135534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1147/2320] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:08:53.140872 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cf426-cf46-4adf-aafe-d96641d189a0 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:53.150233 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cf426-cf46-4adf-aafe-d96641d189a0 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:53.154986 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74423be-2891-4869-9426-d0b3d9509aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:53.155599 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74423be-2891-4869-9426-d0b3d9509aae admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:53.155882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74423be-2891-4869-9426-d0b3d9509aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:53.156157 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74423be-2891-4869-9426-d0b3d9509aae admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:53.157043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74423be-2891-4869-9426-d0b3d9509aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:53.158777 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74423be-2891-4869-9426-d0b3d9509aae admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:53.285383 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1174/2321] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:08:53 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:53.286552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708dde0f-5734-4637-b106-a6ae53a6ae1e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:53.299307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708dde0f-5734-4637-b106-a6ae53a6ae1e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:53.336104 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:53.368844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bd773-b9fd-4ad4-a934-c1d173f649e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:53.369496 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bd773-b9fd-4ad4-a934-c1d173f649e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:53.369786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bd773-b9fd-4ad4-a934-c1d173f649e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:53.370065 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bd773-b9fd-4ad4-a934-c1d173f649e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:53.370742 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bd773-b9fd-4ad4-a934-c1d173f649e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:53.373279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bd773-b9fd-4ad4-a934-c1d173f649e5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:53.559621 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1148/2322] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:08:53 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:08:53.567463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74423be-2891-4869-9426-d0b3d9509aae admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:53.578260 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74423be-2891-4869-9426-d0b3d9509aae admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:53.582850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2d6bb-60d5-4d72-81e1-ebbf4110ca28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:53.583460 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2d6bb-60d5-4d72-81e1-ebbf4110ca28 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:53.583744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2d6bb-60d5-4d72-81e1-ebbf4110ca28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:53.584020 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2d6bb-60d5-4d72-81e1-ebbf4110ca28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:53.584723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2d6bb-60d5-4d72-81e1-ebbf4110ca28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:53.586513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2d6bb-60d5-4d72-81e1-ebbf4110ca28 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:53.597840 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1175/2323] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:53.603815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bd773-b9fd-4ad4-a934-c1d173f649e5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:53.615553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bd773-b9fd-4ad4-a934-c1d173f649e5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:53.620521 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d350aeb-f944-418d-998d-af83c525344e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:53.621192 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d350aeb-f944-418d-998d-af83c525344e admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:53.621480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d350aeb-f944-418d-998d-af83c525344e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:53.621760 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d350aeb-f944-418d-998d-af83c525344e admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:53.623060 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d350aeb-f944-418d-998d-af83c525344e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:53.624662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d350aeb-f944-418d-998d-af83c525344e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:53.635357 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1149/2324] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:53.639659 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2d6bb-60d5-4d72-81e1-ebbf4110ca28 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:53.649724 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2d6bb-60d5-4d72-81e1-ebbf4110ca28 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:53.654281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f44d5-5033-4f5d-ad87-ca08e9a27fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:53.654953 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f44d5-5033-4f5d-ad87-ca08e9a27fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:53.655236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f44d5-5033-4f5d-ad87-ca08e9a27fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:53.655514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f44d5-5033-4f5d-ad87-ca08e9a27fb4 admin admin] PATH_INFO: `/v3/projects/76dd0b64ada5495bb5d9a609ce5a3cd2/users/9d23c3b310a748579619ec5984ccad9c/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:53.670757 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f44d5-5033-4f5d-ad87-ca08e9a27fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76dd0b64ada5495bb5d9a609ce5a3cd2, user_id=9d23c3b310a748579619ec5984ccad9c, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:53.673453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f44d5-5033-4f5d-ad87-ca08e9a27fb4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:53.817030 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1176/2325] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:53 2022] PUT /identity/v3/projects/76dd0b64ada5495bb5d9a609ce5a3cd2/users/9d23c3b310a748579619ec5984ccad9c/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:53.822007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6281f-e9e8-4821-af6c-bafd6d864593 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:53.822298 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6281f-e9e8-4821-af6c-bafd6d864593 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:53.822577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6281f-e9e8-4821-af6c-bafd6d864593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:53.842080 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6ce6281f-e9e8-4821-af6c-bafd6d864593 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:53.843341 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6ce6281f-e9e8-4821-af6c-bafd6d864593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:53.902412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1150/2326] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:53.912744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f44d5-5033-4f5d-ad87-ca08e9a27fb4 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:53.914487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-972f44d5-5033-4f5d-ad87-ca08e9a27fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:53.973762 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f44d5-5033-4f5d-ad87-ca08e9a27fb4 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:53.977477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eeb9a4-299f-4d3a-a462-64847b72a3d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:53.978101 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeb9a4-299f-4d3a-a462-64847b72a3d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:53.978386 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeb9a4-299f-4d3a-a462-64847b72a3d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:53.978690 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeb9a4-299f-4d3a-a462-64847b72a3d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:53.989398 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eeb9a4-299f-4d3a-a462-64847b72a3d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:53.990865 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eeb9a4-299f-4d3a-a462-64847b72a3d0 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:54.000810 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1177/2327] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:54.929732 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6281f-e9e8-4821-af6c-bafd6d864593 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:54.929732 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6ce6281f-e9e8-4821-af6c-bafd6d864593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:55.002563 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6281f-e9e8-4821-af6c-bafd6d864593 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:55.007732 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953b706-0d49-4a8f-8638-e04a2d5a6a04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff43a72eaef462f86426ad3ceccd3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:55.009077 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953b706-0d49-4a8f-8638-e04a2d5a6a04 service placement] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:55.009386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953b706-0d49-4a8f-8638-e04a2d5a6a04 service placement] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:55.009673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953b706-0d49-4a8f-8638-e04a2d5a6a04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:55.011638 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1953b706-0d49-4a8f-8638-e04a2d5a6a04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:55.024439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953b706-0d49-4a8f-8638-e04a2d5a6a04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:55.026160 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953b706-0d49-4a8f-8638-e04a2d5a6a04 service placement] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:55.036487 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1151/2328] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:55.515614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32400f-f447-4e11-9ea2-b5a3637167e8 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:55.516078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32400f-f447-4e11-9ea2-b5a3637167e8 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:55.516356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32400f-f447-4e11-9ea2-b5a3637167e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:55.551205 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-9a32400f-f447-4e11-9ea2-b5a3637167e8 None None] MFA Rules not processed for user `9d23c3b310a748579619ec5984ccad9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:55.552718 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9a32400f-f447-4e11-9ea2-b5a3637167e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:55.590843 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:55.635891 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1178/2329] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:08:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:55.647220 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953b706-0d49-4a8f-8638-e04a2d5a6a04 service placement] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:55.648699 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1953b706-0d49-4a8f-8638-e04a2d5a6a04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:55.696924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:55.713492 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953b706-0d49-4a8f-8638-e04a2d5a6a04 service placement] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:55.718528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84827f-ccb9-493b-bb6c-e754ab43f210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:55.719150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84827f-ccb9-493b-bb6c-e754ab43f210 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:55.719434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84827f-ccb9-493b-bb6c-e754ab43f210 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:55.719710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84827f-ccb9-493b-bb6c-e754ab43f210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:55.728349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84827f-ccb9-493b-bb6c-e754ab43f210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:55.729951 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84827f-ccb9-493b-bb6c-e754ab43f210 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:55.739244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1152/2330] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:58.745118 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa9716-dadd-4219-9228-a7afe212a177 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:58.745620 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa9716-dadd-4219-9228-a7afe212a177 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:58.745620 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa9716-dadd-4219-9228-a7afe212a177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:58.765613 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-effa9716-dadd-4219-9228-a7afe212a177 None None] MFA Rules not processed for user `9d23c3b310a748579619ec5984ccad9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:58.766834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-effa9716-dadd-4219-9228-a7afe212a177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:58.773877 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1179/2331] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:08:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:06.056083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:08.759905 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=15 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:14.590963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764609c-87cf-44a6-b64f-1862c1fd0b2e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:14.591987 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764609c-87cf-44a6-b64f-1862c1fd0b2e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:14.591987 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764609c-87cf-44a6-b64f-1862c1fd0b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:14.615472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d764609c-87cf-44a6-b64f-1862c1fd0b2e None None] MFA Rules not processed for user `922506341d4a43c4a5f0cf9f610c4b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:14.617755 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d764609c-87cf-44a6-b64f-1862c1fd0b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:14.688540 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1153/2332] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:09:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:14.690795 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f49249-7522-4991-8cbe-8cabdf7b856f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:14.691246 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f49249-7522-4991-8cbe-8cabdf7b856f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:14.691528 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f49249-7522-4991-8cbe-8cabdf7b856f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:14.714939 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c9f49249-7522-4991-8cbe-8cabdf7b856f None None] MFA Rules not processed for user `1cbbfdda843a4ab98ff9cf0742513f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:14.717138 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c9f49249-7522-4991-8cbe-8cabdf7b856f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:14.796510 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1180/2333] 10.222.0.75 () {58 vars in 1009 bytes} [Thu Jul 28 18:09:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:09:15.011679 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764609c-87cf-44a6-b64f-1862c1fd0b2e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:15.013686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d764609c-87cf-44a6-b64f-1862c1fd0b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:15.101836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764609c-87cf-44a6-b64f-1862c1fd0b2e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:15.107245 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934ebdf-f793-4fbc-b0d3-4459ba7431cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77b4fcb974d48a0bda4852c8d304511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:15.107887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934ebdf-f793-4fbc-b0d3-4459ba7431cb service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:15.108275 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934ebdf-f793-4fbc-b0d3-4459ba7431cb service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:15.108691 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934ebdf-f793-4fbc-b0d3-4459ba7431cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:15.117800 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934ebdf-f793-4fbc-b0d3-4459ba7431cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:15.119476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934ebdf-f793-4fbc-b0d3-4459ba7431cb service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:15.127996 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1154/2334] 10.222.0.75 () {60 vars in 1384 bytes} [Thu Jul 28 18:09:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:09:24.789621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=25 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:25.125746 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=57 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:40.498815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557ec1b-641e-496d-b029-85330289a45c None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:40.499333 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557ec1b-641e-496d-b029-85330289a45c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:40.499558 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557ec1b-641e-496d-b029-85330289a45c None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:40.501018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1181/2335] 10.222.0.75 () {54 vars in 921 bytes} [Thu Jul 28 18:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:09:40.507104 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd2434-04aa-4097-83a8-c8c97152f268 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:40.507654 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd2434-04aa-4097-83a8-c8c97152f268 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:40.507795 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd2434-04aa-4097-83a8-c8c97152f268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:40.528393 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f8fd2434-04aa-4097-83a8-c8c97152f268 None None] MFA Rules not processed for user `c456a787159844feb7eabfd1e527e46e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:40.529680 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f8fd2434-04aa-4097-83a8-c8c97152f268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:40.608954 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1155/2336] 10.222.0.75 () {58 vars in 1018 bytes} [Thu Jul 28 18:09:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:40.621082 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557ec1b-641e-496d-b029-85330289a45c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:40.622827 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7557ec1b-641e-496d-b029-85330289a45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:40.726295 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557ec1b-641e-496d-b029-85330289a45c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:40.730076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095dd72-175d-45ce-ab51-7b4abea1b75d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1837a832a0da4d698984ce62057b81f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:40.730778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095dd72-175d-45ce-ab51-7b4abea1b75d service glance] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:40.731096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095dd72-175d-45ce-ab51-7b4abea1b75d service glance] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:40.741218 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095dd72-175d-45ce-ab51-7b4abea1b75d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:40.741891 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095dd72-175d-45ce-ab51-7b4abea1b75d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:40.743618 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095dd72-175d-45ce-ab51-7b4abea1b75d service glance] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:40.754369 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1182/2337] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:40.949873 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae306c7-4ed8-46b4-a644-afcfb133d06c None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:40.950182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae306c7-4ed8-46b4-a644-afcfb133d06c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:40.950445 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae306c7-4ed8-46b4-a644-afcfb133d06c None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:40.951864 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1156/2338] 10.222.0.75 () {54 vars in 921 bytes} [Thu Jul 28 18:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:09:40.957237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaec6b-1f23-46c2-99f4-e6c6c0651619 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:40.957526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaec6b-1f23-46c2-99f4-e6c6c0651619 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:40.957807 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaec6b-1f23-46c2-99f4-e6c6c0651619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:40.980528 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-15eaec6b-1f23-46c2-99f4-e6c6c0651619 None None] MFA Rules not processed for user `d0e56603b8704cb2b5587313c67254a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:40.982405 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-15eaec6b-1f23-46c2-99f4-e6c6c0651619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:40.988129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1183/2339] 10.222.0.75 () {58 vars in 1018 bytes} [Thu Jul 28 18:09:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:41.000960 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae306c7-4ed8-46b4-a644-afcfb133d06c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:41.002713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6ae306c7-4ed8-46b4-a644-afcfb133d06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:41.019185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae306c7-4ed8-46b4-a644-afcfb133d06c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:41.022807 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e69378-ab8c-41a8-b9fd-225c04f071be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:41.023433 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e69378-ab8c-41a8-b9fd-225c04f071be service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:41.023715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e69378-ab8c-41a8-b9fd-225c04f071be service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:41.023992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e69378-ab8c-41a8-b9fd-225c04f071be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:41.031890 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e69378-ab8c-41a8-b9fd-225c04f071be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:41.033412 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e69378-ab8c-41a8-b9fd-225c04f071be service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:41.042243 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1157/2340] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:41.136271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad41bf-4a0e-4f32-a92b-d239515f326d None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:41.136559 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad41bf-4a0e-4f32-a92b-d239515f326d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:41.136906 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad41bf-4a0e-4f32-a92b-d239515f326d None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:41.138310 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1184/2341] 10.222.0.75 () {54 vars in 921 bytes} [Thu Jul 28 18:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:09:41.144571 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f114f-5053-4449-8f43-7583527cea3c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:41.144989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f114f-5053-4449-8f43-7583527cea3c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:41.145335 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f114f-5053-4449-8f43-7583527cea3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:41.166285 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-775f114f-5053-4449-8f43-7583527cea3c None None] MFA Rules not processed for user `c456a787159844feb7eabfd1e527e46e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:41.168067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-775f114f-5053-4449-8f43-7583527cea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:41.177705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1158/2342] 10.222.0.75 () {58 vars in 1018 bytes} [Thu Jul 28 18:09:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:09:41.188738 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad41bf-4a0e-4f32-a92b-d239515f326d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:41.202148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad41bf-4a0e-4f32-a92b-d239515f326d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:41.204158 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ef046-13bc-47e1-ada1-f51af16cb761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:41.204821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ef046-13bc-47e1-ada1-f51af16cb761 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:41.205115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ef046-13bc-47e1-ada1-f51af16cb761 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:41.205390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ef046-13bc-47e1-ada1-f51af16cb761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:41.216627 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ef046-13bc-47e1-ada1-f51af16cb761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:41.218648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ef046-13bc-47e1-ada1-f51af16cb761 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:41.230011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1185/2343] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:46.189697 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2397bfa-6d8b-4923-a375-d492aefea8e4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:46.190177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2397bfa-6d8b-4923-a375-d492aefea8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:46.190280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2397bfa-6d8b-4923-a375-d492aefea8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:46.209890 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c2397bfa-6d8b-4923-a375-d492aefea8e4 None None] MFA Rules not processed for user `1cbbfdda843a4ab98ff9cf0742513f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:46.211120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c2397bfa-6d8b-4923-a375-d492aefea8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:46.218792 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1159/2344] 10.222.0.75 () {58 vars in 1009 bytes} [Thu Jul 28 18:09:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:46.230927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ef046-13bc-47e1-ada1-f51af16cb761 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:46.243237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ef046-13bc-47e1-ada1-f51af16cb761 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:46.248561 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac9ace-fba2-4650-9750-30a94474eeb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77b4fcb974d48a0bda4852c8d304511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:46.249227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac9ace-fba2-4650-9750-30a94474eeb0 service swift] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:46.249791 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac9ace-fba2-4650-9750-30a94474eeb0 service swift] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:46.249791 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac9ace-fba2-4650-9750-30a94474eeb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:46.258046 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac9ace-fba2-4650-9750-30a94474eeb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:46.259648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac9ace-fba2-4650-9750-30a94474eeb0 service swift] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:46.268333 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1186/2345] 10.222.0.75 () {60 vars in 1384 bytes} [Thu Jul 28 18:09:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:09:56.204511 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=43 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:56.265072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=50 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:19.862227 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fbbec-b2da-4da9-8e7c-16bb7b49933f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:19.862816 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fbbec-b2da-4da9-8e7c-16bb7b49933f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:19.862816 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fbbec-b2da-4da9-8e7c-16bb7b49933f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:19.882008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2d3fbbec-b2da-4da9-8e7c-16bb7b49933f None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:19.883190 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2d3fbbec-b2da-4da9-8e7c-16bb7b49933f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:19.891078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1160/2346] 10.222.0.77 () {58 vars in 1016 bytes} [Thu Jul 28 18:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:10:19.935222 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac9ace-fba2-4650-9750-30a94474eeb0 service swift] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:19.936600 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a7ac9ace-fba2-4650-9750-30a94474eeb0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:19.951786 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac9ace-fba2-4650-9750-30a94474eeb0 service swift] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:19.957263 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf824b8-504d-4ebd-8f8a-aad0feb68743 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:19.957877 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf824b8-504d-4ebd-8f8a-aad0feb68743 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:19.958161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf824b8-504d-4ebd-8f8a-aad0feb68743 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:19.958440 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf824b8-504d-4ebd-8f8a-aad0feb68743 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:19.966652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf824b8-504d-4ebd-8f8a-aad0feb68743 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:19.968493 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf824b8-504d-4ebd-8f8a-aad0feb68743 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:19.978634 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1187/2347] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:10:20.721135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2974737-8f60-4563-9544-3294a1d15068 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:20.721423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2974737-8f60-4563-9544-3294a1d15068 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:20.721698 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2974737-8f60-4563-9544-3294a1d15068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:20.743856 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b2974737-8f60-4563-9544-3294a1d15068 None None] MFA Rules not processed for user `1cbbfdda843a4ab98ff9cf0742513f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:20.745849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b2974737-8f60-4563-9544-3294a1d15068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:20.754367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1161/2348] 10.222.0.75 () {58 vars in 967 bytes} [Thu Jul 28 18:10:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:10:20.780959 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf824b8-504d-4ebd-8f8a-aad0feb68743 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:20.792685 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf824b8-504d-4ebd-8f8a-aad0feb68743 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:20.807028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214a604-f864-4029-833c-aa21ff338bc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77b4fcb974d48a0bda4852c8d304511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:20.807662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214a604-f864-4029-833c-aa21ff338bc5 service swift] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:20.807945 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214a604-f864-4029-833c-aa21ff338bc5 service swift] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:20.808220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214a604-f864-4029-833c-aa21ff338bc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:20.817735 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214a604-f864-4029-833c-aa21ff338bc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:20.819332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214a604-f864-4029-833c-aa21ff338bc5 service swift] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:20.828122 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1188/2349] 10.222.0.75 () {60 vars in 1384 bytes} [Thu Jul 28 18:10:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:10:27.038798 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8e7a5-fd64-47e3-9e11-8d792bbe6454 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:27.039373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8e7a5-fd64-47e3-9e11-8d792bbe6454 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:27.039373 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8e7a5-fd64-47e3-9e11-8d792bbe6454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:27.058688 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-75b8e7a5-fd64-47e3-9e11-8d792bbe6454 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:27.059886 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-75b8e7a5-fd64-47e3-9e11-8d792bbe6454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:27.069524 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1162/2350] 10.222.0.77 () {58 vars in 1016 bytes} [Thu Jul 28 18:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:10:27.101703 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214a604-f864-4029-833c-aa21ff338bc5 service swift] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:27.115597 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214a604-f864-4029-833c-aa21ff338bc5 service swift] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:27.125483 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef642845-5512-43a7-8124-108974486f7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:27.127564 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef642845-5512-43a7-8124-108974486f7f service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:27.127860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef642845-5512-43a7-8124-108974486f7f service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:27.128146 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef642845-5512-43a7-8124-108974486f7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:27.142660 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef642845-5512-43a7-8124-108974486f7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:27.144278 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef642845-5512-43a7-8124-108974486f7f service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:27.159421 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1189/2351] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:10:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:10:33.528572 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53119755-8519-4f71-b4a8-65afe52191bc None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:33.529305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53119755-8519-4f71-b4a8-65afe52191bc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:33.529480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53119755-8519-4f71-b4a8-65afe52191bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:33.553095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-53119755-8519-4f71-b4a8-65afe52191bc None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:33.554288 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-53119755-8519-4f71-b4a8-65afe52191bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:33.562542 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1163/2352] 10.222.0.77 () {58 vars in 1016 bytes} [Thu Jul 28 18:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:10:33.590889 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef642845-5512-43a7-8124-108974486f7f service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:33.592284 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ef642845-5512-43a7-8124-108974486f7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:33.607682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef642845-5512-43a7-8124-108974486f7f service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:33.613881 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b7fbc-c509-48e9-8ef6-65c24e55b856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:33.614494 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b7fbc-c509-48e9-8ef6-65c24e55b856 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:33.614778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b7fbc-c509-48e9-8ef6-65c24e55b856 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:33.615056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b7fbc-c509-48e9-8ef6-65c24e55b856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:33.625195 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b7fbc-c509-48e9-8ef6-65c24e55b856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:33.626804 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b7fbc-c509-48e9-8ef6-65c24e55b856 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:33.636346 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1190/2353] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:10:39.577407 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e453d4-71f5-41c3-99a0-2011111970bc None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:39.577939 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e453d4-71f5-41c3-99a0-2011111970bc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:39.577939 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e453d4-71f5-41c3-99a0-2011111970bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:39.600175 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-62e453d4-71f5-41c3-99a0-2011111970bc None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:39.601417 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-62e453d4-71f5-41c3-99a0-2011111970bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:39.609284 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1164/2354] 10.222.0.77 () {58 vars in 1016 bytes} [Thu Jul 28 18:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:10:39.656953 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b7fbc-c509-48e9-8ef6-65c24e55b856 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:39.668609 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b7fbc-c509-48e9-8ef6-65c24e55b856 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:39.674247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f752b-f912-4bbf-b981-514566576299 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:39.674847 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f752b-f912-4bbf-b981-514566576299 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:39.675128 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f752b-f912-4bbf-b981-514566576299 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:39.675401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f752b-f912-4bbf-b981-514566576299 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:39.684068 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f752b-f912-4bbf-b981-514566576299 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:39.692016 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f752b-f912-4bbf-b981-514566576299 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:39.695580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1191/2355] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:10:45.911469 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71565f0-9f3e-42a6-9546-e50f18c286c7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:45.912016 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71565f0-9f3e-42a6-9546-e50f18c286c7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:45.912016 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71565f0-9f3e-42a6-9546-e50f18c286c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:45.932090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c71565f0-9f3e-42a6-9546-e50f18c286c7 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:45.933256 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c71565f0-9f3e-42a6-9546-e50f18c286c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:45.941813 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1165/2356] 10.222.0.77 () {58 vars in 1016 bytes} [Thu Jul 28 18:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:10:45.978901 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f752b-f912-4bbf-b981-514566576299 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:45.990119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f752b-f912-4bbf-b981-514566576299 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:45.995992 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3704a43-a0a2-4666-95bb-818d9e8f3f86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:45.996615 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3704a43-a0a2-4666-95bb-818d9e8f3f86 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:45.996928 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3704a43-a0a2-4666-95bb-818d9e8f3f86 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:45.997379 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3704a43-a0a2-4666-95bb-818d9e8f3f86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:46.009385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3704a43-a0a2-4666-95bb-818d9e8f3f86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:46.012098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3704a43-a0a2-4666-95bb-818d9e8f3f86 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:46.022866 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1192/2357] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:10:51.228497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9cf75-75a0-49bc-92f2-b33e557abd2f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:51.229142 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9cf75-75a0-49bc-92f2-b33e557abd2f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:51.229142 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9cf75-75a0-49bc-92f2-b33e557abd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:51.237533 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=19 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:51.250764 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7cf9cf75-75a0-49bc-92f2-b33e557abd2f None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:51.251984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7cf9cf75-75a0-49bc-92f2-b33e557abd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:51.259838 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1166/2358] 10.222.0.77 () {58 vars in 1016 bytes} [Thu Jul 28 18:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:10:51.342595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3704a43-a0a2-4666-95bb-818d9e8f3f86 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:51.348604 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=37 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:51.355041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3704a43-a0a2-4666-95bb-818d9e8f3f86 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:51.360587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a39661-da10-454c-9d5e-ee3a1b167c47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:51.361230 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a39661-da10-454c-9d5e-ee3a1b167c47 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:51.361517 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a39661-da10-454c-9d5e-ee3a1b167c47 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:51.361801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a39661-da10-454c-9d5e-ee3a1b167c47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:51.370707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a39661-da10-454c-9d5e-ee3a1b167c47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:51.372311 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a39661-da10-454c-9d5e-ee3a1b167c47 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:51.381932 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1193/2359] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:10:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:10:57.409187 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9cf75-75a0-49bc-92f2-b33e557abd2f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:57.419019 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9cf75-75a0-49bc-92f2-b33e557abd2f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:57.422648 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d905c6-e717-4159-a5f5-f7567a61788a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:57.423259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d905c6-e717-4159-a5f5-f7567a61788a service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:57.423546 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d905c6-e717-4159-a5f5-f7567a61788a service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:57.423824 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d905c6-e717-4159-a5f5-f7567a61788a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:57.425604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-08d905c6-e717-4159-a5f5-f7567a61788a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:57.438882 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d905c6-e717-4159-a5f5-f7567a61788a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:57.440294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d905c6-e717-4159-a5f5-f7567a61788a service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:57.452207 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1167/2360] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:10:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:01.433646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:01.500220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a39661-da10-454c-9d5e-ee3a1b167c47 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:01.510421 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a39661-da10-454c-9d5e-ee3a1b167c47 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:01.514156 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e381e5b-5636-4a3a-993d-f1432cec3bc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:01.514766 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e381e5b-5636-4a3a-993d-f1432cec3bc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:01.515050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e381e5b-5636-4a3a-993d-f1432cec3bc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:01.515350 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e381e5b-5636-4a3a-993d-f1432cec3bc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:01.517211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4e381e5b-5636-4a3a-993d-f1432cec3bc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:01.530681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e381e5b-5636-4a3a-993d-f1432cec3bc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:01.532121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e381e5b-5636-4a3a-993d-f1432cec3bc0 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:01.547110 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1194/2361] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:07.447283 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=8 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:11.538310 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=6 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:13.875309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16967a6a-8411-4aeb-98ea-bf4b13c865de None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:13.875857 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16967a6a-8411-4aeb-98ea-bf4b13c865de None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:13.875857 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16967a6a-8411-4aeb-98ea-bf4b13c865de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:13.895834 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-16967a6a-8411-4aeb-98ea-bf4b13c865de None None] MFA Rules not processed for user `9d23c3b310a748579619ec5984ccad9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:13.897064 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-16967a6a-8411-4aeb-98ea-bf4b13c865de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:13.903943 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1168/2362] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:11:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:14.137869 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e381e5b-5636-4a3a-993d-f1432cec3bc0 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:14.146481 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e381e5b-5636-4a3a-993d-f1432cec3bc0 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:14.150321 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cea199-5175-444f-986d-4d2fc94b13e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:14.150943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cea199-5175-444f-986d-4d2fc94b13e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:14.151226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cea199-5175-444f-986d-4d2fc94b13e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:14.151501 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cea199-5175-444f-986d-4d2fc94b13e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:14.153314 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-60cea199-5175-444f-986d-4d2fc94b13e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:14.162710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cea199-5175-444f-986d-4d2fc94b13e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:14.164159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cea199-5175-444f-986d-4d2fc94b13e8 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:14.172106 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1195/2363] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:14.568679 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16967a6a-8411-4aeb-98ea-bf4b13c865de None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:14.570294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-16967a6a-8411-4aeb-98ea-bf4b13c865de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:14.585380 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16967a6a-8411-4aeb-98ea-bf4b13c865de None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:14.590682 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a15182-bc6c-4d83-9e64-8834b624a3b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff43a72eaef462f86426ad3ceccd3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:14.591304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a15182-bc6c-4d83-9e64-8834b624a3b8 service placement] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:14.591586 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a15182-bc6c-4d83-9e64-8834b624a3b8 service placement] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:14.591862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a15182-bc6c-4d83-9e64-8834b624a3b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:14.593692 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-88a15182-bc6c-4d83-9e64-8834b624a3b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:14.606552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a15182-bc6c-4d83-9e64-8834b624a3b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:14.611671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a15182-bc6c-4d83-9e64-8834b624a3b8 service placement] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:14.618898 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1169/2364] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:15.720152 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cea199-5175-444f-986d-4d2fc94b13e8 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:15.729633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cea199-5175-444f-986d-4d2fc94b13e8 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:15.734049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15676d5-e28a-4e9d-a5f2-f6b60b8e46da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:15.734658 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15676d5-e28a-4e9d-a5f2-f6b60b8e46da service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:15.734941 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15676d5-e28a-4e9d-a5f2-f6b60b8e46da service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:15.735212 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15676d5-e28a-4e9d-a5f2-f6b60b8e46da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:15.736992 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c15676d5-e28a-4e9d-a5f2-f6b60b8e46da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:15.746827 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15676d5-e28a-4e9d-a5f2-f6b60b8e46da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:15.748276 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15676d5-e28a-4e9d-a5f2-f6b60b8e46da service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:15.756668 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1196/2365] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:18.325409 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a15182-bc6c-4d83-9e64-8834b624a3b8 service placement] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:18.345176 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a15182-bc6c-4d83-9e64-8834b624a3b8 service placement] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:18.352532 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab0629-708a-4c7e-a287-6b62c1bef307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:18.353207 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab0629-708a-4c7e-a287-6b62c1bef307 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:18.353493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab0629-708a-4c7e-a287-6b62c1bef307 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:18.353840 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab0629-708a-4c7e-a287-6b62c1bef307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:18.356280 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5eab0629-708a-4c7e-a287-6b62c1bef307 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:18.419769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab0629-708a-4c7e-a287-6b62c1bef307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:18.421485 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab0629-708a-4c7e-a287-6b62c1bef307 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:18.431261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1170/2366] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:25.752888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=12 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:27.770483 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15676d5-e28a-4e9d-a5f2-f6b60b8e46da service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:27.783590 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15676d5-e28a-4e9d-a5f2-f6b60b8e46da service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:27.789080 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f090f-1eff-4b31-8d4f-e711ff5a4e40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:27.789685 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f090f-1eff-4b31-8d4f-e711ff5a4e40 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:27.789964 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f090f-1eff-4b31-8d4f-e711ff5a4e40 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:27.790234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f090f-1eff-4b31-8d4f-e711ff5a4e40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:27.792022 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b95f090f-1eff-4b31-8d4f-e711ff5a4e40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:27.804701 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f090f-1eff-4b31-8d4f-e711ff5a4e40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:27.806312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f090f-1eff-4b31-8d4f-e711ff5a4e40 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:27.820281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1197/2367] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:28.426587 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=37 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:37.737234 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccc017-6285-4620-ac80-f5df67c0db00 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:37.737879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccc017-6285-4620-ac80-f5df67c0db00 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:37.737879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccc017-6285-4620-ac80-f5df67c0db00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:37.758274 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-68ccc017-6285-4620-ac80-f5df67c0db00 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:37.759489 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-68ccc017-6285-4620-ac80-f5df67c0db00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:37.767516 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1171/2368] 10.222.0.77 () {58 vars in 1016 bytes} [Thu Jul 28 18:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:37.814154 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=6 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:37.823147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f090f-1eff-4b31-8d4f-e711ff5a4e40 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:37.834220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f090f-1eff-4b31-8d4f-e711ff5a4e40 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:37.840239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce936f2a-6b4f-4e73-bab7-5803dc931144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:37.840883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce936f2a-6b4f-4e73-bab7-5803dc931144 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:37.841165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce936f2a-6b4f-4e73-bab7-5803dc931144 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:37.841939 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce936f2a-6b4f-4e73-bab7-5803dc931144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:37.850633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce936f2a-6b4f-4e73-bab7-5803dc931144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:37.852223 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce936f2a-6b4f-4e73-bab7-5803dc931144 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:37.862608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1198/2369] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:42.562713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f055678-0078-4712-bccb-c1a5ec1a66d4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:42.563449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f055678-0078-4712-bccb-c1a5ec1a66d4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:42.563633 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f055678-0078-4712-bccb-c1a5ec1a66d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:42.592615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6f055678-0078-4712-bccb-c1a5ec1a66d4 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:42.593891 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6f055678-0078-4712-bccb-c1a5ec1a66d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:42.602087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1172/2370] 10.222.0.77 () {58 vars in 1016 bytes} [Thu Jul 28 18:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:42.634973 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce936f2a-6b4f-4e73-bab7-5803dc931144 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:42.646388 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce936f2a-6b4f-4e73-bab7-5803dc931144 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:42.651989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee70f48-9c59-4d09-8f3e-db077454ac25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:42.652671 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee70f48-9c59-4d09-8f3e-db077454ac25 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:42.652998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee70f48-9c59-4d09-8f3e-db077454ac25 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:42.653284 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee70f48-9c59-4d09-8f3e-db077454ac25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:42.662232 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee70f48-9c59-4d09-8f3e-db077454ac25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:42.663852 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee70f48-9c59-4d09-8f3e-db077454ac25 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:42.674267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1199/2371] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:49.329657 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79fe95-9930-4412-bb31-13a00422b0f1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:49.330194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79fe95-9930-4412-bb31-13a00422b0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:49.330194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79fe95-9930-4412-bb31-13a00422b0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:49.350037 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-bc79fe95-9930-4412-bb31-13a00422b0f1 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:49.351250 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bc79fe95-9930-4412-bb31-13a00422b0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:49.359655 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1173/2372] 10.222.0.77 () {58 vars in 1016 bytes} [Thu Jul 28 18:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:49.397560 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee70f48-9c59-4d09-8f3e-db077454ac25 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:49.408708 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee70f48-9c59-4d09-8f3e-db077454ac25 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:49.414350 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59f4a1-4cfd-4e59-ad6b-06bb463bdbf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:49.414957 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59f4a1-4cfd-4e59-ad6b-06bb463bdbf2 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:49.415243 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59f4a1-4cfd-4e59-ad6b-06bb463bdbf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:49.415521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59f4a1-4cfd-4e59-ad6b-06bb463bdbf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:49.424210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59f4a1-4cfd-4e59-ad6b-06bb463bdbf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:49.425855 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59f4a1-4cfd-4e59-ad6b-06bb463bdbf2 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:49.435933 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1200/2373] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:54.577453 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644060f-1313-4d85-b70a-14841d8c8cec None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:54.577979 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644060f-1313-4d85-b70a-14841d8c8cec None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:54.578081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644060f-1313-4d85-b70a-14841d8c8cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:54.597246 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9644060f-1313-4d85-b70a-14841d8c8cec None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:54.598448 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9644060f-1313-4d85-b70a-14841d8c8cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:54.606551 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1174/2374] 10.222.0.77 () {58 vars in 1016 bytes} [Thu Jul 28 18:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:54.652938 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59f4a1-4cfd-4e59-ad6b-06bb463bdbf2 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:54.664109 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59f4a1-4cfd-4e59-ad6b-06bb463bdbf2 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:54.669879 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a2ef6-27df-4da4-9182-4b5c06ccf9af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:54.670511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a2ef6-27df-4da4-9182-4b5c06ccf9af service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:54.670790 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a2ef6-27df-4da4-9182-4b5c06ccf9af service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:54.671062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a2ef6-27df-4da4-9182-4b5c06ccf9af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:54.680064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a2ef6-27df-4da4-9182-4b5c06ccf9af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:54.681705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a2ef6-27df-4da4-9182-4b5c06ccf9af service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:54.691955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1201/2375] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:56.948571 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644060f-1313-4d85-b70a-14841d8c8cec None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:56.961351 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644060f-1313-4d85-b70a-14841d8c8cec None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:56.966738 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e80ff-d772-4753-9627-6ef43a3c8f0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:56.967355 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e80ff-d772-4753-9627-6ef43a3c8f0c service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:56.967636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e80ff-d772-4753-9627-6ef43a3c8f0c service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:56.967912 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e80ff-d772-4753-9627-6ef43a3c8f0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:56.970138 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c76e80ff-d772-4753-9627-6ef43a3c8f0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:57.027140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e80ff-d772-4753-9627-6ef43a3c8f0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:57.028717 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e80ff-d772-4753-9627-6ef43a3c8f0c service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:57.038290 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1175/2376] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:59.771938 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a2ef6-27df-4da4-9182-4b5c06ccf9af service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:59.783093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a2ef6-27df-4da4-9182-4b5c06ccf9af service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:59.788547 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a4e16-a207-45ed-8d09-a879dbf9389b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:59.789188 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a4e16-a207-45ed-8d09-a879dbf9389b service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:59.789472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a4e16-a207-45ed-8d09-a879dbf9389b service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:59.789751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a4e16-a207-45ed-8d09-a879dbf9389b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:59.791491 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8c5a4e16-a207-45ed-8d09-a879dbf9389b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:59.802566 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a4e16-a207-45ed-8d09-a879dbf9389b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:59.804214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a4e16-a207-45ed-8d09-a879dbf9389b service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:59.814064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1202/2377] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:12:00.933090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8e970-8ca4-4253-a70c-5425cc0df86d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:00.933090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8e970-8ca4-4253-a70c-5425cc0df86d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:00.933090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8e970-8ca4-4253-a70c-5425cc0df86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:00.939102 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=41 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:00.951426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-02a8e970-8ca4-4253-a70c-5425cc0df86d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:12:00.952689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-02a8e970-8ca4-4253-a70c-5425cc0df86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:12:00.960561 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1176/2378] 10.222.0.77 () {58 vars in 1016 bytes} [Thu Jul 28 18:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:12:00.989973 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a4e16-a207-45ed-8d09-a879dbf9389b service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:12:01.001469 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a4e16-a207-45ed-8d09-a879dbf9389b service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:12:01.007067 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b683f9-0f7d-486d-b75d-1e47d77dd033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:12:01.007676 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b683f9-0f7d-486d-b75d-1e47d77dd033 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:01.007961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b683f9-0f7d-486d-b75d-1e47d77dd033 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:01.008237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b683f9-0f7d-486d-b75d-1e47d77dd033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:01.017056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b683f9-0f7d-486d-b75d-1e47d77dd033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:12:01.018665 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b683f9-0f7d-486d-b75d-1e47d77dd033 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:12:01.028411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1203/2379] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:12:08.492714 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8e970-8ca4-4253-a70c-5425cc0df86d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:12:08.506204 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8e970-8ca4-4253-a70c-5425cc0df86d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:12:08.511779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c83b63-46fb-44d8-9247-786ac30a8bb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:12:08.512408 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c83b63-46fb-44d8-9247-786ac30a8bb2 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:08.512690 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c83b63-46fb-44d8-9247-786ac30a8bb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:08.513001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c83b63-46fb-44d8-9247-786ac30a8bb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:08.514861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-67c83b63-46fb-44d8-9247-786ac30a8bb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:12:08.527839 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c83b63-46fb-44d8-9247-786ac30a8bb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:12:08.529568 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c83b63-46fb-44d8-9247-786ac30a8bb2 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:12:08.542719 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1177/2380] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:12:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:12:11.023971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=36 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:15.405583 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b683f9-0f7d-486d-b75d-1e47d77dd033 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:12:15.418017 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b683f9-0f7d-486d-b75d-1e47d77dd033 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:12:15.424074 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1478e-b559-4530-b635-5915b2088d4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:12:15.424691 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1478e-b559-4530-b635-5915b2088d4f service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:15.425003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1478e-b559-4530-b635-5915b2088d4f service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:15.425280 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1478e-b559-4530-b635-5915b2088d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:15.427316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-31c1478e-b559-4530-b635-5915b2088d4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:12:15.488951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1478e-b559-4530-b635-5915b2088d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:12:15.491360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1478e-b559-4530-b635-5915b2088d4f service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:12:15.507697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1204/2381] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:12:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:12:16.981914 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3370bd2-a0de-49dd-bb68-a85f8a62a839 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:16.982456 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3370bd2-a0de-49dd-bb68-a85f8a62a839 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:16.982456 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3370bd2-a0de-49dd-bb68-a85f8a62a839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:17.002852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a3370bd2-a0de-49dd-bb68-a85f8a62a839 None None] MFA Rules not processed for user `6811352e7e4e44fcb5598bc5d900e0a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:12:17.004077 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a3370bd2-a0de-49dd-bb68-a85f8a62a839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:12:17.011079 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1178/2382] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:12:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:12:21.812674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c6220-3d5b-4a0c-8624-b1d9d0668cfb None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:21.813216 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c6220-3d5b-4a0c-8624-b1d9d0668cfb None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:21.813310 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c6220-3d5b-4a0c-8624-b1d9d0668cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:21.833454 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-243c6220-3d5b-4a0c-8624-b1d9d0668cfb None None] MFA Rules not processed for user `0130232e2fd44fe09dd82a173da0a12d`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:12:21.834704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-243c6220-3d5b-4a0c-8624-b1d9d0668cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:12:21.841751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1205/2383] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:12:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:12:22.154165 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3370bd2-a0de-49dd-bb68-a85f8a62a839 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:12:22.163820 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3370bd2-a0de-49dd-bb68-a85f8a62a839 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:12:22.167434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edb734-978c-47e5-af29-634d20b21ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:12:22.168054 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edb734-978c-47e5-af29-634d20b21ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:22.168338 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edb734-978c-47e5-af29-634d20b21ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:22.168615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edb734-978c-47e5-af29-634d20b21ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:22.170445 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b5edb734-978c-47e5-af29-634d20b21ba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:12:22.180438 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edb734-978c-47e5-af29-634d20b21ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:12:22.184188 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edb734-978c-47e5-af29-634d20b21ba5 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:12:22.190489 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1179/2384] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:12:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:12:31.826774 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=31 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:32.150193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c6220-3d5b-4a0c-8624-b1d9d0668cfb None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:12:32.165731 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c6220-3d5b-4a0c-8624-b1d9d0668cfb None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:12:32.182396 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beab1d1-fa7b-4724-8863-a9545c4f9421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:12:32.183330 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beab1d1-fa7b-4724-8863-a9545c4f9421 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:32.183765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beab1d1-fa7b-4724-8863-a9545c4f9421 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:32.184183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beab1d1-fa7b-4724-8863-a9545c4f9421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:32.186203 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=17 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:32.186737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3beab1d1-fa7b-4724-8863-a9545c4f9421 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:12:32.219598 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beab1d1-fa7b-4724-8863-a9545c4f9421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:12:32.225232 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beab1d1-fa7b-4724-8863-a9545c4f9421 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:12:32.242991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1206/2385] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:12:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:12:39.018822 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4249ae-092e-4392-95a3-70c38f69fc4c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:39.019392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4249ae-092e-4392-95a3-70c38f69fc4c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:39.019392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4249ae-092e-4392-95a3-70c38f69fc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:39.040390 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-cc4249ae-092e-4392-95a3-70c38f69fc4c None None] MFA Rules not processed for user `922506341d4a43c4a5f0cf9f610c4b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:12:39.041828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cc4249ae-092e-4392-95a3-70c38f69fc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:12:39.049988 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1180/2386] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:12:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:12:42.236301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=6 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:49.034850 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:01.319873 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beab1d1-fa7b-4724-8863-a9545c4f9421 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:13:01.383646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beab1d1-fa7b-4724-8863-a9545c4f9421 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:13:01.388836 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d406cb1-20c8-4d80-9b9e-a56e29ac1cb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff43a72eaef462f86426ad3ceccd3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:13:01.389475 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d406cb1-20c8-4d80-9b9e-a56e29ac1cb6 service placement] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:01.389754 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d406cb1-20c8-4d80-9b9e-a56e29ac1cb6 service placement] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:01.390026 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d406cb1-20c8-4d80-9b9e-a56e29ac1cb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:01.391759 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1d406cb1-20c8-4d80-9b9e-a56e29ac1cb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:13:01.425375 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d406cb1-20c8-4d80-9b9e-a56e29ac1cb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:13:01.427113 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d406cb1-20c8-4d80-9b9e-a56e29ac1cb6 service placement] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:13:01.452129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1207/2387] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:13:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:13:01.486405 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4249ae-092e-4392-95a3-70c38f69fc4c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:13:01.539206 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4249ae-092e-4392-95a3-70c38f69fc4c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:13:01.543905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b5874-8f62-4a0d-ae7a-e23ac4494431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:13:01.544549 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b5874-8f62-4a0d-ae7a-e23ac4494431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:01.544860 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b5874-8f62-4a0d-ae7a-e23ac4494431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:01.545136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b5874-8f62-4a0d-ae7a-e23ac4494431 admin admin] PATH_INFO: `/v3/users/9d23c3b310a748579619ec5984ccad9c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:01.546352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b5874-8f62-4a0d-ae7a-e23ac4494431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d23c3b310a748579619ec5984ccad9c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:13:01.548308 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b5874-8f62-4a0d-ae7a-e23ac4494431 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:13:01.784089 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-757b5874-8f62-4a0d-ae7a-e23ac4494431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d23c3b310a748579619ec5984ccad9c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:13:01.784672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-757b5874-8f62-4a0d-ae7a-e23ac4494431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d23c3b310a748579619ec5984ccad9c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:13:01.796900 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-757b5874-8f62-4a0d-ae7a-e23ac4494431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d23c3b310a748579619ec5984ccad9c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:13:01.804459 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-757b5874-8f62-4a0d-ae7a-e23ac4494431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d23c3b310a748579619ec5984ccad9c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:13:01.805156 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-757b5874-8f62-4a0d-ae7a-e23ac4494431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d23c3b310a748579619ec5984ccad9c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:13:01.889751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1181/2388] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:13:01 2022] DELETE /identity/v3/users/9d23c3b310a748579619ec5984ccad9c => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:13:02.137348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d406cb1-20c8-4d80-9b9e-a56e29ac1cb6 service placement] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:13:02.148058 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d406cb1-20c8-4d80-9b9e-a56e29ac1cb6 service placement] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:13:02.208336 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99823a83-743b-45c6-bdd8-a6936b886c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:13:02.209037 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99823a83-743b-45c6-bdd8-a6936b886c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:02.209326 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99823a83-743b-45c6-bdd8-a6936b886c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:02.209607 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99823a83-743b-45c6-bdd8-a6936b886c12 admin admin] PATH_INFO: `/v3/projects/76dd0b64ada5495bb5d9a609ce5a3cd2` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:02.210856 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99823a83-743b-45c6-bdd8-a6936b886c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76dd0b64ada5495bb5d9a609ce5a3cd2)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:13:02.212927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99823a83-743b-45c6-bdd8-a6936b886c12 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:13:02.330480 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-99823a83-743b-45c6-bdd8-a6936b886c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76dd0b64ada5495bb5d9a609ce5a3cd2', 'request_id': 'req-99823a83-743b-45c6-bdd8-a6936b886c12'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:13:02.452884 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-99823a83-743b-45c6-bdd8-a6936b886c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76dd0b64ada5495bb5d9a609ce5a3cd2', 'request_id': 'req-99823a83-743b-45c6-bdd8-a6936b886c12'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:13:02.534958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-99823a83-743b-45c6-bdd8-a6936b886c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76dd0b64ada5495bb5d9a609ce5a3cd2', 'request_id': 'req-99823a83-743b-45c6-bdd8-a6936b886c12'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:13:02.534958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:02.534958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-99823a83-743b-45c6-bdd8-a6936b886c12 admin admin] The token cache is being invalidate because project 76dd0b64ada5495bb5d9a609ce5a3cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:13:02.534958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-99823a83-743b-45c6-bdd8-a6936b886c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:13:02.534958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-99823a83-743b-45c6-bdd8-a6936b886c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:13:02.535425 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1208/2389] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:13:02 2022] DELETE /identity/v3/projects/76dd0b64ada5495bb5d9a609ce5a3cd2 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:13:11.886030 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=44,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:27.973769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a1056-1a87-4b1e-b045-7ed02e9083cd None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:27.974447 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a1056-1a87-4b1e-b045-7ed02e9083cd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:27.974447 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a1056-1a87-4b1e-b045-7ed02e9083cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:27.993835 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-878a1056-1a87-4b1e-b045-7ed02e9083cd None None] MFA Rules not processed for user `399d1cc4c30a4cedbae053d3cf7301fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:13:27.995048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-878a1056-1a87-4b1e-b045-7ed02e9083cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:13:28.052340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1182/2390] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:13:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:13:38.044867 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=25 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:01.588044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99823a83-743b-45c6-bdd8-a6936b886c12 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:01.590177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-99823a83-743b-45c6-bdd8-a6936b886c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:01.665136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99823a83-743b-45c6-bdd8-a6936b886c12 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:01.676688 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53296df9-f1ab-405a-a50b-3d3c6c4a07be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff43a72eaef462f86426ad3ceccd3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:01.677366 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53296df9-f1ab-405a-a50b-3d3c6c4a07be service placement] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:01.677658 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53296df9-f1ab-405a-a50b-3d3c6c4a07be service placement] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:01.677937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53296df9-f1ab-405a-a50b-3d3c6c4a07be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:01.679751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-53296df9-f1ab-405a-a50b-3d3c6c4a07be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:01.692274 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53296df9-f1ab-405a-a50b-3d3c6c4a07be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:01.694257 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53296df9-f1ab-405a-a50b-3d3c6c4a07be service placement] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:01.705295 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1209/2391] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:14:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:14:11.700049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=32 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:14.782792 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a1056-1a87-4b1e-b045-7ed02e9083cd None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:14.784685 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-878a1056-1a87-4b1e-b045-7ed02e9083cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:14.863993 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a1056-1a87-4b1e-b045-7ed02e9083cd None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:14.867934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c5464-0598-4461-abf5-002929b08ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:14.868561 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c5464-0598-4461-abf5-002929b08ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:14.868905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c5464-0598-4461-abf5-002929b08ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:14.869178 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c5464-0598-4461-abf5-002929b08ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:14.870942 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bb7c5464-0598-4461-abf5-002929b08ab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:14.933831 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c5464-0598-4461-abf5-002929b08ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:14.935269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c5464-0598-4461-abf5-002929b08ab1 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:14.945267 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1183/2392] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:14:18.198793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1435ae-132b-414b-b897-e206c9992afa None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:18.199369 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1435ae-132b-414b-b897-e206c9992afa None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:18.199533 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1435ae-132b-414b-b897-e206c9992afa None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:18.201134 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1210/2393] 10.222.0.75 () {54 vars in 921 bytes} [Thu Jul 28 18:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:14:18.227451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a5465-089f-47cd-9139-c740033a8800 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:18.227974 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a5465-089f-47cd-9139-c740033a8800 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:18.228146 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a5465-089f-47cd-9139-c740033a8800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:18.289202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-871a5465-089f-47cd-9139-c740033a8800 None None] MFA Rules not processed for user `cff43a72eaef462f86426ad3ceccd3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:14:18.290348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-871a5465-089f-47cd-9139-c740033a8800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:18.299053 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1184/2394] 10.222.0.75 () {58 vars in 1018 bytes} [Thu Jul 28 18:14:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:14:18.310362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1435ae-132b-414b-b897-e206c9992afa None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:18.324297 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1435ae-132b-414b-b897-e206c9992afa None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:18.330106 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492da5ba-544c-4753-87c8-156b957cddd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff43a72eaef462f86426ad3ceccd3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:18.330724 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492da5ba-544c-4753-87c8-156b957cddd0 service placement] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:18.331008 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492da5ba-544c-4753-87c8-156b957cddd0 service placement] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:18.331283 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492da5ba-544c-4753-87c8-156b957cddd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:18.342550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492da5ba-544c-4753-87c8-156b957cddd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:18.348799 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492da5ba-544c-4753-87c8-156b957cddd0 service placement] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:18.360727 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a5465-089f-47cd-9139-c740033a8800 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:18.361177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1211/2395] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:14:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:14:18.366204 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-871a5465-089f-47cd-9139-c740033a8800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:18.380724 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a5465-089f-47cd-9139-c740033a8800 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:18.385523 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817cf04-e952-4d57-b91f-1b74e2b0eaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:18.386285 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817cf04-e952-4d57-b91f-1b74e2b0eaa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:18.386579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817cf04-e952-4d57-b91f-1b74e2b0eaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:18.386861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817cf04-e952-4d57-b91f-1b74e2b0eaa1 admin admin] PATH_INFO: `/v3/users/6811352e7e4e44fcb5598bc5d900e0a7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:18.388056 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817cf04-e952-4d57-b91f-1b74e2b0eaa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6811352e7e4e44fcb5598bc5d900e0a7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:18.390111 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817cf04-e952-4d57-b91f-1b74e2b0eaa1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:18.634708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6817cf04-e952-4d57-b91f-1b74e2b0eaa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6811352e7e4e44fcb5598bc5d900e0a7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:18.635368 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6817cf04-e952-4d57-b91f-1b74e2b0eaa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6811352e7e4e44fcb5598bc5d900e0a7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:18.636566 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:18.647972 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6817cf04-e952-4d57-b91f-1b74e2b0eaa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6811352e7e4e44fcb5598bc5d900e0a7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:18.654810 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6817cf04-e952-4d57-b91f-1b74e2b0eaa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6811352e7e4e44fcb5598bc5d900e0a7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:18.655452 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6817cf04-e952-4d57-b91f-1b74e2b0eaa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6811352e7e4e44fcb5598bc5d900e0a7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:18.786812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1185/2396] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:14:18 2022] DELETE /identity/v3/users/6811352e7e4e44fcb5598bc5d900e0a7 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:14:19.074493 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492da5ba-544c-4753-87c8-156b957cddd0 service placement] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:19.085772 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492da5ba-544c-4753-87c8-156b957cddd0 service placement] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:19.143446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f8e11-f0fd-43f8-8c15-efa10a5d5f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:19.144096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f8e11-f0fd-43f8-8c15-efa10a5d5f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:19.144376 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f8e11-f0fd-43f8-8c15-efa10a5d5f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:19.144651 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f8e11-f0fd-43f8-8c15-efa10a5d5f0e admin admin] PATH_INFO: `/v3/projects/c2fcb2737de84d1594f4d46684f00f34` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:19.145841 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f8e11-f0fd-43f8-8c15-efa10a5d5f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2fcb2737de84d1594f4d46684f00f34)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:19.147775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f8e11-f0fd-43f8-8c15-efa10a5d5f0e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:19.443834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d47f8e11-f0fd-43f8-8c15-efa10a5d5f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2fcb2737de84d1594f4d46684f00f34', 'request_id': 'req-d47f8e11-f0fd-43f8-8c15-efa10a5d5f0e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:19.523051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d47f8e11-f0fd-43f8-8c15-efa10a5d5f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2fcb2737de84d1594f4d46684f00f34', 'request_id': 'req-d47f8e11-f0fd-43f8-8c15-efa10a5d5f0e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:19.529180 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d47f8e11-f0fd-43f8-8c15-efa10a5d5f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2fcb2737de84d1594f4d46684f00f34', 'request_id': 'req-d47f8e11-f0fd-43f8-8c15-efa10a5d5f0e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:19.541320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d47f8e11-f0fd-43f8-8c15-efa10a5d5f0e admin admin] The token cache is being invalidate because project c2fcb2737de84d1594f4d46684f00f34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:14:19.541645 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d47f8e11-f0fd-43f8-8c15-efa10a5d5f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:19.542294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d47f8e11-f0fd-43f8-8c15-efa10a5d5f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:19.543820 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1212/2397] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:14:19 2022] DELETE /identity/v3/projects/c2fcb2737de84d1594f4d46684f00f34 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:14:19.550905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03af74-0ed4-49e9-89d6-7f5054cebb7a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:19.551404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03af74-0ed4-49e9-89d6-7f5054cebb7a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:19.551509 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03af74-0ed4-49e9-89d6-7f5054cebb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:19.601169 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3c03af74-0ed4-49e9-89d6-7f5054cebb7a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:14:19.602343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3c03af74-0ed4-49e9-89d6-7f5054cebb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:19.665738 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1186/2398] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:14:19.673919 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed028d85-a2b1-4e0b-b138-d0c5392bbb19 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:19.674237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed028d85-a2b1-4e0b-b138-d0c5392bbb19 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:19.674540 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed028d85-a2b1-4e0b-b138-d0c5392bbb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:19.693827 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-ed028d85-a2b1-4e0b-b138-d0c5392bbb19 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:14:19.695028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ed028d85-a2b1-4e0b-b138-d0c5392bbb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:19.702740 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1213/2399] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:14:19.707561 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03af74-0ed4-49e9-89d6-7f5054cebb7a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:19.717453 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03af74-0ed4-49e9-89d6-7f5054cebb7a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:19.722695 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719593b5-fa3b-4f7b-8691-37dff4f66833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:19.723309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719593b5-fa3b-4f7b-8691-37dff4f66833 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:19.723590 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719593b5-fa3b-4f7b-8691-37dff4f66833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:19.723862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719593b5-fa3b-4f7b-8691-37dff4f66833 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:19.724559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719593b5-fa3b-4f7b-8691-37dff4f66833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:14:19.724911 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719593b5-fa3b-4f7b-8691-37dff4f66833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:19.726500 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719593b5-fa3b-4f7b-8691-37dff4f66833 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:19.738321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1187/2400] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:14:19.742991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed028d85-a2b1-4e0b-b138-d0c5392bbb19 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:19.752171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed028d85-a2b1-4e0b-b138-d0c5392bbb19 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:19.756722 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1be894-4647-448b-865d-cc72548b3356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:19.757357 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1be894-4647-448b-865d-cc72548b3356 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:19.757639 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1be894-4647-448b-865d-cc72548b3356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:19.757915 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1be894-4647-448b-865d-cc72548b3356 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:19.758566 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1be894-4647-448b-865d-cc72548b3356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:19.760477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1be894-4647-448b-865d-cc72548b3356 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:19.869452 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1214/2401] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:14:19 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:14:19.873521 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719593b5-fa3b-4f7b-8691-37dff4f66833 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:19.883814 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719593b5-fa3b-4f7b-8691-37dff4f66833 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:19.947914 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60cd03-8527-4e3a-a84e-71b03e1636a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:19.948894 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60cd03-8527-4e3a-a84e-71b03e1636a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:19.949246 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60cd03-8527-4e3a-a84e-71b03e1636a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:19.949532 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60cd03-8527-4e3a-a84e-71b03e1636a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:19.950232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60cd03-8527-4e3a-a84e-71b03e1636a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:19.952423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60cd03-8527-4e3a-a84e-71b03e1636a2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:20.055843 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1188/2402] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:14:19 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:14:20.060106 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1be894-4647-448b-865d-cc72548b3356 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:20.071327 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1be894-4647-448b-865d-cc72548b3356 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:20.075978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8703737-02d1-4c73-bb6e-bac141e66fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:20.076587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8703737-02d1-4c73-bb6e-bac141e66fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:20.076899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8703737-02d1-4c73-bb6e-bac141e66fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:20.077181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8703737-02d1-4c73-bb6e-bac141e66fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:20.077871 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8703737-02d1-4c73-bb6e-bac141e66fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:20.080247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8703737-02d1-4c73-bb6e-bac141e66fa2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:20.090747 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1215/2403] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:14:20.094709 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60cd03-8527-4e3a-a84e-71b03e1636a2 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:20.104921 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60cd03-8527-4e3a-a84e-71b03e1636a2 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:20.109718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e47245-85e4-48aa-87aa-c7d3ba9da3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:20.110328 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e47245-85e4-48aa-87aa-c7d3ba9da3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:20.110612 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e47245-85e4-48aa-87aa-c7d3ba9da3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:20.110891 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e47245-85e4-48aa-87aa-c7d3ba9da3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:20.111700 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e47245-85e4-48aa-87aa-c7d3ba9da3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:20.113504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e47245-85e4-48aa-87aa-c7d3ba9da3a1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:20.126952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1189/2404] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:14:20.131095 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8703737-02d1-4c73-bb6e-bac141e66fa2 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:20.141232 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8703737-02d1-4c73-bb6e-bac141e66fa2 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:20.146899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b18170-410a-4b4d-86b7-cce68ce826ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:20.147564 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b18170-410a-4b4d-86b7-cce68ce826ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:20.147850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b18170-410a-4b4d-86b7-cce68ce826ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:20.148126 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b18170-410a-4b4d-86b7-cce68ce826ab admin admin] PATH_INFO: `/v3/projects/6d27d17fa0604fd09b72d7b3685e0e5c/users/37e201441d61470eaf1dd713990b9354/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:20.164549 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b18170-410a-4b4d-86b7-cce68ce826ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d27d17fa0604fd09b72d7b3685e0e5c, user_id=37e201441d61470eaf1dd713990b9354, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:20.167380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b18170-410a-4b4d-86b7-cce68ce826ab admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:20.284934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1216/2405] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:14:20 2022] PUT /identity/v3/projects/6d27d17fa0604fd09b72d7b3685e0e5c/users/37e201441d61470eaf1dd713990b9354/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:14:20.295218 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8fa36-cf74-4d87-a4aa-6ca3fd9b0e5e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:20.295508 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8fa36-cf74-4d87-a4aa-6ca3fd9b0e5e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:20.297796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8fa36-cf74-4d87-a4aa-6ca3fd9b0e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:20.315956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:20.324644 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-92b8fa36-cf74-4d87-a4aa-6ca3fd9b0e5e None None] MFA Rules not processed for user `37e201441d61470eaf1dd713990b9354`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:14:20.325889 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-92b8fa36-cf74-4d87-a4aa-6ca3fd9b0e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:20.393279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1190/2406] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:14:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:14:20.405598 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b18170-410a-4b4d-86b7-cce68ce826ab admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:20.419682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:20.473349 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b18170-410a-4b4d-86b7-cce68ce826ab admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:20.478114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef4c70-304f-4b2e-b81c-903bcff37bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:20.478734 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef4c70-304f-4b2e-b81c-903bcff37bbe admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:20.479019 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef4c70-304f-4b2e-b81c-903bcff37bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:20.479298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef4c70-304f-4b2e-b81c-903bcff37bbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:20.479968 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef4c70-304f-4b2e-b81c-903bcff37bbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:20.481986 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef4c70-304f-4b2e-b81c-903bcff37bbe admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:20.588170 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1217/2407] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:14:20 2022] POST /identity/v3/projects => generated 371 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:14:20.592332 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8fa36-cf74-4d87-a4aa-6ca3fd9b0e5e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:20.603870 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8fa36-cf74-4d87-a4aa-6ca3fd9b0e5e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:20.660380 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d05d7-cc67-41dc-b6cd-70a16742287c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:20.661096 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d05d7-cc67-41dc-b6cd-70a16742287c admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:20.661385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d05d7-cc67-41dc-b6cd-70a16742287c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:20.661663 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d05d7-cc67-41dc-b6cd-70a16742287c admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:20.662338 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d05d7-cc67-41dc-b6cd-70a16742287c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:20.664293 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d05d7-cc67-41dc-b6cd-70a16742287c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:20.827031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1191/2408] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:14:20 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:14:20.831661 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef4c70-304f-4b2e-b81c-903bcff37bbe admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:20.842381 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef4c70-304f-4b2e-b81c-903bcff37bbe admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:20.847023 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4e844-6225-427c-9d18-e58b3022f2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:20.847733 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4e844-6225-427c-9d18-e58b3022f2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:20.848022 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4e844-6225-427c-9d18-e58b3022f2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:20.848306 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4e844-6225-427c-9d18-e58b3022f2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:20.849048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4e844-6225-427c-9d18-e58b3022f2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:20.850679 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4e844-6225-427c-9d18-e58b3022f2d2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:20.861641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1218/2409] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:14:20.867806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d05d7-cc67-41dc-b6cd-70a16742287c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:20.878492 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d05d7-cc67-41dc-b6cd-70a16742287c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:20.883211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f7f64-3251-43d5-b93f-15fa716a6f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:20.883874 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f7f64-3251-43d5-b93f-15fa716a6f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:20.884246 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f7f64-3251-43d5-b93f-15fa716a6f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:20.884527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f7f64-3251-43d5-b93f-15fa716a6f4e admin admin] PATH_INFO: `/v3/projects/bb19f16d459e47028c87bea8f8d3c5c9/users/9975c715d22c4bec9e7b25256481025f/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:20.900059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f7f64-3251-43d5-b93f-15fa716a6f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb19f16d459e47028c87bea8f8d3c5c9, user_id=9975c715d22c4bec9e7b25256481025f, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:20.902822 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f7f64-3251-43d5-b93f-15fa716a6f4e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:21.003165 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1192/2410] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:14:20 2022] PUT /identity/v3/projects/bb19f16d459e47028c87bea8f8d3c5c9/users/9975c715d22c4bec9e7b25256481025f/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:14:21.007237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4e844-6225-427c-9d18-e58b3022f2d2 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:21.017922 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4e844-6225-427c-9d18-e58b3022f2d2 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:21.072714 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d27f3-c7e8-4040-b3d1-4c8a99086e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:21.073358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d27f3-c7e8-4040-b3d1-4c8a99086e88 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:21.073638 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d27f3-c7e8-4040-b3d1-4c8a99086e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:21.073907 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d27f3-c7e8-4040-b3d1-4c8a99086e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:21.074594 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d27f3-c7e8-4040-b3d1-4c8a99086e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:21.076196 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d27f3-c7e8-4040-b3d1-4c8a99086e88 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:21.087070 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1219/2411] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:14:21.091402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f7f64-3251-43d5-b93f-15fa716a6f4e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:21.101602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f7f64-3251-43d5-b93f-15fa716a6f4e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:21.106411 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b73ebf-d82e-48bb-87ec-b7730d1e8a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:21.107089 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b73ebf-d82e-48bb-87ec-b7730d1e8a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:21.107366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b73ebf-d82e-48bb-87ec-b7730d1e8a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:21.107638 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b73ebf-d82e-48bb-87ec-b7730d1e8a49 admin admin] PATH_INFO: `/v3/projects/bb19f16d459e47028c87bea8f8d3c5c9/users/9975c715d22c4bec9e7b25256481025f/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:21.109683 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b73ebf-d82e-48bb-87ec-b7730d1e8a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb19f16d459e47028c87bea8f8d3c5c9, user_id=9975c715d22c4bec9e7b25256481025f, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:21.112661 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b73ebf-d82e-48bb-87ec-b7730d1e8a49 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:21.123701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1193/2412] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:14:21 2022] PUT /identity/v3/projects/bb19f16d459e47028c87bea8f8d3c5c9/users/9975c715d22c4bec9e7b25256481025f/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:14:21.135717 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54154b7-4ba0-4eae-8a94-f062ad660413 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:21.136012 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54154b7-4ba0-4eae-8a94-f062ad660413 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:21.141081 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54154b7-4ba0-4eae-8a94-f062ad660413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:21.164904 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d54154b7-4ba0-4eae-8a94-f062ad660413 None None] MFA Rules not processed for user `9975c715d22c4bec9e7b25256481025f`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:14:21.166236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d54154b7-4ba0-4eae-8a94-f062ad660413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:21.233781 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1220/2413] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:14:21 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:14:21.245932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b73ebf-d82e-48bb-87ec-b7730d1e8a49 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:21.247579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d5b73ebf-d82e-48bb-87ec-b7730d1e8a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:21.302829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:21.326527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b73ebf-d82e-48bb-87ec-b7730d1e8a49 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:21.330273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66b23b-1302-48bc-a886-8f57f52fda56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:21.330887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66b23b-1302-48bc-a886-8f57f52fda56 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:21.331167 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66b23b-1302-48bc-a886-8f57f52fda56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:21.331439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66b23b-1302-48bc-a886-8f57f52fda56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:21.341318 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66b23b-1302-48bc-a886-8f57f52fda56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:21.342769 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66b23b-1302-48bc-a886-8f57f52fda56 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:21.353042 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1194/2414] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:14:21 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:14:21.732018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54154b7-4ba0-4eae-8a94-f062ad660413 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:21.742550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54154b7-4ba0-4eae-8a94-f062ad660413 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:21.746186 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5ba2f-701b-40cf-a29b-7a5407558d79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:21.746801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5ba2f-701b-40cf-a29b-7a5407558d79 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:21.747087 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5ba2f-701b-40cf-a29b-7a5407558d79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:21.747367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5ba2f-701b-40cf-a29b-7a5407558d79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:21.752466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:21.802943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5ba2f-701b-40cf-a29b-7a5407558d79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:21.804418 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5ba2f-701b-40cf-a29b-7a5407558d79 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:21.813222 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1221/2415] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:14:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:14:31.413821 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=12 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:31.872617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=24 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:03.046096 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a27eb-788c-4170-8478-4c02e60d737f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:03.046635 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a27eb-788c-4170-8478-4c02e60d737f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:03.046635 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a27eb-788c-4170-8478-4c02e60d737f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:03.067235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9e7a27eb-788c-4170-8478-4c02e60d737f None None] MFA Rules not processed for user `922506341d4a43c4a5f0cf9f610c4b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:03.074356 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9e7a27eb-788c-4170-8478-4c02e60d737f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:03.143791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1195/2416] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:15:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:15:03.613586 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0811c09-0b7b-4a53-a693-51e932a71158 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:03.614099 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0811c09-0b7b-4a53-a693-51e932a71158 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:03.614198 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0811c09-0b7b-4a53-a693-51e932a71158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:03.634564 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-a0811c09-0b7b-4a53-a693-51e932a71158 None None] MFA Rules not processed for user `1cbbfdda843a4ab98ff9cf0742513f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:03.635822 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a0811c09-0b7b-4a53-a693-51e932a71158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:03.701829 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1222/2417] 10.222.0.75 () {58 vars in 1009 bytes} [Thu Jul 28 18:15:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:03.915044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a27eb-788c-4170-8478-4c02e60d737f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:03.915044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9e7a27eb-788c-4170-8478-4c02e60d737f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:03.987607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a27eb-788c-4170-8478-4c02e60d737f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:03.993931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024544c6-2826-4285-b75d-9c03f5ecea87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77b4fcb974d48a0bda4852c8d304511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:03.994564 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024544c6-2826-4285-b75d-9c03f5ecea87 service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:03.994852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024544c6-2826-4285-b75d-9c03f5ecea87 service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:03.995136 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024544c6-2826-4285-b75d-9c03f5ecea87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:04.004020 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024544c6-2826-4285-b75d-9c03f5ecea87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:04.013908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024544c6-2826-4285-b75d-9c03f5ecea87 service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:04.017185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1196/2418] 10.222.0.75 () {60 vars in 1384 bytes} [Thu Jul 28 18:15:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:15:11.021862 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0811c09-0b7b-4a53-a693-51e932a71158 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:11.100888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0811c09-0b7b-4a53-a693-51e932a71158 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:11.107020 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7a096-fc72-4c63-ab63-60123e958f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:11.107792 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7a096-fc72-4c63-ab63-60123e958f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:11.108167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7a096-fc72-4c63-ab63-60123e958f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:11.108783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7a096-fc72-4c63-ab63-60123e958f13 admin admin] PATH_INFO: `/v3/users/37e201441d61470eaf1dd713990b9354` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:11.110143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7a096-fc72-4c63-ab63-60123e958f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e201441d61470eaf1dd713990b9354)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:11.112327 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7a096-fc72-4c63-ab63-60123e958f13 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:11.395698 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5ed7a096-fc72-4c63-ab63-60123e958f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e201441d61470eaf1dd713990b9354'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:11.499598 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5ed7a096-fc72-4c63-ab63-60123e958f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e201441d61470eaf1dd713990b9354'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:11.532257 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5ed7a096-fc72-4c63-ab63-60123e958f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e201441d61470eaf1dd713990b9354'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:11.556495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5ed7a096-fc72-4c63-ab63-60123e958f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e201441d61470eaf1dd713990b9354'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:11.557378 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5ed7a096-fc72-4c63-ab63-60123e958f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e201441d61470eaf1dd713990b9354'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:11.565633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1223/2419] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:11 2022] DELETE /identity/v3/users/37e201441d61470eaf1dd713990b9354 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:11.573928 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30123eb-f647-49bf-8095-5801d9c78918 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:11.574416 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30123eb-f647-49bf-8095-5801d9c78918 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:11.574524 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30123eb-f647-49bf-8095-5801d9c78918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:11.596203 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d30123eb-f647-49bf-8095-5801d9c78918 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:11.602479 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d30123eb-f647-49bf-8095-5801d9c78918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:11.686573 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1197/2420] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:15:11.697941 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7a096-fc72-4c63-ab63-60123e958f13 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:11.699927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5ed7a096-fc72-4c63-ab63-60123e958f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:11.727894 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:11.770761 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7a096-fc72-4c63-ab63-60123e958f13 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:11.775545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714b7b4-6512-4a07-a0a4-9594eb7a068b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:11.776623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714b7b4-6512-4a07-a0a4-9594eb7a068b service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:11.777039 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714b7b4-6512-4a07-a0a4-9594eb7a068b service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:11.777254 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714b7b4-6512-4a07-a0a4-9594eb7a068b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:11.790268 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714b7b4-6512-4a07-a0a4-9594eb7a068b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:11.791549 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714b7b4-6512-4a07-a0a4-9594eb7a068b service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:11.813024 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1224/2421] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:12.703789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30123eb-f647-49bf-8095-5801d9c78918 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:12.705526 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d30123eb-f647-49bf-8095-5801d9c78918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:12.731335 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30123eb-f647-49bf-8095-5801d9c78918 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:12.750153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65665b-e0c7-492a-b10c-e1d980f16c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:12.750153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65665b-e0c7-492a-b10c-e1d980f16c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:12.750153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65665b-e0c7-492a-b10c-e1d980f16c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:12.750153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65665b-e0c7-492a-b10c-e1d980f16c8e admin admin] PATH_INFO: `/v3/projects/6d27d17fa0604fd09b72d7b3685e0e5c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:12.750539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65665b-e0c7-492a-b10c-e1d980f16c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d27d17fa0604fd09b72d7b3685e0e5c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:12.750539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65665b-e0c7-492a-b10c-e1d980f16c8e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:12.861592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:12.881127 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5b65665b-e0c7-492a-b10c-e1d980f16c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d27d17fa0604fd09b72d7b3685e0e5c', 'request_id': 'req-5b65665b-e0c7-492a-b10c-e1d980f16c8e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:12.895548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5b65665b-e0c7-492a-b10c-e1d980f16c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d27d17fa0604fd09b72d7b3685e0e5c', 'request_id': 'req-5b65665b-e0c7-492a-b10c-e1d980f16c8e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:12.904681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5b65665b-e0c7-492a-b10c-e1d980f16c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d27d17fa0604fd09b72d7b3685e0e5c', 'request_id': 'req-5b65665b-e0c7-492a-b10c-e1d980f16c8e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:12.997802 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5b65665b-e0c7-492a-b10c-e1d980f16c8e admin admin] The token cache is being invalidate because project 6d27d17fa0604fd09b72d7b3685e0e5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:15:12.998411 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5b65665b-e0c7-492a-b10c-e1d980f16c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:12.999217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5b65665b-e0c7-492a-b10c-e1d980f16c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:13.004526 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1198/2422] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:15:12 2022] DELETE /identity/v3/projects/6d27d17fa0604fd09b72d7b3685e0e5c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:13.008555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714b7b4-6512-4a07-a0a4-9594eb7a068b service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:13.022371 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714b7b4-6512-4a07-a0a4-9594eb7a068b service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:13.133846 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226687bf-5dcc-44e5-9372-fff3208b6345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:13.134440 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226687bf-5dcc-44e5-9372-fff3208b6345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:13.134724 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226687bf-5dcc-44e5-9372-fff3208b6345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:13.135007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226687bf-5dcc-44e5-9372-fff3208b6345 admin admin] PATH_INFO: `/v3/users/9975c715d22c4bec9e7b25256481025f` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:13.136944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226687bf-5dcc-44e5-9372-fff3208b6345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9975c715d22c4bec9e7b25256481025f)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:13.139014 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226687bf-5dcc-44e5-9372-fff3208b6345 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:13.391307 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-226687bf-5dcc-44e5-9372-fff3208b6345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9975c715d22c4bec9e7b25256481025f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:13.495012 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-226687bf-5dcc-44e5-9372-fff3208b6345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9975c715d22c4bec9e7b25256481025f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:13.521672 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-226687bf-5dcc-44e5-9372-fff3208b6345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9975c715d22c4bec9e7b25256481025f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:13.536652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-226687bf-5dcc-44e5-9372-fff3208b6345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9975c715d22c4bec9e7b25256481025f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:13.537645 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-226687bf-5dcc-44e5-9372-fff3208b6345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9975c715d22c4bec9e7b25256481025f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:13.551632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1225/2423] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:13 2022] DELETE /identity/v3/users/9975c715d22c4bec9e7b25256481025f => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:14.986533 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65665b-e0c7-492a-b10c-e1d980f16c8e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:14.995446 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5b65665b-e0c7-492a-b10c-e1d980f16c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:15.029368 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65665b-e0c7-492a-b10c-e1d980f16c8e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:15.115281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317d0ff-1490-4d16-9c0e-2ba33ba44587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:15.116000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317d0ff-1490-4d16-9c0e-2ba33ba44587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:15.117958 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317d0ff-1490-4d16-9c0e-2ba33ba44587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:15.117958 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317d0ff-1490-4d16-9c0e-2ba33ba44587 admin admin] PATH_INFO: `/v3/projects/bb19f16d459e47028c87bea8f8d3c5c9` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:15.118477 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317d0ff-1490-4d16-9c0e-2ba33ba44587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb19f16d459e47028c87bea8f8d3c5c9)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:15.120434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317d0ff-1490-4d16-9c0e-2ba33ba44587 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:15.273983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2317d0ff-1490-4d16-9c0e-2ba33ba44587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb19f16d459e47028c87bea8f8d3c5c9', 'request_id': 'req-2317d0ff-1490-4d16-9c0e-2ba33ba44587'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:15.280878 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2317d0ff-1490-4d16-9c0e-2ba33ba44587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb19f16d459e47028c87bea8f8d3c5c9', 'request_id': 'req-2317d0ff-1490-4d16-9c0e-2ba33ba44587'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:15.291209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2317d0ff-1490-4d16-9c0e-2ba33ba44587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb19f16d459e47028c87bea8f8d3c5c9', 'request_id': 'req-2317d0ff-1490-4d16-9c0e-2ba33ba44587'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:15.421148 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2317d0ff-1490-4d16-9c0e-2ba33ba44587 admin admin] The token cache is being invalidate because project bb19f16d459e47028c87bea8f8d3c5c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:15:15.421443 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2317d0ff-1490-4d16-9c0e-2ba33ba44587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:15.422101 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2317d0ff-1490-4d16-9c0e-2ba33ba44587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:15.423641 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1199/2424] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:15:14 2022] DELETE /identity/v3/projects/bb19f16d459e47028c87bea8f8d3c5c9 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:15.428655 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a18395-b4db-42eb-a5c0-37e86ec9557e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:15.429181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a18395-b4db-42eb-a5c0-37e86ec9557e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:15.429902 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a18395-b4db-42eb-a5c0-37e86ec9557e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:15.451436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-00a18395-b4db-42eb-a5c0-37e86ec9557e None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:15.456098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-00a18395-b4db-42eb-a5c0-37e86ec9557e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:15.493099 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:15.521317 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1226/2425] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:15.529506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e70cd-c047-44c6-ac2f-ba0f1a3cd66c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:15.529720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e70cd-c047-44c6-ac2f-ba0f1a3cd66c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:15.529995 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e70cd-c047-44c6-ac2f-ba0f1a3cd66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:15.551981 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-433e70cd-c047-44c6-ac2f-ba0f1a3cd66c None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:15.553877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-433e70cd-c047-44c6-ac2f-ba0f1a3cd66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:15.565898 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1200/2426] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:15:15.570404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a18395-b4db-42eb-a5c0-37e86ec9557e None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:15.581223 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a18395-b4db-42eb-a5c0-37e86ec9557e None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:15.586806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa1d67-d15a-4d16-867e-65c0177681ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:15.587463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa1d67-d15a-4d16-867e-65c0177681ef admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:15.588085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa1d67-d15a-4d16-867e-65c0177681ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:15.588367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa1d67-d15a-4d16-867e-65c0177681ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:15.589121 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa1d67-d15a-4d16-867e-65c0177681ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:15:15.589431 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa1d67-d15a-4d16-867e-65c0177681ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:15.591084 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa1d67-d15a-4d16-867e-65c0177681ef admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:15.606081 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1227/2427] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:15:15.609826 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e70cd-c047-44c6-ac2f-ba0f1a3cd66c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:15.620822 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e70cd-c047-44c6-ac2f-ba0f1a3cd66c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:15.625727 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ee983-b2a6-4b6a-ac80-2f01988f93c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:15.626369 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ee983-b2a6-4b6a-ac80-2f01988f93c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:15.626674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ee983-b2a6-4b6a-ac80-2f01988f93c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:15.627000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ee983-b2a6-4b6a-ac80-2f01988f93c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:15.627740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ee983-b2a6-4b6a-ac80-2f01988f93c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:15.629779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ee983-b2a6-4b6a-ac80-2f01988f93c8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:15.738595 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1201/2428] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:15 2022] POST /identity/v3/projects => generated 363 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:15:15.742757 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa1d67-d15a-4d16-867e-65c0177681ef admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:15.753754 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa1d67-d15a-4d16-867e-65c0177681ef admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:15.837658 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b00ef9-2a84-4e8b-9125-9b37718ebc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:15.838301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b00ef9-2a84-4e8b-9125-9b37718ebc43 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:15.838582 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b00ef9-2a84-4e8b-9125-9b37718ebc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:15.838857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b00ef9-2a84-4e8b-9125-9b37718ebc43 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:15.839535 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b00ef9-2a84-4e8b-9125-9b37718ebc43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:15.841699 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b00ef9-2a84-4e8b-9125-9b37718ebc43 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:15.949056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1228/2429] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:15 2022] POST /identity/v3/users => generated 282 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:15.954088 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ee983-b2a6-4b6a-ac80-2f01988f93c8 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:15.965886 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ee983-b2a6-4b6a-ac80-2f01988f93c8 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:15.970609 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd3904-9cae-4714-a780-b1620901c704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:15.971238 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd3904-9cae-4714-a780-b1620901c704 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:15.971543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd3904-9cae-4714-a780-b1620901c704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:15.971840 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd3904-9cae-4714-a780-b1620901c704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:15.972538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd3904-9cae-4714-a780-b1620901c704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:15.974237 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd3904-9cae-4714-a780-b1620901c704 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:15.985091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1202/2430] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:15:15.990624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b00ef9-2a84-4e8b-9125-9b37718ebc43 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:16.000769 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b00ef9-2a84-4e8b-9125-9b37718ebc43 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:16.005899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad311e-a69d-4d1d-a8d0-578cbf3768d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:16.006541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad311e-a69d-4d1d-a8d0-578cbf3768d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:16.006824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad311e-a69d-4d1d-a8d0-578cbf3768d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:16.007102 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad311e-a69d-4d1d-a8d0-578cbf3768d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:16.007821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad311e-a69d-4d1d-a8d0-578cbf3768d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:16.009480 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad311e-a69d-4d1d-a8d0-578cbf3768d6 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:16.020359 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1229/2431] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:16.025120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd3904-9cae-4714-a780-b1620901c704 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:16.035785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd3904-9cae-4714-a780-b1620901c704 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:16.041406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75006d56-bd09-41f4-86d6-b2e899dc06f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:16.042149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75006d56-bd09-41f4-86d6-b2e899dc06f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:16.042430 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75006d56-bd09-41f4-86d6-b2e899dc06f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:16.043113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75006d56-bd09-41f4-86d6-b2e899dc06f5 admin admin] PATH_INFO: `/v3/projects/4df4808424d1477e954a5ad1a1d6a891/users/34e12096359041ee9b9317c5b197b97e/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:16.046117 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:16.059473 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75006d56-bd09-41f4-86d6-b2e899dc06f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4df4808424d1477e954a5ad1a1d6a891, user_id=34e12096359041ee9b9317c5b197b97e, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:16.062650 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75006d56-bd09-41f4-86d6-b2e899dc06f5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:16.174031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1203/2432] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:16 2022] PUT /identity/v3/projects/4df4808424d1477e954a5ad1a1d6a891/users/34e12096359041ee9b9317c5b197b97e/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:16.185707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0645a5-3c6f-497e-8c3a-51b646552068 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:16.185997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0645a5-3c6f-497e-8c3a-51b646552068 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:16.186507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0645a5-3c6f-497e-8c3a-51b646552068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:16.216029 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-de0645a5-3c6f-497e-8c3a-51b646552068 None None] MFA Rules not processed for user `34e12096359041ee9b9317c5b197b97e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:16.217281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-de0645a5-3c6f-497e-8c3a-51b646552068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:16.281390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1230/2433] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:15:16 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:16.285974 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75006d56-bd09-41f4-86d6-b2e899dc06f5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:16.348031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75006d56-bd09-41f4-86d6-b2e899dc06f5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:16.353594 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d5512-1b0d-45fd-bf1f-de56018cda22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:16.354248 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d5512-1b0d-45fd-bf1f-de56018cda22 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:16.357106 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d5512-1b0d-45fd-bf1f-de56018cda22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:16.357106 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d5512-1b0d-45fd-bf1f-de56018cda22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:16.357106 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d5512-1b0d-45fd-bf1f-de56018cda22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:16.357460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d5512-1b0d-45fd-bf1f-de56018cda22 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:16.421771 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1204/2434] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:16 2022] POST /identity/v3/projects => generated 363 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:15:16.425804 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0645a5-3c6f-497e-8c3a-51b646552068 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:16.437383 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0645a5-3c6f-497e-8c3a-51b646552068 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:16.468705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:16.493000 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c45cc-c311-40ac-89bd-e28360150296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:16.493622 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c45cc-c311-40ac-89bd-e28360150296 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:16.493904 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c45cc-c311-40ac-89bd-e28360150296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:16.494184 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c45cc-c311-40ac-89bd-e28360150296 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:16.494860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c45cc-c311-40ac-89bd-e28360150296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:16.496834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c45cc-c311-40ac-89bd-e28360150296 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:16.575206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1231/2435] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:16 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:16.579188 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d5512-1b0d-45fd-bf1f-de56018cda22 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:16.590190 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d5512-1b0d-45fd-bf1f-de56018cda22 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:16.594800 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2aba19-12f4-4d45-ba66-972d9f062fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:16.595410 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aba19-12f4-4d45-ba66-972d9f062fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:16.595692 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aba19-12f4-4d45-ba66-972d9f062fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:16.595968 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aba19-12f4-4d45-ba66-972d9f062fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:16.596835 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2aba19-12f4-4d45-ba66-972d9f062fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:16.598440 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2aba19-12f4-4d45-ba66-972d9f062fc9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:16.609658 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1205/2436] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:16.613778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c45cc-c311-40ac-89bd-e28360150296 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:16.624004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c45cc-c311-40ac-89bd-e28360150296 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:16.628605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0261c7-730a-4e05-92f7-d2ceb674b397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:16.629288 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0261c7-730a-4e05-92f7-d2ceb674b397 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:16.629644 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0261c7-730a-4e05-92f7-d2ceb674b397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:16.629930 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0261c7-730a-4e05-92f7-d2ceb674b397 admin admin] PATH_INFO: `/v3/projects/7df6da48a6814cca9cd1fff15b7a08ab/users/455eed9e2fd24ba9b75b0e23d58a3c8c/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:16.644312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0261c7-730a-4e05-92f7-d2ceb674b397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7df6da48a6814cca9cd1fff15b7a08ab, user_id=455eed9e2fd24ba9b75b0e23d58a3c8c, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:16.647097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0261c7-730a-4e05-92f7-d2ceb674b397 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:16.746500 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1232/2437] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:16 2022] PUT /identity/v3/projects/7df6da48a6814cca9cd1fff15b7a08ab/users/455eed9e2fd24ba9b75b0e23d58a3c8c/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:15:16.750569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2aba19-12f4-4d45-ba66-972d9f062fc9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:16.760978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2aba19-12f4-4d45-ba66-972d9f062fc9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:16.817139 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688cd43-704e-48dd-ac89-ce95cbc0b852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:16.817782 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688cd43-704e-48dd-ac89-ce95cbc0b852 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:16.818074 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688cd43-704e-48dd-ac89-ce95cbc0b852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:16.818374 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688cd43-704e-48dd-ac89-ce95cbc0b852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:16.819070 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688cd43-704e-48dd-ac89-ce95cbc0b852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:16.820665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688cd43-704e-48dd-ac89-ce95cbc0b852 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:16.831397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1206/2438] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:16.835486 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0261c7-730a-4e05-92f7-d2ceb674b397 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:16.846182 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0261c7-730a-4e05-92f7-d2ceb674b397 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:16.850797 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adfc00-dc70-49fa-823e-b74673dc788c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:16.852030 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adfc00-dc70-49fa-823e-b74673dc788c admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:16.852313 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adfc00-dc70-49fa-823e-b74673dc788c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:16.852591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adfc00-dc70-49fa-823e-b74673dc788c admin admin] PATH_INFO: `/v3/projects/7df6da48a6814cca9cd1fff15b7a08ab/users/455eed9e2fd24ba9b75b0e23d58a3c8c/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:16.854780 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90adfc00-dc70-49fa-823e-b74673dc788c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7df6da48a6814cca9cd1fff15b7a08ab, user_id=455eed9e2fd24ba9b75b0e23d58a3c8c, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:16.857465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90adfc00-dc70-49fa-823e-b74673dc788c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:16.867881 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1233/2439] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:16 2022] PUT /identity/v3/projects/7df6da48a6814cca9cd1fff15b7a08ab/users/455eed9e2fd24ba9b75b0e23d58a3c8c/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:16.878040 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ef3f4-87d0-476b-9075-c3adb5b6e1d2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:16.878334 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ef3f4-87d0-476b-9075-c3adb5b6e1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:16.878620 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ef3f4-87d0-476b-9075-c3adb5b6e1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:16.906741 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-254ef3f4-87d0-476b-9075-c3adb5b6e1d2 None None] MFA Rules not processed for user `455eed9e2fd24ba9b75b0e23d58a3c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:16.907957 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-254ef3f4-87d0-476b-9075-c3adb5b6e1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:16.950621 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:16.978933 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1207/2440] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:15:16 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:15:16.990700 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adfc00-dc70-49fa-823e-b74673dc788c admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:16.992511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-90adfc00-dc70-49fa-823e-b74673dc788c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:17.071119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adfc00-dc70-49fa-823e-b74673dc788c admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:17.075181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecd340-ad6b-488c-9989-53998d29667a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:17.076224 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecd340-ad6b-488c-9989-53998d29667a service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:17.076514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecd340-ad6b-488c-9989-53998d29667a service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:17.076885 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecd340-ad6b-488c-9989-53998d29667a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:17.090529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecd340-ad6b-488c-9989-53998d29667a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:17.090529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecd340-ad6b-488c-9989-53998d29667a service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:17.103873 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1234/2441] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:16 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:18.203909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ef3f4-87d0-476b-9075-c3adb5b6e1d2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:18.276943 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ef3f4-87d0-476b-9075-c3adb5b6e1d2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:18.285681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee38ad-2c61-4390-945b-53bcc231a42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:18.286359 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee38ad-2c61-4390-945b-53bcc231a42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:18.286789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee38ad-2c61-4390-945b-53bcc231a42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:18.286902 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee38ad-2c61-4390-945b-53bcc231a42d admin admin] PATH_INFO: `/v3/users/34e12096359041ee9b9317c5b197b97e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:18.288119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee38ad-2c61-4390-945b-53bcc231a42d admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e12096359041ee9b9317c5b197b97e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:18.291023 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee38ad-2c61-4390-945b-53bcc231a42d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:18.528273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-87ee38ad-2c61-4390-945b-53bcc231a42d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e12096359041ee9b9317c5b197b97e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:18.529344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-87ee38ad-2c61-4390-945b-53bcc231a42d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e12096359041ee9b9317c5b197b97e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:18.546302 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-87ee38ad-2c61-4390-945b-53bcc231a42d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e12096359041ee9b9317c5b197b97e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:18.554115 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-87ee38ad-2c61-4390-945b-53bcc231a42d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e12096359041ee9b9317c5b197b97e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:18.555091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-87ee38ad-2c61-4390-945b-53bcc231a42d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e12096359041ee9b9317c5b197b97e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:18.637894 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1208/2442] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:18 2022] DELETE /identity/v3/users/34e12096359041ee9b9317c5b197b97e => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:18.642536 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d7c24-5cac-455d-8d07-311473f914b5 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:18.643029 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d7c24-5cac-455d-8d07-311473f914b5 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:18.643136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d7c24-5cac-455d-8d07-311473f914b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:18.662713 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-104d7c24-5cac-455d-8d07-311473f914b5 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:18.664556 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-104d7c24-5cac-455d-8d07-311473f914b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:18.722342 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1235/2443] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:18.732557 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee38ad-2c61-4390-945b-53bcc231a42d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:18.734194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-87ee38ad-2c61-4390-945b-53bcc231a42d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:18.793487 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee38ad-2c61-4390-945b-53bcc231a42d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:18.797015 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab5daa-41a5-4fec-861b-d0496130ee2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:18.797632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab5daa-41a5-4fec-861b-d0496130ee2d service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:18.797911 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab5daa-41a5-4fec-861b-d0496130ee2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:18.798182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab5daa-41a5-4fec-861b-d0496130ee2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:18.807097 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab5daa-41a5-4fec-861b-d0496130ee2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:18.808536 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab5daa-41a5-4fec-861b-d0496130ee2d service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:18.818314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1209/2444] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:19.308660 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d7c24-5cac-455d-8d07-311473f914b5 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:19.310605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-104d7c24-5cac-455d-8d07-311473f914b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:19.325273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d7c24-5cac-455d-8d07-311473f914b5 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:19.330297 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7b4c9-1bd4-4054-9607-a4c47f0d34f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:19.331024 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7b4c9-1bd4-4054-9607-a4c47f0d34f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:19.331459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7b4c9-1bd4-4054-9607-a4c47f0d34f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:19.331743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7b4c9-1bd4-4054-9607-a4c47f0d34f7 admin admin] PATH_INFO: `/v3/projects/4df4808424d1477e954a5ad1a1d6a891` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:19.333389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7b4c9-1bd4-4054-9607-a4c47f0d34f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4df4808424d1477e954a5ad1a1d6a891)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:19.338633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7b4c9-1bd4-4054-9607-a4c47f0d34f7 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:19.470367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:19.494215 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6ca7b4c9-1bd4-4054-9607-a4c47f0d34f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4df4808424d1477e954a5ad1a1d6a891', 'request_id': 'req-6ca7b4c9-1bd4-4054-9607-a4c47f0d34f7'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:19.596450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6ca7b4c9-1bd4-4054-9607-a4c47f0d34f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4df4808424d1477e954a5ad1a1d6a891', 'request_id': 'req-6ca7b4c9-1bd4-4054-9607-a4c47f0d34f7'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:19.604014 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6ca7b4c9-1bd4-4054-9607-a4c47f0d34f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4df4808424d1477e954a5ad1a1d6a891', 'request_id': 'req-6ca7b4c9-1bd4-4054-9607-a4c47f0d34f7'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:19.621876 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6ca7b4c9-1bd4-4054-9607-a4c47f0d34f7 admin admin] The token cache is being invalidate because project 4df4808424d1477e954a5ad1a1d6a891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:15:19.621876 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6ca7b4c9-1bd4-4054-9607-a4c47f0d34f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:19.621876 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6ca7b4c9-1bd4-4054-9607-a4c47f0d34f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:19.627665 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1236/2445] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:15:19 2022] DELETE /identity/v3/projects/4df4808424d1477e954a5ad1a1d6a891 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:19.633745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab5daa-41a5-4fec-861b-d0496130ee2d service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:19.638700 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:19.643664 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab5daa-41a5-4fec-861b-d0496130ee2d service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:19.702928 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cc03f-452d-4aae-a29a-26f51b994c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:19.703605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cc03f-452d-4aae-a29a-26f51b994c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:19.703896 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cc03f-452d-4aae-a29a-26f51b994c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:19.704170 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cc03f-452d-4aae-a29a-26f51b994c8c admin admin] PATH_INFO: `/v3/users/455eed9e2fd24ba9b75b0e23d58a3c8c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:19.705415 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cc03f-452d-4aae-a29a-26f51b994c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=455eed9e2fd24ba9b75b0e23d58a3c8c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:19.707392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cc03f-452d-4aae-a29a-26f51b994c8c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:19.937192 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7a6cc03f-452d-4aae-a29a-26f51b994c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '455eed9e2fd24ba9b75b0e23d58a3c8c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:19.937894 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7a6cc03f-452d-4aae-a29a-26f51b994c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '455eed9e2fd24ba9b75b0e23d58a3c8c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:19.950643 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7a6cc03f-452d-4aae-a29a-26f51b994c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '455eed9e2fd24ba9b75b0e23d58a3c8c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:19.957963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7a6cc03f-452d-4aae-a29a-26f51b994c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '455eed9e2fd24ba9b75b0e23d58a3c8c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:19.958692 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7a6cc03f-452d-4aae-a29a-26f51b994c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '455eed9e2fd24ba9b75b0e23d58a3c8c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:20.093839 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1210/2446] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:19 2022] DELETE /identity/v3/users/455eed9e2fd24ba9b75b0e23d58a3c8c => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:20.541802 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7b4c9-1bd4-4054-9607-a4c47f0d34f7 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:20.544549 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6ca7b4c9-1bd4-4054-9607-a4c47f0d34f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:20.566246 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7b4c9-1bd4-4054-9607-a4c47f0d34f7 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:20.631370 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c339457-5302-49b5-8c6c-aed1dccd8005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:20.632032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c339457-5302-49b5-8c6c-aed1dccd8005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:20.632413 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c339457-5302-49b5-8c6c-aed1dccd8005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:20.632643 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c339457-5302-49b5-8c6c-aed1dccd8005 admin admin] PATH_INFO: `/v3/projects/7df6da48a6814cca9cd1fff15b7a08ab` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:20.633956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c339457-5302-49b5-8c6c-aed1dccd8005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7df6da48a6814cca9cd1fff15b7a08ab)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:20.635908 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c339457-5302-49b5-8c6c-aed1dccd8005 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:20.803548 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7c339457-5302-49b5-8c6c-aed1dccd8005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7df6da48a6814cca9cd1fff15b7a08ab', 'request_id': 'req-7c339457-5302-49b5-8c6c-aed1dccd8005'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:20.883264 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7c339457-5302-49b5-8c6c-aed1dccd8005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7df6da48a6814cca9cd1fff15b7a08ab', 'request_id': 'req-7c339457-5302-49b5-8c6c-aed1dccd8005'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:20.890401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7c339457-5302-49b5-8c6c-aed1dccd8005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7df6da48a6814cca9cd1fff15b7a08ab', 'request_id': 'req-7c339457-5302-49b5-8c6c-aed1dccd8005'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:20.902056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7c339457-5302-49b5-8c6c-aed1dccd8005 admin admin] The token cache is being invalidate because project 7df6da48a6814cca9cd1fff15b7a08ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:15:20.902741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7c339457-5302-49b5-8c6c-aed1dccd8005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:20.903268 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7c339457-5302-49b5-8c6c-aed1dccd8005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:20.905067 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1237/2447] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:15:20 2022] DELETE /identity/v3/projects/7df6da48a6814cca9cd1fff15b7a08ab => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:20.910914 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e2040-b6e3-4d9f-99ed-6749bd1380d8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:20.911410 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e2040-b6e3-4d9f-99ed-6749bd1380d8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:20.911616 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e2040-b6e3-4d9f-99ed-6749bd1380d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:20.932460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ef9e2040-b6e3-4d9f-99ed-6749bd1380d8 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:20.933708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ef9e2040-b6e3-4d9f-99ed-6749bd1380d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:20.994394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1211/2448] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:21.002176 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5bf43-6d83-45f9-9a3c-4e0fbf72d710 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:21.002550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5bf43-6d83-45f9-9a3c-4e0fbf72d710 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:21.002838 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5bf43-6d83-45f9-9a3c-4e0fbf72d710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:21.022501 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-8bd5bf43-6d83-45f9-9a3c-4e0fbf72d710 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:21.024267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8bd5bf43-6d83-45f9-9a3c-4e0fbf72d710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:21.032425 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1238/2449] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:21.036762 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e2040-b6e3-4d9f-99ed-6749bd1380d8 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:21.047076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e2040-b6e3-4d9f-99ed-6749bd1380d8 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:21.051630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da13ceb-34e6-4c75-9607-8368dda7a71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:21.052244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da13ceb-34e6-4c75-9607-8368dda7a71d admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:21.052528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da13ceb-34e6-4c75-9607-8368dda7a71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:21.052840 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da13ceb-34e6-4c75-9607-8368dda7a71d admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:21.053546 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da13ceb-34e6-4c75-9607-8368dda7a71d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:15:21.053909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da13ceb-34e6-4c75-9607-8368dda7a71d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:21.055500 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da13ceb-34e6-4c75-9607-8368dda7a71d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:21.066959 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1212/2450] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:15:21.073072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5bf43-6d83-45f9-9a3c-4e0fbf72d710 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:21.082613 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5bf43-6d83-45f9-9a3c-4e0fbf72d710 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:21.088170 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeccfc0-860b-4cc2-9d6d-90ca1c41174c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:21.093415 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeccfc0-860b-4cc2-9d6d-90ca1c41174c admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:21.093415 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeccfc0-860b-4cc2-9d6d-90ca1c41174c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:21.093415 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeccfc0-860b-4cc2-9d6d-90ca1c41174c admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:21.093415 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeccfc0-860b-4cc2-9d6d-90ca1c41174c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:21.093415 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeccfc0-860b-4cc2-9d6d-90ca1c41174c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:21.187305 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1239/2451] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:21 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:15:21.191388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da13ceb-34e6-4c75-9607-8368dda7a71d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:21.201240 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da13ceb-34e6-4c75-9607-8368dda7a71d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:21.205836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:21.267082 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b36b7-4444-4ff9-8b72-37c1e2418b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:21.267724 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b36b7-4444-4ff9-8b72-37c1e2418b36 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:21.268003 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b36b7-4444-4ff9-8b72-37c1e2418b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:21.268275 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b36b7-4444-4ff9-8b72-37c1e2418b36 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:21.269000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b36b7-4444-4ff9-8b72-37c1e2418b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:21.272181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b36b7-4444-4ff9-8b72-37c1e2418b36 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:21.387607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1213/2452] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:21 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:21.391797 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeccfc0-860b-4cc2-9d6d-90ca1c41174c admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:21.402813 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeccfc0-860b-4cc2-9d6d-90ca1c41174c admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:21.407430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086da06e-d176-44d2-ba1a-979ab071f012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:21.408037 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086da06e-d176-44d2-ba1a-979ab071f012 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:21.408320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086da06e-d176-44d2-ba1a-979ab071f012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:21.408594 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086da06e-d176-44d2-ba1a-979ab071f012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:21.409322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086da06e-d176-44d2-ba1a-979ab071f012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:21.410947 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086da06e-d176-44d2-ba1a-979ab071f012 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:21.420813 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1240/2453] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:15:21.424554 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b36b7-4444-4ff9-8b72-37c1e2418b36 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:21.434638 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b36b7-4444-4ff9-8b72-37c1e2418b36 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:21.439222 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9e5d0-07d1-485e-b57b-6b4bdec60d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:21.439830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9e5d0-07d1-485e-b57b-6b4bdec60d88 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:21.440116 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9e5d0-07d1-485e-b57b-6b4bdec60d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:21.440396 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9e5d0-07d1-485e-b57b-6b4bdec60d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:21.441127 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9e5d0-07d1-485e-b57b-6b4bdec60d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:21.442753 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9e5d0-07d1-485e-b57b-6b4bdec60d88 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:21.453950 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1214/2454] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:21.457960 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086da06e-d176-44d2-ba1a-979ab071f012 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:21.464951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:21.468643 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086da06e-d176-44d2-ba1a-979ab071f012 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:21.473206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38ddec-b958-46d1-9ff2-af23ad2fe0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:21.477317 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38ddec-b958-46d1-9ff2-af23ad2fe0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:21.477317 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38ddec-b958-46d1-9ff2-af23ad2fe0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:21.477317 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38ddec-b958-46d1-9ff2-af23ad2fe0e7 admin admin] PATH_INFO: `/v3/projects/c4afbc0f2f894f9aba8962b91ffe0379/users/bd20e4b08a9b426696d8796a728c4a90/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:21.488715 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38ddec-b958-46d1-9ff2-af23ad2fe0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4afbc0f2f894f9aba8962b91ffe0379, user_id=bd20e4b08a9b426696d8796a728c4a90, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:21.491688 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38ddec-b958-46d1-9ff2-af23ad2fe0e7 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:21.587030 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1241/2455] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:21 2022] PUT /identity/v3/projects/c4afbc0f2f894f9aba8962b91ffe0379/users/bd20e4b08a9b426696d8796a728c4a90/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:21.653460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceecb7-ae19-49ec-be7f-fe20668bde66 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:21.653815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceecb7-ae19-49ec-be7f-fe20668bde66 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:21.654161 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceecb7-ae19-49ec-be7f-fe20668bde66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:21.681265 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9bceecb7-ae19-49ec-be7f-fe20668bde66 None None] MFA Rules not processed for user `bd20e4b08a9b426696d8796a728c4a90`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:21.682474 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9bceecb7-ae19-49ec-be7f-fe20668bde66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:21.748524 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1215/2456] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:15:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:21.753303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38ddec-b958-46d1-9ff2-af23ad2fe0e7 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:21.819371 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38ddec-b958-46d1-9ff2-af23ad2fe0e7 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:21.825061 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e0155-c32a-4341-aa17-71eaed3d1775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:21.825701 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e0155-c32a-4341-aa17-71eaed3d1775 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:21.825989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e0155-c32a-4341-aa17-71eaed3d1775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:21.826269 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e0155-c32a-4341-aa17-71eaed3d1775 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:21.826945 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e0155-c32a-4341-aa17-71eaed3d1775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:21.828899 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e0155-c32a-4341-aa17-71eaed3d1775 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:21.953372 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1242/2457] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:21 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:21.957628 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceecb7-ae19-49ec-be7f-fe20668bde66 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:21.968371 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceecb7-ae19-49ec-be7f-fe20668bde66 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:22.030768 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eaa7f5-018b-4007-9a33-13500e17bdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:22.031394 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaa7f5-018b-4007-9a33-13500e17bdfd admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:22.031680 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaa7f5-018b-4007-9a33-13500e17bdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:22.031960 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaa7f5-018b-4007-9a33-13500e17bdfd admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:22.032623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eaa7f5-018b-4007-9a33-13500e17bdfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:22.034612 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eaa7f5-018b-4007-9a33-13500e17bdfd admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:22.130495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1216/2458] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:21 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:22.134137 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e0155-c32a-4341-aa17-71eaed3d1775 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:22.144575 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e0155-c32a-4341-aa17-71eaed3d1775 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:22.149212 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6b17c-78da-4b9c-9ba1-5d385c2d19fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:22.149820 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6b17c-78da-4b9c-9ba1-5d385c2d19fc admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:22.151572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6b17c-78da-4b9c-9ba1-5d385c2d19fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:22.151572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6b17c-78da-4b9c-9ba1-5d385c2d19fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:22.151572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6b17c-78da-4b9c-9ba1-5d385c2d19fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:22.152712 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6b17c-78da-4b9c-9ba1-5d385c2d19fc admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:22.163318 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1243/2459] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:22.167891 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eaa7f5-018b-4007-9a33-13500e17bdfd admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:22.178470 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eaa7f5-018b-4007-9a33-13500e17bdfd admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:22.183985 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2bb65-3e3f-4628-9ba3-d5ccf826b78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:22.184602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2bb65-3e3f-4628-9ba3-d5ccf826b78b admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:22.184962 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2bb65-3e3f-4628-9ba3-d5ccf826b78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:22.185211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2bb65-3e3f-4628-9ba3-d5ccf826b78b admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:22.185910 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2bb65-3e3f-4628-9ba3-d5ccf826b78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:22.187509 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2bb65-3e3f-4628-9ba3-d5ccf826b78b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:22.189006 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:22.201507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1217/2460] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:22.206114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6b17c-78da-4b9c-9ba1-5d385c2d19fc admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:22.216930 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6b17c-78da-4b9c-9ba1-5d385c2d19fc admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:22.221573 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e71b1-2790-456b-922a-5db9c511282e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:22.222236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e71b1-2790-456b-922a-5db9c511282e admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:22.222517 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e71b1-2790-456b-922a-5db9c511282e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:22.222790 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e71b1-2790-456b-922a-5db9c511282e admin admin] PATH_INFO: `/v3/projects/0884e6564345455f8a35dbd4140165b6/users/dd64857bf1df4d3eb05adb7a2890a3ad/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:22.238929 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e71b1-2790-456b-922a-5db9c511282e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0884e6564345455f8a35dbd4140165b6, user_id=dd64857bf1df4d3eb05adb7a2890a3ad, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:22.243221 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e71b1-2790-456b-922a-5db9c511282e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:22.313236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1244/2461] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:22 2022] PUT /identity/v3/projects/0884e6564345455f8a35dbd4140165b6/users/dd64857bf1df4d3eb05adb7a2890a3ad/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:22.323768 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad05afc-6173-479a-86a4-2c9fb97b8ce9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:22.324144 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad05afc-6173-479a-86a4-2c9fb97b8ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:22.324327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad05afc-6173-479a-86a4-2c9fb97b8ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:22.355922 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-aad05afc-6173-479a-86a4-2c9fb97b8ce9 None None] MFA Rules not processed for user `dd64857bf1df4d3eb05adb7a2890a3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:22.357176 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-aad05afc-6173-479a-86a4-2c9fb97b8ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:22.434596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1218/2462] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:15:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:22.439188 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e71b1-2790-456b-922a-5db9c511282e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:22.521518 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e71b1-2790-456b-922a-5db9c511282e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:22.526773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0cc72-d41e-4ebc-8992-e046f7d32eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:22.527498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0cc72-d41e-4ebc-8992-e046f7d32eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:22.527801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0cc72-d41e-4ebc-8992-e046f7d32eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:22.528079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0cc72-d41e-4ebc-8992-e046f7d32eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:22.528823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0cc72-d41e-4ebc-8992-e046f7d32eb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:22.530768 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0cc72-d41e-4ebc-8992-e046f7d32eb3 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:22.653169 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1245/2463] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:22 2022] POST /identity/v3/projects => generated 377 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:22.657194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad05afc-6173-479a-86a4-2c9fb97b8ce9 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:22.668600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad05afc-6173-479a-86a4-2c9fb97b8ce9 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:22.727039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f8e67-6fab-4004-b982-84e892197d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:22.727688 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f8e67-6fab-4004-b982-84e892197d16 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:22.727976 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f8e67-6fab-4004-b982-84e892197d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:22.728255 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f8e67-6fab-4004-b982-84e892197d16 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:22.728966 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f8e67-6fab-4004-b982-84e892197d16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:22.730921 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f8e67-6fab-4004-b982-84e892197d16 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:22.832378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1219/2464] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:22 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:15:22.837045 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0cc72-d41e-4ebc-8992-e046f7d32eb3 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:22.847624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0cc72-d41e-4ebc-8992-e046f7d32eb3 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:22.852867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec6d9e-fbd9-4e59-8591-9a220515ed43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:22.853484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec6d9e-fbd9-4e59-8591-9a220515ed43 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:22.853772 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec6d9e-fbd9-4e59-8591-9a220515ed43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:22.854047 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec6d9e-fbd9-4e59-8591-9a220515ed43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:22.854749 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec6d9e-fbd9-4e59-8591-9a220515ed43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:22.856391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec6d9e-fbd9-4e59-8591-9a220515ed43 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:22.868562 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1246/2465] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:22.872770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f8e67-6fab-4004-b982-84e892197d16 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:22.883507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f8e67-6fab-4004-b982-84e892197d16 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:22.888085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb28cf0-282f-4f15-90d1-0e1f136fdbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:22.888746 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb28cf0-282f-4f15-90d1-0e1f136fdbc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:22.889056 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb28cf0-282f-4f15-90d1-0e1f136fdbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:22.889328 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb28cf0-282f-4f15-90d1-0e1f136fdbc6 admin admin] PATH_INFO: `/v3/projects/121a8ba8ff5c4cd38a2b9fb221c8c511/users/ad649eade1ed4a979d432536ec7d6423/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:22.905807 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb28cf0-282f-4f15-90d1-0e1f136fdbc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=121a8ba8ff5c4cd38a2b9fb221c8c511, user_id=ad649eade1ed4a979d432536ec7d6423, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:22.908605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb28cf0-282f-4f15-90d1-0e1f136fdbc6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:22.992843 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1220/2466] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:22 2022] PUT /identity/v3/projects/121a8ba8ff5c4cd38a2b9fb221c8c511/users/ad649eade1ed4a979d432536ec7d6423/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:22.996932 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec6d9e-fbd9-4e59-8591-9a220515ed43 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:23.008525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:23.008525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec6d9e-fbd9-4e59-8591-9a220515ed43 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:23.066386 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18661aae-f622-462c-afa5-23bbc8aa2055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:23.067061 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18661aae-f622-462c-afa5-23bbc8aa2055 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:23.067286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18661aae-f622-462c-afa5-23bbc8aa2055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:23.067558 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18661aae-f622-462c-afa5-23bbc8aa2055 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:23.068242 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18661aae-f622-462c-afa5-23bbc8aa2055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:23.070471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18661aae-f622-462c-afa5-23bbc8aa2055 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:23.094190 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1247/2467] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:15:23.095619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb28cf0-282f-4f15-90d1-0e1f136fdbc6 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:23.107653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb28cf0-282f-4f15-90d1-0e1f136fdbc6 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:23.112557 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c735bf-71af-4164-b618-9f4dc59b84b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:23.113258 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c735bf-71af-4164-b618-9f4dc59b84b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:23.113569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c735bf-71af-4164-b618-9f4dc59b84b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:23.113844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c735bf-71af-4164-b618-9f4dc59b84b1 admin admin] PATH_INFO: `/v3/projects/121a8ba8ff5c4cd38a2b9fb221c8c511/users/ad649eade1ed4a979d432536ec7d6423/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:23.116142 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c735bf-71af-4164-b618-9f4dc59b84b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=121a8ba8ff5c4cd38a2b9fb221c8c511, user_id=ad649eade1ed4a979d432536ec7d6423, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:23.118876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c735bf-71af-4164-b618-9f4dc59b84b1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:23.131537 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1221/2468] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:23 2022] PUT /identity/v3/projects/121a8ba8ff5c4cd38a2b9fb221c8c511/users/ad649eade1ed4a979d432536ec7d6423/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:23.144765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba432b-475d-4967-9fe0-2923492c8c47 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:23.145063 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba432b-475d-4967-9fe0-2923492c8c47 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:23.145343 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba432b-475d-4967-9fe0-2923492c8c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:23.179547 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c0ba432b-475d-4967-9fe0-2923492c8c47 None None] MFA Rules not processed for user `ad649eade1ed4a979d432536ec7d6423`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:23.181081 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c0ba432b-475d-4967-9fe0-2923492c8c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:23.272467 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1248/2469] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:15:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:23.284666 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c735bf-71af-4164-b618-9f4dc59b84b1 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:23.286520 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a9c735bf-71af-4164-b618-9f4dc59b84b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:23.332354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:23.352185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c735bf-71af-4164-b618-9f4dc59b84b1 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:23.356019 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78304f-5ba9-4fbc-baad-d0fba4f0e854 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:23.356640 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78304f-5ba9-4fbc-baad-d0fba4f0e854 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:23.356963 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78304f-5ba9-4fbc-baad-d0fba4f0e854 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:23.357242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78304f-5ba9-4fbc-baad-d0fba4f0e854 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:23.366451 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78304f-5ba9-4fbc-baad-d0fba4f0e854 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:23.368417 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78304f-5ba9-4fbc-baad-d0fba4f0e854 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:23.377745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1222/2470] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:23.478184 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba432b-475d-4967-9fe0-2923492c8c47 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:23.487769 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba432b-475d-4967-9fe0-2923492c8c47 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:23.492585 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c5905-8423-43b7-b3c7-4b9723693f77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:23.493222 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c5905-8423-43b7-b3c7-4b9723693f77 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:23.493507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c5905-8423-43b7-b3c7-4b9723693f77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:23.493784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c5905-8423-43b7-b3c7-4b9723693f77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:23.550309 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c5905-8423-43b7-b3c7-4b9723693f77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:23.551874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c5905-8423-43b7-b3c7-4b9723693f77 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:23.561466 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1249/2471] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:25.976693 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78304f-5ba9-4fbc-baad-d0fba4f0e854 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:25.978418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4a78304f-5ba9-4fbc-baad-d0fba4f0e854 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:26.040522 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78304f-5ba9-4fbc-baad-d0fba4f0e854 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:26.044320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409978f-e991-4dc9-a7ed-6c6330437192 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1837a832a0da4d698984ce62057b81f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:26.044973 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409978f-e991-4dc9-a7ed-6c6330437192 service glance] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:26.045290 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409978f-e991-4dc9-a7ed-6c6330437192 service glance] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:26.045579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409978f-e991-4dc9-a7ed-6c6330437192 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:26.047441 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4409978f-e991-4dc9-a7ed-6c6330437192 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:26.135799 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409978f-e991-4dc9-a7ed-6c6330437192 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:26.137209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409978f-e991-4dc9-a7ed-6c6330437192 service glance] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:26.158832 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1223/2472] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:26.384787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c5905-8423-43b7-b3c7-4b9723693f77 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:26.390655 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3f2c5905-8423-43b7-b3c7-4b9723693f77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:26.415244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:26.445685 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c5905-8423-43b7-b3c7-4b9723693f77 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:26.459187 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c063fe-1295-4c04-a7f9-41cf9dc37b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:26.460049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c063fe-1295-4c04-a7f9-41cf9dc37b16 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:26.460401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c063fe-1295-4c04-a7f9-41cf9dc37b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:26.460804 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c063fe-1295-4c04-a7f9-41cf9dc37b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:26.463778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e6c063fe-1295-4c04-a7f9-41cf9dc37b16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:26.473822 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c063fe-1295-4c04-a7f9-41cf9dc37b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:26.475398 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c063fe-1295-4c04-a7f9-41cf9dc37b16 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:26.484783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1250/2473] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:26.559770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409978f-e991-4dc9-a7ed-6c6330437192 service glance] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:26.571150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409978f-e991-4dc9-a7ed-6c6330437192 service glance] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:26.576951 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876905d8-42c5-4595-a6c2-3a63dadbf33b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:26.577724 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876905d8-42c5-4595-a6c2-3a63dadbf33b service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:26.578146 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876905d8-42c5-4595-a6c2-3a63dadbf33b service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:26.578478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876905d8-42c5-4595-a6c2-3a63dadbf33b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:26.580803 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-876905d8-42c5-4595-a6c2-3a63dadbf33b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:26.596305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876905d8-42c5-4595-a6c2-3a63dadbf33b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:26.597763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876905d8-42c5-4595-a6c2-3a63dadbf33b service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:26.610305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1224/2474] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:15:28.846683 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c063fe-1295-4c04-a7f9-41cf9dc37b16 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:28.925370 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c063fe-1295-4c04-a7f9-41cf9dc37b16 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:28.931679 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf039ac3-cf6c-405b-b18a-1cabc5d9c7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:28.932472 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf039ac3-cf6c-405b-b18a-1cabc5d9c7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:28.932769 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf039ac3-cf6c-405b-b18a-1cabc5d9c7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:28.933255 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf039ac3-cf6c-405b-b18a-1cabc5d9c7e0 admin admin] PATH_INFO: `/v3/users/bd20e4b08a9b426696d8796a728c4a90` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:28.935044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf039ac3-cf6c-405b-b18a-1cabc5d9c7e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd20e4b08a9b426696d8796a728c4a90)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:28.938026 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf039ac3-cf6c-405b-b18a-1cabc5d9c7e0 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:29.196691 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bf039ac3-cf6c-405b-b18a-1cabc5d9c7e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd20e4b08a9b426696d8796a728c4a90'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:29.278953 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bf039ac3-cf6c-405b-b18a-1cabc5d9c7e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd20e4b08a9b426696d8796a728c4a90'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:29.293290 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bf039ac3-cf6c-405b-b18a-1cabc5d9c7e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd20e4b08a9b426696d8796a728c4a90'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:29.306171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bf039ac3-cf6c-405b-b18a-1cabc5d9c7e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd20e4b08a9b426696d8796a728c4a90'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:29.307343 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bf039ac3-cf6c-405b-b18a-1cabc5d9c7e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd20e4b08a9b426696d8796a728c4a90'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:29.314493 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1251/2475] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:28 2022] DELETE /identity/v3/users/bd20e4b08a9b426696d8796a728c4a90 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:29.319250 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e834e1f-56a3-4f75-a1fc-bf22823d0804 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:29.319760 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e834e1f-56a3-4f75-a1fc-bf22823d0804 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:29.319926 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e834e1f-56a3-4f75-a1fc-bf22823d0804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:29.352127 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4e834e1f-56a3-4f75-a1fc-bf22823d0804 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:29.353523 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4e834e1f-56a3-4f75-a1fc-bf22823d0804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:29.398713 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980dc5-0e48-498f-897b-ecdce71ee1d4 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:29.398954 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980dc5-0e48-498f-897b-ecdce71ee1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:29.399237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980dc5-0e48-498f-897b-ecdce71ee1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:29.407423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:29.418584 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-a0980dc5-0e48-498f-897b-ecdce71ee1d4 None None] MFA Rules not processed for user `1cbbfdda843a4ab98ff9cf0742513f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:29.419891 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a0980dc5-0e48-498f-897b-ecdce71ee1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:29.423343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1225/2476] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:29.434688 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e834e1f-56a3-4f75-a1fc-bf22823d0804 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:29.436086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4e834e1f-56a3-4f75-a1fc-bf22823d0804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:29.466077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:29.480703 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1252/2477] 10.222.0.75 () {58 vars in 1009 bytes} [Thu Jul 28 18:15:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:15:29.496149 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0980dc5-0e48-498f-897b-ecdce71ee1d4 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:29.496149 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a0980dc5-0e48-498f-897b-ecdce71ee1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:29.501664 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e834e1f-56a3-4f75-a1fc-bf22823d0804 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:29.505618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f01f10-9c4a-478f-aee1-2ecbc585faa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:29.506346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f01f10-9c4a-478f-aee1-2ecbc585faa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:29.506636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f01f10-9c4a-478f-aee1-2ecbc585faa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:29.506918 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f01f10-9c4a-478f-aee1-2ecbc585faa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:29.518478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f01f10-9c4a-478f-aee1-2ecbc585faa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:29.520109 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f01f10-9c4a-478f-aee1-2ecbc585faa6 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:29.532276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1226/2478] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:29.575306 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0980dc5-0e48-498f-897b-ecdce71ee1d4 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:29.582077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80db662-64ef-4209-abd4-988e909f9c56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77b4fcb974d48a0bda4852c8d304511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:29.582743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80db662-64ef-4209-abd4-988e909f9c56 service swift] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:29.583377 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80db662-64ef-4209-abd4-988e909f9c56 service swift] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:29.583377 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80db662-64ef-4209-abd4-988e909f9c56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:29.592841 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80db662-64ef-4209-abd4-988e909f9c56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:29.594243 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80db662-64ef-4209-abd4-988e909f9c56 service swift] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:29.603812 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1253/2479] 10.222.0.75 () {60 vars in 1384 bytes} [Thu Jul 28 18:15:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 18:15:30.130809 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f01f10-9c4a-478f-aee1-2ecbc585faa6 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:30.132592 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-87f01f10-9c4a-478f-aee1-2ecbc585faa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:30.150877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f01f10-9c4a-478f-aee1-2ecbc585faa6 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:30.155686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536b37c-c19e-4f15-9364-f56e62e24e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:30.156338 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536b37c-c19e-4f15-9364-f56e62e24e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:30.156806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536b37c-c19e-4f15-9364-f56e62e24e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:30.157092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536b37c-c19e-4f15-9364-f56e62e24e7e admin admin] PATH_INFO: `/v3/projects/c4afbc0f2f894f9aba8962b91ffe0379` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:30.158287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536b37c-c19e-4f15-9364-f56e62e24e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4afbc0f2f894f9aba8962b91ffe0379)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:30.161224 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536b37c-c19e-4f15-9364-f56e62e24e7e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:30.294786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c536b37c-c19e-4f15-9364-f56e62e24e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4afbc0f2f894f9aba8962b91ffe0379', 'request_id': 'req-c536b37c-c19e-4f15-9364-f56e62e24e7e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:30.301767 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c536b37c-c19e-4f15-9364-f56e62e24e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4afbc0f2f894f9aba8962b91ffe0379', 'request_id': 'req-c536b37c-c19e-4f15-9364-f56e62e24e7e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:30.309352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c536b37c-c19e-4f15-9364-f56e62e24e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4afbc0f2f894f9aba8962b91ffe0379', 'request_id': 'req-c536b37c-c19e-4f15-9364-f56e62e24e7e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:30.385741 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c536b37c-c19e-4f15-9364-f56e62e24e7e admin admin] The token cache is being invalidate because project c4afbc0f2f894f9aba8962b91ffe0379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:15:30.386385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c536b37c-c19e-4f15-9364-f56e62e24e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:30.386702 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c536b37c-c19e-4f15-9364-f56e62e24e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:30.388535 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1227/2480] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:15:30 2022] DELETE /identity/v3/projects/c4afbc0f2f894f9aba8962b91ffe0379 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:30.392649 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80db662-64ef-4209-abd4-988e909f9c56 service swift] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:30.404556 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80db662-64ef-4209-abd4-988e909f9c56 service swift] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:30.492547 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4534331-9e3a-4234-9d84-403cadd894f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:30.493281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4534331-9e3a-4234-9d84-403cadd894f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:30.493582 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4534331-9e3a-4234-9d84-403cadd894f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:30.493815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4534331-9e3a-4234-9d84-403cadd894f1 admin admin] PATH_INFO: `/v3/users/dd64857bf1df4d3eb05adb7a2890a3ad` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:30.495017 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4534331-9e3a-4234-9d84-403cadd894f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd64857bf1df4d3eb05adb7a2890a3ad)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:30.497037 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4534331-9e3a-4234-9d84-403cadd894f1 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:30.670432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f4534331-9e3a-4234-9d84-403cadd894f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd64857bf1df4d3eb05adb7a2890a3ad'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:30.751663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f4534331-9e3a-4234-9d84-403cadd894f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd64857bf1df4d3eb05adb7a2890a3ad'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:30.767704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f4534331-9e3a-4234-9d84-403cadd894f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd64857bf1df4d3eb05adb7a2890a3ad'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:30.775732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f4534331-9e3a-4234-9d84-403cadd894f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd64857bf1df4d3eb05adb7a2890a3ad'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:30.776639 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f4534331-9e3a-4234-9d84-403cadd894f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd64857bf1df4d3eb05adb7a2890a3ad'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:30.781469 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:30.784151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1254/2481] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:30 2022] DELETE /identity/v3/users/dd64857bf1df4d3eb05adb7a2890a3ad => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:31.394873 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536b37c-c19e-4f15-9364-f56e62e24e7e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:31.396618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c536b37c-c19e-4f15-9364-f56e62e24e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:31.416432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536b37c-c19e-4f15-9364-f56e62e24e7e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:31.501528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396509e0-f959-4682-bce8-c9a1893736ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:31.502142 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396509e0-f959-4682-bce8-c9a1893736ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:31.502427 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396509e0-f959-4682-bce8-c9a1893736ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:31.502709 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396509e0-f959-4682-bce8-c9a1893736ea admin admin] PATH_INFO: `/v3/projects/0884e6564345455f8a35dbd4140165b6` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:31.503995 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396509e0-f959-4682-bce8-c9a1893736ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=0884e6564345455f8a35dbd4140165b6)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:31.506013 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396509e0-f959-4682-bce8-c9a1893736ea admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:31.524416 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:31.622197 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-396509e0-f959-4682-bce8-c9a1893736ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0884e6564345455f8a35dbd4140165b6', 'request_id': 'req-396509e0-f959-4682-bce8-c9a1893736ea'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:31.629613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-396509e0-f959-4682-bce8-c9a1893736ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0884e6564345455f8a35dbd4140165b6', 'request_id': 'req-396509e0-f959-4682-bce8-c9a1893736ea'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:31.637439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-396509e0-f959-4682-bce8-c9a1893736ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0884e6564345455f8a35dbd4140165b6', 'request_id': 'req-396509e0-f959-4682-bce8-c9a1893736ea'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:31.740968 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-396509e0-f959-4682-bce8-c9a1893736ea admin admin] The token cache is being invalidate because project 0884e6564345455f8a35dbd4140165b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:15:31.741261 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-396509e0-f959-4682-bce8-c9a1893736ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:31.741911 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-396509e0-f959-4682-bce8-c9a1893736ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:31.743800 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1228/2482] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:15:31 2022] DELETE /identity/v3/projects/0884e6564345455f8a35dbd4140165b6 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:31.747614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4534331-9e3a-4234-9d84-403cadd894f1 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:31.749069 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f4534331-9e3a-4234-9d84-403cadd894f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:31.761999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4534331-9e3a-4234-9d84-403cadd894f1 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:31.821391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228cf759-1328-481f-9a25-34432feae1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:31.822041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cf759-1328-481f-9a25-34432feae1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:31.822324 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cf759-1328-481f-9a25-34432feae1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:31.822599 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cf759-1328-481f-9a25-34432feae1a7 admin admin] PATH_INFO: `/v3/users/ad649eade1ed4a979d432536ec7d6423` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:31.823760 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228cf759-1328-481f-9a25-34432feae1a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad649eade1ed4a979d432536ec7d6423)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:31.825757 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228cf759-1328-481f-9a25-34432feae1a7 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:32.014116 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-228cf759-1328-481f-9a25-34432feae1a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad649eade1ed4a979d432536ec7d6423'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:32.066576 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-228cf759-1328-481f-9a25-34432feae1a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad649eade1ed4a979d432536ec7d6423'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:32.085272 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-228cf759-1328-481f-9a25-34432feae1a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad649eade1ed4a979d432536ec7d6423'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:32.097586 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-228cf759-1328-481f-9a25-34432feae1a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad649eade1ed4a979d432536ec7d6423'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:32.098333 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-228cf759-1328-481f-9a25-34432feae1a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad649eade1ed4a979d432536ec7d6423'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:32.104832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1255/2483] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:31 2022] DELETE /identity/v3/users/ad649eade1ed4a979d432536ec7d6423 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:32.524478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396509e0-f959-4682-bce8-c9a1893736ea admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:32.526036 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-396509e0-f959-4682-bce8-c9a1893736ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:32.544217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396509e0-f959-4682-bce8-c9a1893736ea admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:32.630686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68501866-fa9a-448b-9e84-6186464b9024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:32.631365 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68501866-fa9a-448b-9e84-6186464b9024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:32.631654 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68501866-fa9a-448b-9e84-6186464b9024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:32.632015 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68501866-fa9a-448b-9e84-6186464b9024 admin admin] PATH_INFO: `/v3/projects/121a8ba8ff5c4cd38a2b9fb221c8c511` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:32.633335 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68501866-fa9a-448b-9e84-6186464b9024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=121a8ba8ff5c4cd38a2b9fb221c8c511)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:32.635459 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68501866-fa9a-448b-9e84-6186464b9024 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:32.782449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-68501866-fa9a-448b-9e84-6186464b9024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '121a8ba8ff5c4cd38a2b9fb221c8c511', 'request_id': 'req-68501866-fa9a-448b-9e84-6186464b9024'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:32.788550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-68501866-fa9a-448b-9e84-6186464b9024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '121a8ba8ff5c4cd38a2b9fb221c8c511', 'request_id': 'req-68501866-fa9a-448b-9e84-6186464b9024'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:32.799153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-68501866-fa9a-448b-9e84-6186464b9024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '121a8ba8ff5c4cd38a2b9fb221c8c511', 'request_id': 'req-68501866-fa9a-448b-9e84-6186464b9024'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:32.873855 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-68501866-fa9a-448b-9e84-6186464b9024 admin admin] The token cache is being invalidate because project 121a8ba8ff5c4cd38a2b9fb221c8c511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:15:32.874282 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-68501866-fa9a-448b-9e84-6186464b9024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:32.875274 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-68501866-fa9a-448b-9e84-6186464b9024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:32.878004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1229/2484] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:15:32 2022] DELETE /identity/v3/projects/121a8ba8ff5c4cd38a2b9fb221c8c511 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:32.884184 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78a76b-de3a-4799-96b3-c39ad7b6f38a None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:32.884786 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78a76b-de3a-4799-96b3-c39ad7b6f38a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:32.884786 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78a76b-de3a-4799-96b3-c39ad7b6f38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:32.909558 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-fa78a76b-de3a-4799-96b3-c39ad7b6f38a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:32.910953 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fa78a76b-de3a-4799-96b3-c39ad7b6f38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:32.988645 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1256/2485] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:32.997464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fd963-5b46-4fa4-ba45-8514ea05d094 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:32.997752 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fd963-5b46-4fa4-ba45-8514ea05d094 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:32.998226 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fd963-5b46-4fa4-ba45-8514ea05d094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:33.027372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-726fd963-5b46-4fa4-ba45-8514ea05d094 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:33.028607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-726fd963-5b46-4fa4-ba45-8514ea05d094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:33.042852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1230/2486] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:33.046000 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78a76b-de3a-4799-96b3-c39ad7b6f38a None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:33.056684 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78a76b-de3a-4799-96b3-c39ad7b6f38a None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:33.061427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e30869-38ff-4db4-8bbc-a03e08b88884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:33.063051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e30869-38ff-4db4-8bbc-a03e08b88884 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:33.063346 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e30869-38ff-4db4-8bbc-a03e08b88884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:33.063630 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e30869-38ff-4db4-8bbc-a03e08b88884 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:33.064346 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e30869-38ff-4db4-8bbc-a03e08b88884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:15:33.064662 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e30869-38ff-4db4-8bbc-a03e08b88884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:33.066367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e30869-38ff-4db4-8bbc-a03e08b88884 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:33.088824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1257/2487] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:15:33.093863 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fd963-5b46-4fa4-ba45-8514ea05d094 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:33.104288 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fd963-5b46-4fa4-ba45-8514ea05d094 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:33.109805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bdd07-408d-43b4-bd38-aa9dd4ef05e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:33.111436 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bdd07-408d-43b4-bd38-aa9dd4ef05e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:33.111728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bdd07-408d-43b4-bd38-aa9dd4ef05e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:33.112016 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bdd07-408d-43b4-bd38-aa9dd4ef05e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:33.112701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bdd07-408d-43b4-bd38-aa9dd4ef05e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:33.114961 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bdd07-408d-43b4-bd38-aa9dd4ef05e2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:33.211988 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:33.225201 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1231/2488] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:33 2022] POST /identity/v3/projects => generated 391 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:33.231400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e30869-38ff-4db4-8bbc-a03e08b88884 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:33.253768 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e30869-38ff-4db4-8bbc-a03e08b88884 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:33.259879 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:33.354978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce6dcd-8d63-44c7-96ff-44fef6e7881f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:33.355613 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce6dcd-8d63-44c7-96ff-44fef6e7881f admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:33.355901 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce6dcd-8d63-44c7-96ff-44fef6e7881f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:33.356174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce6dcd-8d63-44c7-96ff-44fef6e7881f admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:33.356900 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce6dcd-8d63-44c7-96ff-44fef6e7881f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:33.358888 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce6dcd-8d63-44c7-96ff-44fef6e7881f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:33.454769 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1258/2489] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:33 2022] POST /identity/v3/users => generated 296 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:15:33.458919 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bdd07-408d-43b4-bd38-aa9dd4ef05e2 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:33.478938 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bdd07-408d-43b4-bd38-aa9dd4ef05e2 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:33.483912 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e2e15-c628-4df8-8884-e9c27ad4833b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:33.484551 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e2e15-c628-4df8-8884-e9c27ad4833b admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:33.484955 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e2e15-c628-4df8-8884-e9c27ad4833b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:33.485302 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e2e15-c628-4df8-8884-e9c27ad4833b admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:33.486045 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e2e15-c628-4df8-8884-e9c27ad4833b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:33.487713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e2e15-c628-4df8-8884-e9c27ad4833b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:33.499439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1232/2490] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:33.503463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce6dcd-8d63-44c7-96ff-44fef6e7881f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:33.514653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce6dcd-8d63-44c7-96ff-44fef6e7881f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:33.519499 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae8ffa-98d7-4247-a1a9-42d4c2d79017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:33.520139 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae8ffa-98d7-4247-a1a9-42d4c2d79017 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:33.520426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae8ffa-98d7-4247-a1a9-42d4c2d79017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:33.520784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae8ffa-98d7-4247-a1a9-42d4c2d79017 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:33.521515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae8ffa-98d7-4247-a1a9-42d4c2d79017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:33.523139 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae8ffa-98d7-4247-a1a9-42d4c2d79017 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:33.536303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1259/2491] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:33.540479 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e2e15-c628-4df8-8884-e9c27ad4833b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:33.551325 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e2e15-c628-4df8-8884-e9c27ad4833b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:33.556929 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6520a42-6f1d-43b0-91f9-a1d0a3139577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:33.558067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6520a42-6f1d-43b0-91f9-a1d0a3139577 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:33.558556 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6520a42-6f1d-43b0-91f9-a1d0a3139577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:33.558835 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6520a42-6f1d-43b0-91f9-a1d0a3139577 admin admin] PATH_INFO: `/v3/projects/52b575abbd894b1a841b84a7bd2d4cbe/users/8f72fa98279144aa957911e99982ac08/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:33.576214 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6520a42-6f1d-43b0-91f9-a1d0a3139577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b575abbd894b1a841b84a7bd2d4cbe, user_id=8f72fa98279144aa957911e99982ac08, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:33.578966 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6520a42-6f1d-43b0-91f9-a1d0a3139577 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:33.677888 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1233/2492] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:33 2022] PUT /identity/v3/projects/52b575abbd894b1a841b84a7bd2d4cbe/users/8f72fa98279144aa957911e99982ac08/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:33.689317 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1397b0b-e5ef-450d-ac90-2a0459d94b1c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:33.689607 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1397b0b-e5ef-450d-ac90-2a0459d94b1c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:33.689884 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1397b0b-e5ef-450d-ac90-2a0459d94b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:33.719041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d1397b0b-e5ef-450d-ac90-2a0459d94b1c None None] MFA Rules not processed for user `8f72fa98279144aa957911e99982ac08`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:33.720256 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d1397b0b-e5ef-450d-ac90-2a0459d94b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:33.787160 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1260/2493] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:15:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:33.798378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6520a42-6f1d-43b0-91f9-a1d0a3139577 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:33.800151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f6520a42-6f1d-43b0-91f9-a1d0a3139577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:33.859548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6520a42-6f1d-43b0-91f9-a1d0a3139577 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:33.863286 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf55ae-be15-4a48-b143-c1a8f4d71067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:33.863832 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf55ae-be15-4a48-b143-c1a8f4d71067 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:33.864114 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf55ae-be15-4a48-b143-c1a8f4d71067 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:33.864665 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf55ae-be15-4a48-b143-c1a8f4d71067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:33.875927 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf55ae-be15-4a48-b143-c1a8f4d71067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:33.877420 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf55ae-be15-4a48-b143-c1a8f4d71067 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:33.887543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1234/2494] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:43.784269 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:43.882487 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:51.816938 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1397b0b-e5ef-450d-ac90-2a0459d94b1c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:51.880015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1397b0b-e5ef-450d-ac90-2a0459d94b1c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:51.884477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6a2e1-6ebe-4e65-ad34-8bebfe2bbd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:51.885161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6a2e1-6ebe-4e65-ad34-8bebfe2bbd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:51.885447 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6a2e1-6ebe-4e65-ad34-8bebfe2bbd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:51.885759 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6a2e1-6ebe-4e65-ad34-8bebfe2bbd40 admin admin] PATH_INFO: `/v3/users/8f72fa98279144aa957911e99982ac08` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:51.887011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6a2e1-6ebe-4e65-ad34-8bebfe2bbd40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f72fa98279144aa957911e99982ac08)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:51.889152 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6a2e1-6ebe-4e65-ad34-8bebfe2bbd40 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:52.095348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-06c6a2e1-6ebe-4e65-ad34-8bebfe2bbd40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f72fa98279144aa957911e99982ac08'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:52.179690 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-06c6a2e1-6ebe-4e65-ad34-8bebfe2bbd40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f72fa98279144aa957911e99982ac08'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:52.192516 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-06c6a2e1-6ebe-4e65-ad34-8bebfe2bbd40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f72fa98279144aa957911e99982ac08'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:52.199257 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-06c6a2e1-6ebe-4e65-ad34-8bebfe2bbd40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f72fa98279144aa957911e99982ac08'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:52.199922 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-06c6a2e1-6ebe-4e65-ad34-8bebfe2bbd40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f72fa98279144aa957911e99982ac08'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:52.206471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1261/2495] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:51 2022] DELETE /identity/v3/users/8f72fa98279144aa957911e99982ac08 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:52.210733 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7c29f-0ba8-49a0-b21a-be7316185d7b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:52.211262 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7c29f-0ba8-49a0-b21a-be7316185d7b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:52.211262 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7c29f-0ba8-49a0-b21a-be7316185d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:52.230674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-edd7c29f-0ba8-49a0-b21a-be7316185d7b None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:52.232360 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-edd7c29f-0ba8-49a0-b21a-be7316185d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:52.292405 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1235/2496] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:52.306587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6a2e1-6ebe-4e65-ad34-8bebfe2bbd40 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:52.308004 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-06c6a2e1-6ebe-4e65-ad34-8bebfe2bbd40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:52.387749 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6a2e1-6ebe-4e65-ad34-8bebfe2bbd40 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:52.391528 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b2727-2929-4a84-b775-8a509dcfb151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:52.392091 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b2727-2929-4a84-b775-8a509dcfb151 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:52.392379 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b2727-2929-4a84-b775-8a509dcfb151 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:52.392657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b2727-2929-4a84-b775-8a509dcfb151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:52.403238 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b2727-2929-4a84-b775-8a509dcfb151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:52.405487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b2727-2929-4a84-b775-8a509dcfb151 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:52.414914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1262/2497] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:52.821618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7c29f-0ba8-49a0-b21a-be7316185d7b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:52.824384 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-edd7c29f-0ba8-49a0-b21a-be7316185d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:52.837413 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7c29f-0ba8-49a0-b21a-be7316185d7b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:52.842857 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71be5ac-ec57-4971-b8d7-9cc21720a892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:52.844096 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71be5ac-ec57-4971-b8d7-9cc21720a892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:52.844559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71be5ac-ec57-4971-b8d7-9cc21720a892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:52.844871 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71be5ac-ec57-4971-b8d7-9cc21720a892 admin admin] PATH_INFO: `/v3/projects/52b575abbd894b1a841b84a7bd2d4cbe` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:52.846077 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71be5ac-ec57-4971-b8d7-9cc21720a892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b575abbd894b1a841b84a7bd2d4cbe)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:52.847976 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71be5ac-ec57-4971-b8d7-9cc21720a892 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:52.962433 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c71be5ac-ec57-4971-b8d7-9cc21720a892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b575abbd894b1a841b84a7bd2d4cbe', 'request_id': 'req-c71be5ac-ec57-4971-b8d7-9cc21720a892'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:52.968708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c71be5ac-ec57-4971-b8d7-9cc21720a892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b575abbd894b1a841b84a7bd2d4cbe', 'request_id': 'req-c71be5ac-ec57-4971-b8d7-9cc21720a892'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:52.975188 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c71be5ac-ec57-4971-b8d7-9cc21720a892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b575abbd894b1a841b84a7bd2d4cbe', 'request_id': 'req-c71be5ac-ec57-4971-b8d7-9cc21720a892'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:53.054015 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c71be5ac-ec57-4971-b8d7-9cc21720a892 admin admin] The token cache is being invalidate because project 52b575abbd894b1a841b84a7bd2d4cbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:15:53.054304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c71be5ac-ec57-4971-b8d7-9cc21720a892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:53.054947 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c71be5ac-ec57-4971-b8d7-9cc21720a892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:53.056515 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1236/2498] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:15:52 2022] DELETE /identity/v3/projects/52b575abbd894b1a841b84a7bd2d4cbe => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:53.062211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e35ec-d814-403e-b2eb-be103b06d552 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:53.062659 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e35ec-d814-403e-b2eb-be103b06d552 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:53.068285 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e35ec-d814-403e-b2eb-be103b06d552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:53.084055 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b73e35ec-d814-403e-b2eb-be103b06d552 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:53.085344 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b73e35ec-d814-403e-b2eb-be103b06d552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:53.102123 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:53.145604 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1263/2499] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:53.153205 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adddc3-6b8b-4097-acd7-6f24eefb882a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:53.153555 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adddc3-6b8b-4097-acd7-6f24eefb882a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:53.154397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adddc3-6b8b-4097-acd7-6f24eefb882a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:53.173981 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-85adddc3-6b8b-4097-acd7-6f24eefb882a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:53.175229 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-85adddc3-6b8b-4097-acd7-6f24eefb882a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:53.188133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1237/2500] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:53.193720 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e35ec-d814-403e-b2eb-be103b06d552 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:53.204616 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e35ec-d814-403e-b2eb-be103b06d552 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:53.209312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c4b9a-d486-499b-88a9-42fe0cb49dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:53.209937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c4b9a-d486-499b-88a9-42fe0cb49dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:53.210339 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c4b9a-d486-499b-88a9-42fe0cb49dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:53.210735 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c4b9a-d486-499b-88a9-42fe0cb49dc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:53.211440 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c4b9a-d486-499b-88a9-42fe0cb49dc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:15:53.211752 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c4b9a-d486-499b-88a9-42fe0cb49dc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:53.213468 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c4b9a-d486-499b-88a9-42fe0cb49dc7 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:53.232109 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1264/2501] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:15:53.236565 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adddc3-6b8b-4097-acd7-6f24eefb882a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:53.246523 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adddc3-6b8b-4097-acd7-6f24eefb882a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:53.251784 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825978aa-5719-4098-94b7-e1019c5ca7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:53.252400 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825978aa-5719-4098-94b7-e1019c5ca7f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:53.252687 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825978aa-5719-4098-94b7-e1019c5ca7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:53.252997 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825978aa-5719-4098-94b7-e1019c5ca7f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:53.253671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825978aa-5719-4098-94b7-e1019c5ca7f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:53.255574 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825978aa-5719-4098-94b7-e1019c5ca7f0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:53.349281 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1238/2502] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:53 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:53.352214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c4b9a-d486-499b-88a9-42fe0cb49dc7 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:53.362773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c4b9a-d486-499b-88a9-42fe0cb49dc7 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:53.419631 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54907b-15f8-42dd-b4b1-9b2cd8eac4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:53.421839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54907b-15f8-42dd-b4b1-9b2cd8eac4cf admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:53.421839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54907b-15f8-42dd-b4b1-9b2cd8eac4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:53.421839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54907b-15f8-42dd-b4b1-9b2cd8eac4cf admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:53.422711 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54907b-15f8-42dd-b4b1-9b2cd8eac4cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:53.423998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54907b-15f8-42dd-b4b1-9b2cd8eac4cf admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:53.517633 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1265/2503] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:53 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:53.521824 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825978aa-5719-4098-94b7-e1019c5ca7f0 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:53.532000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825978aa-5719-4098-94b7-e1019c5ca7f0 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:53.536692 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b05a20-4938-4956-8783-aca0913f1b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:53.537337 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b05a20-4938-4956-8783-aca0913f1b34 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:53.537624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b05a20-4938-4956-8783-aca0913f1b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:53.537900 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b05a20-4938-4956-8783-aca0913f1b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:53.538604 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b05a20-4938-4956-8783-aca0913f1b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:53.540204 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b05a20-4938-4956-8783-aca0913f1b34 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:53.550751 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1239/2504] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:53.555164 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54907b-15f8-42dd-b4b1-9b2cd8eac4cf admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:53.565539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54907b-15f8-42dd-b4b1-9b2cd8eac4cf admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:53.570271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe353e-168d-49ec-a6e9-a466924d7c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:53.570897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe353e-168d-49ec-a6e9-a466924d7c2b admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:53.571183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe353e-168d-49ec-a6e9-a466924d7c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:53.571463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe353e-168d-49ec-a6e9-a466924d7c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:53.572166 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe353e-168d-49ec-a6e9-a466924d7c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:53.573824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe353e-168d-49ec-a6e9-a466924d7c2b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:53.584784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1266/2505] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:53.589016 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b05a20-4938-4956-8783-aca0913f1b34 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:53.600041 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b05a20-4938-4956-8783-aca0913f1b34 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:53.604550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8040c-0ab9-40ed-8ba2-d37d1497da64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:53.605216 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8040c-0ab9-40ed-8ba2-d37d1497da64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:53.605527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8040c-0ab9-40ed-8ba2-d37d1497da64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:53.605804 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8040c-0ab9-40ed-8ba2-d37d1497da64 admin admin] PATH_INFO: `/v3/projects/61d7df64d6bb4e4f9297417643789ad3/users/ab1b2e30663a474b979a0f95bf8dd2ec/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:53.621781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8040c-0ab9-40ed-8ba2-d37d1497da64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d7df64d6bb4e4f9297417643789ad3, user_id=ab1b2e30663a474b979a0f95bf8dd2ec, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:53.625209 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8040c-0ab9-40ed-8ba2-d37d1497da64 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:53.734756 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1240/2506] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:53 2022] PUT /identity/v3/projects/61d7df64d6bb4e4f9297417643789ad3/users/ab1b2e30663a474b979a0f95bf8dd2ec/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:53.740119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb0b7b-f699-4a15-86e2-6eab8eb3c48b None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:53.740414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb0b7b-f699-4a15-86e2-6eab8eb3c48b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:53.740703 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb0b7b-f699-4a15-86e2-6eab8eb3c48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:53.760109 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-70eb0b7b-f699-4a15-86e2-6eab8eb3c48b None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:53.761369 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-70eb0b7b-f699-4a15-86e2-6eab8eb3c48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:53.819022 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1267/2507] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:53.829619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8040c-0ab9-40ed-8ba2-d37d1497da64 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:53.831536 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d4e8040c-0ab9-40ed-8ba2-d37d1497da64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:53.854434 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:53.890124 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8040c-0ab9-40ed-8ba2-d37d1497da64 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:53.893870 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa2776-aaa5-4cbc-ad19-1b16c1053717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:53.894498 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa2776-aaa5-4cbc-ad19-1b16c1053717 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:53.894790 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa2776-aaa5-4cbc-ad19-1b16c1053717 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:53.895038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa2776-aaa5-4cbc-ad19-1b16c1053717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:53.904957 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa2776-aaa5-4cbc-ad19-1b16c1053717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:53.906848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa2776-aaa5-4cbc-ad19-1b16c1053717 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:53.916647 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1241/2508] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:53.995879 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f2c8b-adaf-4f5c-92b0-0b6f26f137dd None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:53.996174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f2c8b-adaf-4f5c-92b0-0b6f26f137dd None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:53.996453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f2c8b-adaf-4f5c-92b0-0b6f26f137dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:54.040768 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:54.049707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-934f2c8b-adaf-4f5c-92b0-0b6f26f137dd None None] MFA Rules not processed for user `1cbbfdda843a4ab98ff9cf0742513f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:54.051016 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-934f2c8b-adaf-4f5c-92b0-0b6f26f137dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:54.119168 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1268/2509] 10.222.0.75 () {58 vars in 967 bytes} [Thu Jul 28 18:15:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:54.131974 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa2776-aaa5-4cbc-ad19-1b16c1053717 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:54.133461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-52aa2776-aaa5-4cbc-ad19-1b16c1053717 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:54.227570 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa2776-aaa5-4cbc-ad19-1b16c1053717 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:54.234330 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5964f6d-0b1e-42b5-aba1-9d12d6bf43b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77b4fcb974d48a0bda4852c8d304511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:54.234330 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5964f6d-0b1e-42b5-aba1-9d12d6bf43b3 service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:54.234615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5964f6d-0b1e-42b5-aba1-9d12d6bf43b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:54.235023 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5964f6d-0b1e-42b5-aba1-9d12d6bf43b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:54.245523 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5964f6d-0b1e-42b5-aba1-9d12d6bf43b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:54.247304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5964f6d-0b1e-42b5-aba1-9d12d6bf43b3 service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:54.266892 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1242/2510] 10.222.0.75 () {60 vars in 1384 bytes} [Thu Jul 28 18:15:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:15:57.196537 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f2c8b-adaf-4f5c-92b0-0b6f26f137dd None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:57.207120 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f2c8b-adaf-4f5c-92b0-0b6f26f137dd None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:57.210799 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf3611-6add-400b-9e13-5e5c05174f6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:57.211632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf3611-6add-400b-9e13-5e5c05174f6c service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:57.211937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf3611-6add-400b-9e13-5e5c05174f6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:57.212209 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf3611-6add-400b-9e13-5e5c05174f6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:57.213989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8adf3611-6add-400b-9e13-5e5c05174f6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:57.301163 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf3611-6add-400b-9e13-5e5c05174f6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:57.303008 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf3611-6add-400b-9e13-5e5c05174f6c service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:57.321820 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1269/2511] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:00.202328 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc133a-4287-4e54-a0a4-65b133a7b76c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:00.203279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc133a-4287-4e54-a0a4-65b133a7b76c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:00.203541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc133a-4287-4e54-a0a4-65b133a7b76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:00.238253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f4fc133a-4287-4e54-a0a4-65b133a7b76c None None] MFA Rules not processed for user `ab1b2e30663a474b979a0f95bf8dd2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:00.239795 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f4fc133a-4287-4e54-a0a4-65b133a7b76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:00.327811 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1243/2512] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:16:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:00.327921 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf3611-6add-400b-9e13-5e5c05174f6c service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:00.350240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf3611-6add-400b-9e13-5e5c05174f6c service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:00.355206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b260e56-387b-4b2e-9bd3-6cc538a4ce51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:00.356153 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b260e56-387b-4b2e-9bd3-6cc538a4ce51 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:00.356894 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b260e56-387b-4b2e-9bd3-6cc538a4ce51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:00.356894 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b260e56-387b-4b2e-9bd3-6cc538a4ce51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:00.357694 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b260e56-387b-4b2e-9bd3-6cc538a4ce51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:00.359732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b260e56-387b-4b2e-9bd3-6cc538a4ce51 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:00.488003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1270/2513] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:00 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:00.489515 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc133a-4287-4e54-a0a4-65b133a7b76c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:00.500790 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc133a-4287-4e54-a0a4-65b133a7b76c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:00.519992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:00.562001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e758b0-3471-4e8d-ba0e-8418dbcd1c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:00.562636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e758b0-3471-4e8d-ba0e-8418dbcd1c22 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:00.562925 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e758b0-3471-4e8d-ba0e-8418dbcd1c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:00.563202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e758b0-3471-4e8d-ba0e-8418dbcd1c22 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:00.563873 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e758b0-3471-4e8d-ba0e-8418dbcd1c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:00.565974 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e758b0-3471-4e8d-ba0e-8418dbcd1c22 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:00.694166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1244/2514] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:00 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:00.698105 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b260e56-387b-4b2e-9bd3-6cc538a4ce51 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:00.710156 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b260e56-387b-4b2e-9bd3-6cc538a4ce51 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:00.715464 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c084c4d-6111-4a7c-8290-82c3ea8c9cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:00.716220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c084c4d-6111-4a7c-8290-82c3ea8c9cfc admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:00.716507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c084c4d-6111-4a7c-8290-82c3ea8c9cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:00.716856 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c084c4d-6111-4a7c-8290-82c3ea8c9cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:00.717655 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c084c4d-6111-4a7c-8290-82c3ea8c9cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:00.719308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c084c4d-6111-4a7c-8290-82c3ea8c9cfc admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:00.731260 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1271/2515] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:16:00.735421 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e758b0-3471-4e8d-ba0e-8418dbcd1c22 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:00.746550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e758b0-3471-4e8d-ba0e-8418dbcd1c22 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:00.751958 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e007c4-72c9-43f4-b81a-4c28500a9a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:00.752640 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e007c4-72c9-43f4-b81a-4c28500a9a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:00.752957 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e007c4-72c9-43f4-b81a-4c28500a9a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:00.753232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e007c4-72c9-43f4-b81a-4c28500a9a6b admin admin] PATH_INFO: `/v3/projects/6cf8a0a8ef36418cb5a637e437641855/users/18ffd16bc989457e9a5d4db51b5ac0f2/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:00.770461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e007c4-72c9-43f4-b81a-4c28500a9a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf8a0a8ef36418cb5a637e437641855, user_id=18ffd16bc989457e9a5d4db51b5ac0f2, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:00.773216 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e007c4-72c9-43f4-b81a-4c28500a9a6b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:00.838097 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1245/2516] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:00 2022] PUT /identity/v3/projects/6cf8a0a8ef36418cb5a637e437641855/users/18ffd16bc989457e9a5d4db51b5ac0f2/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:00.842359 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c084c4d-6111-4a7c-8290-82c3ea8c9cfc admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:00.852650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c084c4d-6111-4a7c-8290-82c3ea8c9cfc admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:00.904930 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:00.919066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f359b-c59c-43d1-82cf-df78ce45eb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:00.919066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f359b-c59c-43d1-82cf-df78ce45eb71 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:00.919066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f359b-c59c-43d1-82cf-df78ce45eb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:00.919066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f359b-c59c-43d1-82cf-df78ce45eb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:00.919574 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f359b-c59c-43d1-82cf-df78ce45eb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:00.919574 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f359b-c59c-43d1-82cf-df78ce45eb71 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:00.932516 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1272/2517] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:00.937152 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e007c4-72c9-43f4-b81a-4c28500a9a6b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:00.949742 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e007c4-72c9-43f4-b81a-4c28500a9a6b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:00.955372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac67b24-e713-4565-9a23-9c6aacc5b926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:00.956139 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac67b24-e713-4565-9a23-9c6aacc5b926 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:00.956496 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac67b24-e713-4565-9a23-9c6aacc5b926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:00.956882 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac67b24-e713-4565-9a23-9c6aacc5b926 admin admin] PATH_INFO: `/v3/projects/6cf8a0a8ef36418cb5a637e437641855/users/18ffd16bc989457e9a5d4db51b5ac0f2/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:00.958986 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac67b24-e713-4565-9a23-9c6aacc5b926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf8a0a8ef36418cb5a637e437641855, user_id=18ffd16bc989457e9a5d4db51b5ac0f2, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:00.961752 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac67b24-e713-4565-9a23-9c6aacc5b926 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:00.972347 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1246/2518] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:00 2022] PUT /identity/v3/projects/6cf8a0a8ef36418cb5a637e437641855/users/18ffd16bc989457e9a5d4db51b5ac0f2/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:01.038838 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f359b-c59c-43d1-82cf-df78ce45eb71 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:01.040546 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d26f359b-c59c-43d1-82cf-df78ce45eb71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:01.111574 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f359b-c59c-43d1-82cf-df78ce45eb71 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:01.180055 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125ecab-d437-42cc-9b40-c6a1d310ea98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:01.180692 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125ecab-d437-42cc-9b40-c6a1d310ea98 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:01.181053 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125ecab-d437-42cc-9b40-c6a1d310ea98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:01.181469 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125ecab-d437-42cc-9b40-c6a1d310ea98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:01.183491 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0125ecab-d437-42cc-9b40-c6a1d310ea98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:01.263745 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125ecab-d437-42cc-9b40-c6a1d310ea98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:01.276658 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125ecab-d437-42cc-9b40-c6a1d310ea98 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:01.276976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1273/2519] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:16:06.688645 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355682d-b611-4c9e-ac11-eb6b98b2d095 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:06.689198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355682d-b611-4c9e-ac11-eb6b98b2d095 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:06.689294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355682d-b611-4c9e-ac11-eb6b98b2d095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:06.721554 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b355682d-b611-4c9e-ac11-eb6b98b2d095 None None] MFA Rules not processed for user `18ffd16bc989457e9a5d4db51b5ac0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:06.722788 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b355682d-b611-4c9e-ac11-eb6b98b2d095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:06.797089 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1247/2520] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:16:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:06.809947 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125ecab-d437-42cc-9b40-c6a1d310ea98 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:06.812040 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0125ecab-d437-42cc-9b40-c6a1d310ea98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:06.866321 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:06.871823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125ecab-d437-42cc-9b40-c6a1d310ea98 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:06.876322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a682b8-ef57-48dd-9349-9c2f4bcd5a43 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1837a832a0da4d698984ce62057b81f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:06.876990 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a682b8-ef57-48dd-9349-9c2f4bcd5a43 service glance] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:06.877281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a682b8-ef57-48dd-9349-9c2f4bcd5a43 service glance] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:06.883098 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a682b8-ef57-48dd-9349-9c2f4bcd5a43 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:06.938215 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a682b8-ef57-48dd-9349-9c2f4bcd5a43 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:06.939676 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a682b8-ef57-48dd-9349-9c2f4bcd5a43 service glance] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:06.949301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1274/2521] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:07.184364 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc02d-eefb-46fb-8a07-65c49a17b3c9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:07.184690 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc02d-eefb-46fb-8a07-65c49a17b3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:07.184996 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc02d-eefb-46fb-8a07-65c49a17b3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:07.211602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d5dcc02d-eefb-46fb-8a07-65c49a17b3c9 None None] MFA Rules not processed for user `1cbbfdda843a4ab98ff9cf0742513f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:07.213030 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d5dcc02d-eefb-46fb-8a07-65c49a17b3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:07.281488 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1248/2522] 10.222.0.75 () {58 vars in 1009 bytes} [Thu Jul 28 18:16:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:07.302504 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a682b8-ef57-48dd-9349-9c2f4bcd5a43 service glance] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:07.390077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a682b8-ef57-48dd-9349-9c2f4bcd5a43 service glance] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:07.395953 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9ce5f-32d8-4992-98d7-5764e490c9c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77b4fcb974d48a0bda4852c8d304511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:07.396705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9ce5f-32d8-4992-98d7-5764e490c9c9 service swift] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:07.396915 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9ce5f-32d8-4992-98d7-5764e490c9c9 service swift] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:07.397194 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9ce5f-32d8-4992-98d7-5764e490c9c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:07.409039 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9ce5f-32d8-4992-98d7-5764e490c9c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:07.410685 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9ce5f-32d8-4992-98d7-5764e490c9c9 service swift] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:07.420583 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1275/2523] 10.222.0.75 () {60 vars in 1384 bytes} [Thu Jul 28 18:16:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:16:16.268326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcc02d-eefb-46fb-8a07-65c49a17b3c9 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:16.273607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:16.363149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcc02d-eefb-46fb-8a07-65c49a17b3c9 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:16.367235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b1d4d-3a55-4025-a2f6-edfc45392804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:16.367888 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b1d4d-3a55-4025-a2f6-edfc45392804 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:16.368163 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b1d4d-3a55-4025-a2f6-edfc45392804 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:16.368435 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b1d4d-3a55-4025-a2f6-edfc45392804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:16.370279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9d0b1d4d-3a55-4025-a2f6-edfc45392804 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:16.447274 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b1d4d-3a55-4025-a2f6-edfc45392804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:16.448742 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b1d4d-3a55-4025-a2f6-edfc45392804 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:16.459327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1249/2524] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:17.416243 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=59 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:19.075694 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dbc07-2a8f-4112-8b8b-7ffe0fb6c2fc None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:19.076362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dbc07-2a8f-4112-8b8b-7ffe0fb6c2fc None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:19.076362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dbc07-2a8f-4112-8b8b-7ffe0fb6c2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:19.097885 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-fd6dbc07-2a8f-4112-8b8b-7ffe0fb6c2fc None None] MFA Rules not processed for user `ab1b2e30663a474b979a0f95bf8dd2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:19.099168 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fd6dbc07-2a8f-4112-8b8b-7ffe0fb6c2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:19.106879 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1276/2525] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:16:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:19.408254 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b1d4d-3a55-4025-a2f6-edfc45392804 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:19.415317 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b1d4d-3a55-4025-a2f6-edfc45392804 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:19.418958 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94489436-96d1-461d-90fd-e904ffb08e53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:19.420044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94489436-96d1-461d-90fd-e904ffb08e53 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:19.420507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94489436-96d1-461d-90fd-e904ffb08e53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:19.420930 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94489436-96d1-461d-90fd-e904ffb08e53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:19.422875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-94489436-96d1-461d-90fd-e904ffb08e53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:19.434708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94489436-96d1-461d-90fd-e904ffb08e53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:19.437028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94489436-96d1-461d-90fd-e904ffb08e53 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:19.446918 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1250/2526] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:19.891867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dbc07-2a8f-4112-8b8b-7ffe0fb6c2fc None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:19.894767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fd6dbc07-2a8f-4112-8b8b-7ffe0fb6c2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:19.972354 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dbc07-2a8f-4112-8b8b-7ffe0fb6c2fc None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:19.977653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83838d7-4809-46bc-b1b3-83169ac9cea4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff43a72eaef462f86426ad3ceccd3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:19.987782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83838d7-4809-46bc-b1b3-83169ac9cea4 service placement] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:19.987782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83838d7-4809-46bc-b1b3-83169ac9cea4 service placement] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:19.987782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83838d7-4809-46bc-b1b3-83169ac9cea4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:19.987782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a83838d7-4809-46bc-b1b3-83169ac9cea4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:19.993308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83838d7-4809-46bc-b1b3-83169ac9cea4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:19.994927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83838d7-4809-46bc-b1b3-83169ac9cea4 service placement] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:20.006249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1277/2527] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:21.201781 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94489436-96d1-461d-90fd-e904ffb08e53 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:21.203406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-94489436-96d1-461d-90fd-e904ffb08e53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:21.218326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94489436-96d1-461d-90fd-e904ffb08e53 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:21.223768 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4faf8-9e55-4d21-b180-501786cc657c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:21.224613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4faf8-9e55-4d21-b180-501786cc657c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:21.224925 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4faf8-9e55-4d21-b180-501786cc657c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:21.225197 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4faf8-9e55-4d21-b180-501786cc657c admin admin] PATH_INFO: `/v3/users/399d1cc4c30a4cedbae053d3cf7301fa` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:21.241936 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4faf8-9e55-4d21-b180-501786cc657c admin admin] RBAC: Authorizing `identity:delete_user(user_id=399d1cc4c30a4cedbae053d3cf7301fa)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:21.243921 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4faf8-9e55-4d21-b180-501786cc657c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:21.439792 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e0a4faf8-9e55-4d21-b180-501786cc657c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '399d1cc4c30a4cedbae053d3cf7301fa'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:21.440534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e0a4faf8-9e55-4d21-b180-501786cc657c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '399d1cc4c30a4cedbae053d3cf7301fa'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:21.453888 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e0a4faf8-9e55-4d21-b180-501786cc657c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '399d1cc4c30a4cedbae053d3cf7301fa'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:21.461323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e0a4faf8-9e55-4d21-b180-501786cc657c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '399d1cc4c30a4cedbae053d3cf7301fa'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:21.462104 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e0a4faf8-9e55-4d21-b180-501786cc657c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '399d1cc4c30a4cedbae053d3cf7301fa'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:21.604054 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1251/2528] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:21 2022] DELETE /identity/v3/users/399d1cc4c30a4cedbae053d3cf7301fa => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:21.871269 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83838d7-4809-46bc-b1b3-83169ac9cea4 service placement] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:21.884561 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83838d7-4809-46bc-b1b3-83169ac9cea4 service placement] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:21.944776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c462d6-9a27-4cdd-b9b0-81aa2a8e7237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:21.945425 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c462d6-9a27-4cdd-b9b0-81aa2a8e7237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:21.945707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c462d6-9a27-4cdd-b9b0-81aa2a8e7237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:21.945982 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c462d6-9a27-4cdd-b9b0-81aa2a8e7237 admin admin] PATH_INFO: `/v3/projects/22aa9947fe3246a9b4c35e000dabdfe9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:21.959447 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c462d6-9a27-4cdd-b9b0-81aa2a8e7237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22aa9947fe3246a9b4c35e000dabdfe9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:21.959447 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c462d6-9a27-4cdd-b9b0-81aa2a8e7237 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:22.107492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b7c462d6-9a27-4cdd-b9b0-81aa2a8e7237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22aa9947fe3246a9b4c35e000dabdfe9', 'request_id': 'req-b7c462d6-9a27-4cdd-b9b0-81aa2a8e7237'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:22.173957 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b7c462d6-9a27-4cdd-b9b0-81aa2a8e7237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22aa9947fe3246a9b4c35e000dabdfe9', 'request_id': 'req-b7c462d6-9a27-4cdd-b9b0-81aa2a8e7237'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:22.180692 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b7c462d6-9a27-4cdd-b9b0-81aa2a8e7237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22aa9947fe3246a9b4c35e000dabdfe9', 'request_id': 'req-b7c462d6-9a27-4cdd-b9b0-81aa2a8e7237'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:22.196515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b7c462d6-9a27-4cdd-b9b0-81aa2a8e7237 admin admin] The token cache is being invalidate because project 22aa9947fe3246a9b4c35e000dabdfe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:22.196515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b7c462d6-9a27-4cdd-b9b0-81aa2a8e7237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:22.196515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b7c462d6-9a27-4cdd-b9b0-81aa2a8e7237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:22.196515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1278/2529] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:21 2022] DELETE /identity/v3/projects/22aa9947fe3246a9b4c35e000dabdfe9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:22.200566 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d281b5-b0d9-4606-ab66-adb36846ba3e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:22.200891 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d281b5-b0d9-4606-ab66-adb36846ba3e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:22.201246 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d281b5-b0d9-4606-ab66-adb36846ba3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:22.209700 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:22.222490 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-67d281b5-b0d9-4606-ab66-adb36846ba3e None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:22.223700 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-67d281b5-b0d9-4606-ab66-adb36846ba3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:22.281898 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1252/2530] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:22.289960 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfc3e5-9ad8-4c30-8481-011e8964342c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:22.290245 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfc3e5-9ad8-4c30-8481-011e8964342c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:22.290522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfc3e5-9ad8-4c30-8481-011e8964342c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:22.299859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:22.311287 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f6dfc3e5-9ad8-4c30-8481-011e8964342c None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:22.312499 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f6dfc3e5-9ad8-4c30-8481-011e8964342c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:22.321190 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1279/2531] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:22.325724 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d281b5-b0d9-4606-ab66-adb36846ba3e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:22.336313 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d281b5-b0d9-4606-ab66-adb36846ba3e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:22.341109 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10767b5a-be08-4081-b972-6c991d0fc74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:22.341739 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10767b5a-be08-4081-b972-6c991d0fc74b admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:22.342022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10767b5a-be08-4081-b972-6c991d0fc74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:22.342294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10767b5a-be08-4081-b972-6c991d0fc74b admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:22.343003 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10767b5a-be08-4081-b972-6c991d0fc74b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:16:22.343312 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10767b5a-be08-4081-b972-6c991d0fc74b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:22.344938 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10767b5a-be08-4081-b972-6c991d0fc74b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:22.356596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1253/2532] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:16:22.361104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfc3e5-9ad8-4c30-8481-011e8964342c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:22.371138 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfc3e5-9ad8-4c30-8481-011e8964342c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:22.377354 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fa5a9-d403-4fb2-93d0-849fbcecacf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:22.378069 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fa5a9-d403-4fb2-93d0-849fbcecacf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:22.378358 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fa5a9-d403-4fb2-93d0-849fbcecacf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:22.378638 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fa5a9-d403-4fb2-93d0-849fbcecacf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:22.379322 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fa5a9-d403-4fb2-93d0-849fbcecacf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:22.381304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fa5a9-d403-4fb2-93d0-849fbcecacf1 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:22.559094 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1280/2533] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:22 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:22.563785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10767b5a-be08-4081-b972-6c991d0fc74b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:22.573687 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10767b5a-be08-4081-b972-6c991d0fc74b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:22.632021 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa219a6e-8049-4f1d-88c3-86e0dbc1e159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:22.632645 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa219a6e-8049-4f1d-88c3-86e0dbc1e159 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:22.632956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa219a6e-8049-4f1d-88c3-86e0dbc1e159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:22.633235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa219a6e-8049-4f1d-88c3-86e0dbc1e159 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:22.633914 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa219a6e-8049-4f1d-88c3-86e0dbc1e159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:22.635834 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa219a6e-8049-4f1d-88c3-86e0dbc1e159 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:22.739271 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1254/2534] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:22 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:22.740521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fa5a9-d403-4fb2-93d0-849fbcecacf1 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:22.752037 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fa5a9-d403-4fb2-93d0-849fbcecacf1 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:22.757721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42986710-e147-4036-bba4-85c46f937214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:22.758511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42986710-e147-4036-bba4-85c46f937214 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:22.758854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42986710-e147-4036-bba4-85c46f937214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:22.759131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42986710-e147-4036-bba4-85c46f937214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:22.759837 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42986710-e147-4036-bba4-85c46f937214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:22.761560 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42986710-e147-4036-bba4-85c46f937214 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:22.772110 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1281/2535] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:22.776360 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa219a6e-8049-4f1d-88c3-86e0dbc1e159 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:22.786776 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa219a6e-8049-4f1d-88c3-86e0dbc1e159 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:22.791754 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618274f9-3c53-4822-850c-94d82c145757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:22.792377 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618274f9-3c53-4822-850c-94d82c145757 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:22.792668 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618274f9-3c53-4822-850c-94d82c145757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:22.792980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618274f9-3c53-4822-850c-94d82c145757 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:22.793686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618274f9-3c53-4822-850c-94d82c145757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:22.795975 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618274f9-3c53-4822-850c-94d82c145757 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:22.807139 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1255/2536] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:16:22.812172 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42986710-e147-4036-bba4-85c46f937214 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:22.822647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42986710-e147-4036-bba4-85c46f937214 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:22.827442 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00949675-ef7f-47c4-b686-8f5150e4ec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:22.828119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00949675-ef7f-47c4-b686-8f5150e4ec21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:22.828405 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00949675-ef7f-47c4-b686-8f5150e4ec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:22.828687 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00949675-ef7f-47c4-b686-8f5150e4ec21 admin admin] PATH_INFO: `/v3/projects/8385e3a1fbda4b3abce5600a9bb2835b/users/22bc7d39bbb44808a5b67c5da673bb34/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:22.846687 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00949675-ef7f-47c4-b686-8f5150e4ec21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8385e3a1fbda4b3abce5600a9bb2835b, user_id=22bc7d39bbb44808a5b67c5da673bb34, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:22.850859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00949675-ef7f-47c4-b686-8f5150e4ec21 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:22.933742 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1282/2537] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:22 2022] PUT /identity/v3/projects/8385e3a1fbda4b3abce5600a9bb2835b/users/22bc7d39bbb44808a5b67c5da673bb34/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:22.946145 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4fa79-a362-4799-ab15-e51a93641a11 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:22.946432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4fa79-a362-4799-ab15-e51a93641a11 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:22.946708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4fa79-a362-4799-ab15-e51a93641a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:22.975545 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a0f4fa79-a362-4799-ab15-e51a93641a11 None None] MFA Rules not processed for user `22bc7d39bbb44808a5b67c5da673bb34`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:22.976821 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a0f4fa79-a362-4799-ab15-e51a93641a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:23.043259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:23.053596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1256/2538] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:16:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:23.055050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00949675-ef7f-47c4-b686-8f5150e4ec21 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:23.130994 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00949675-ef7f-47c4-b686-8f5150e4ec21 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:23.135920 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b592e3-f762-445f-b540-996b3e7562e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:23.136730 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b592e3-f762-445f-b540-996b3e7562e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:23.137056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b592e3-f762-445f-b540-996b3e7562e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:23.137331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b592e3-f762-445f-b540-996b3e7562e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:23.138031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b592e3-f762-445f-b540-996b3e7562e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:23.140150 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b592e3-f762-445f-b540-996b3e7562e3 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:23.215541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeb7a4-21f0-47ae-b4d6-9087de6ff555 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:23.216001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeb7a4-21f0-47ae-b4d6-9087de6ff555 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:23.216107 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeb7a4-21f0-47ae-b4d6-9087de6ff555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:23.235254 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1283/2539] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:23 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:23.239821 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-48aeb7a4-21f0-47ae-b4d6-9087de6ff555 None None] MFA Rules not processed for user `1cbbfdda843a4ab98ff9cf0742513f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:23.240511 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b592e3-f762-445f-b540-996b3e7562e3 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:23.241088 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-48aeb7a4-21f0-47ae-b4d6-9087de6ff555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:23.321679 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1257/2540] 10.222.0.75 () {58 vars in 1009 bytes} [Thu Jul 28 18:16:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:23.325996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b592e3-f762-445f-b540-996b3e7562e3 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:23.330768 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8a228-7d9d-45eb-99ef-24e80ba4e96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:23.331396 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8a228-7d9d-45eb-99ef-24e80ba4e96b admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:23.331682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8a228-7d9d-45eb-99ef-24e80ba4e96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:23.331960 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8a228-7d9d-45eb-99ef-24e80ba4e96b admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:23.332664 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8a228-7d9d-45eb-99ef-24e80ba4e96b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:23.338697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8a228-7d9d-45eb-99ef-24e80ba4e96b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:23.338854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aeb7a4-21f0-47ae-b4d6-9087de6ff555 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:23.340091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-48aeb7a4-21f0-47ae-b4d6-9087de6ff555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:23.424661 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aeb7a4-21f0-47ae-b4d6-9087de6ff555 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:23.431122 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1b019-37d0-457f-a025-6e3e6eed4517 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77b4fcb974d48a0bda4852c8d304511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:23.431638 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1b019-37d0-457f-a025-6e3e6eed4517 service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:23.431992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1b019-37d0-457f-a025-6e3e6eed4517 service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:23.432242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1b019-37d0-457f-a025-6e3e6eed4517 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:23.439658 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1284/2541] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:23 2022] POST /identity/v3/users => generated 295 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:23.442713 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8a228-7d9d-45eb-99ef-24e80ba4e96b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:23.445550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1b019-37d0-457f-a025-6e3e6eed4517 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:23.447458 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1b019-37d0-457f-a025-6e3e6eed4517 service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:23.457847 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8a228-7d9d-45eb-99ef-24e80ba4e96b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:23.459629 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1258/2542] 10.222.0.75 () {60 vars in 1384 bytes} [Thu Jul 28 18:16:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:16:23.463502 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc24341-c04c-40bb-b740-255edc4f71ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:23.463735 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc24341-c04c-40bb-b740-255edc4f71ee admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:23.464033 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc24341-c04c-40bb-b740-255edc4f71ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:23.464225 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc24341-c04c-40bb-b740-255edc4f71ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:23.465052 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc24341-c04c-40bb-b740-255edc4f71ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:23.466929 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc24341-c04c-40bb-b740-255edc4f71ee admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:23.489192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1285/2543] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:16:23.493139 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1b019-37d0-457f-a025-6e3e6eed4517 service swift] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:23.506050 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1b019-37d0-457f-a025-6e3e6eed4517 service swift] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:23.511589 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f6151-de45-4937-abfd-d4ed9da0caf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:23.512305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f6151-de45-4937-abfd-d4ed9da0caf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:23.512593 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f6151-de45-4937-abfd-d4ed9da0caf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:23.512914 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f6151-de45-4937-abfd-d4ed9da0caf2 admin admin] PATH_INFO: `/v3/projects/1880e8dbb0814d029faffe85ecbef8e9/users/147c7e5874d14bb49430b66c4200b106/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:23.531327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f6151-de45-4937-abfd-d4ed9da0caf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1880e8dbb0814d029faffe85ecbef8e9, user_id=147c7e5874d14bb49430b66c4200b106, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:23.534343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f6151-de45-4937-abfd-d4ed9da0caf2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:23.621276 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc24341-c04c-40bb-b740-255edc4f71ee admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:23.623177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9cc24341-c04c-40bb-b740-255edc4f71ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:23.633215 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:23.667771 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1259/2544] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:23 2022] PUT /identity/v3/projects/1880e8dbb0814d029faffe85ecbef8e9/users/147c7e5874d14bb49430b66c4200b106/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:23.672504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f6151-de45-4937-abfd-d4ed9da0caf2 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:23.692050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc24341-c04c-40bb-b740-255edc4f71ee admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:23.810521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f3c7b-9151-4805-9e5f-8b755f115710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:23.812281 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f3c7b-9151-4805-9e5f-8b755f115710 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:23.812844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f3c7b-9151-4805-9e5f-8b755f115710 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:23.813137 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f3c7b-9151-4805-9e5f-8b755f115710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:23.815415 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-572f3c7b-9151-4805-9e5f-8b755f115710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:23.829039 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f3c7b-9151-4805-9e5f-8b755f115710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:23.830787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f3c7b-9151-4805-9e5f-8b755f115710 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:23.851119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1286/2545] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:16:24.020814 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f6151-de45-4937-abfd-d4ed9da0caf2 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:24.032349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264437a-f191-49f4-a750-90b9fe562e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:24.033028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264437a-f191-49f4-a750-90b9fe562e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:24.033314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264437a-f191-49f4-a750-90b9fe562e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:24.033591 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264437a-f191-49f4-a750-90b9fe562e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:24.034300 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264437a-f191-49f4-a750-90b9fe562e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:24.035916 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264437a-f191-49f4-a750-90b9fe562e33 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:24.056878 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1260/2546] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:24.057919 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f3c7b-9151-4805-9e5f-8b755f115710 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:24.075473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f3c7b-9151-4805-9e5f-8b755f115710 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:24.081802 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c71586-9df1-40f8-bef2-a051b9a506d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:24.082628 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c71586-9df1-40f8-bef2-a051b9a506d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:24.083024 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c71586-9df1-40f8-bef2-a051b9a506d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:24.083408 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c71586-9df1-40f8-bef2-a051b9a506d2 admin admin] PATH_INFO: `/v3/projects/1880e8dbb0814d029faffe85ecbef8e9/users/147c7e5874d14bb49430b66c4200b106/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:24.085583 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c71586-9df1-40f8-bef2-a051b9a506d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1880e8dbb0814d029faffe85ecbef8e9, user_id=147c7e5874d14bb49430b66c4200b106, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:24.088612 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c71586-9df1-40f8-bef2-a051b9a506d2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:24.103499 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1287/2547] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:24 2022] PUT /identity/v3/projects/1880e8dbb0814d029faffe85ecbef8e9/users/147c7e5874d14bb49430b66c4200b106/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:24.114390 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cd667-dc9a-4ca0-b383-340f155ca934 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:24.114782 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cd667-dc9a-4ca0-b383-340f155ca934 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:24.115162 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cd667-dc9a-4ca0-b383-340f155ca934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:24.127860 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:24.150242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-613cd667-dc9a-4ca0-b383-340f155ca934 None None] MFA Rules not processed for user `147c7e5874d14bb49430b66c4200b106`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:24.151660 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-613cd667-dc9a-4ca0-b383-340f155ca934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:24.271458 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1261/2548] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:16:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:24.278518 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c71586-9df1-40f8-bef2-a051b9a506d2 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:24.280286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-27c71586-9df1-40f8-bef2-a051b9a506d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:24.365554 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c71586-9df1-40f8-bef2-a051b9a506d2 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:24.370233 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eea727-e1fc-48e6-adab-bd40cff92018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:24.372664 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eea727-e1fc-48e6-adab-bd40cff92018 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:24.372664 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eea727-e1fc-48e6-adab-bd40cff92018 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:24.381120 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eea727-e1fc-48e6-adab-bd40cff92018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:24.449493 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eea727-e1fc-48e6-adab-bd40cff92018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:24.451287 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eea727-e1fc-48e6-adab-bd40cff92018 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:24.462833 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1288/2549] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:29.981636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cd667-dc9a-4ca0-b383-340f155ca934 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:29.992348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cd667-dc9a-4ca0-b383-340f155ca934 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:29.996126 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87f8b7-99c9-4041-b93b-1dc0620f2df2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:29.996770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87f8b7-99c9-4041-b93b-1dc0620f2df2 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:29.997067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87f8b7-99c9-4041-b93b-1dc0620f2df2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:29.997335 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87f8b7-99c9-4041-b93b-1dc0620f2df2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:30.007417 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87f8b7-99c9-4041-b93b-1dc0620f2df2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:30.009028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87f8b7-99c9-4041-b93b-1dc0620f2df2 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:30.020026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1262/2550] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:34.457167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:40.014461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=38 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:46.820028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eea727-e1fc-48e6-adab-bd40cff92018 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:46.833238 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-87eea727-e1fc-48e6-adab-bd40cff92018 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:46.896883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eea727-e1fc-48e6-adab-bd40cff92018 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:46.902775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f1145-5a8b-4ac1-b790-bff3a1934fd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:46.903448 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1145-5a8b-4ac1-b790-bff3a1934fd2 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:46.903822 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1145-5a8b-4ac1-b790-bff3a1934fd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:46.904011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1145-5a8b-4ac1-b790-bff3a1934fd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:46.905917 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3a6f1145-5a8b-4ac1-b790-bff3a1934fd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:46.921157 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f1145-5a8b-4ac1-b790-bff3a1934fd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:46.922815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f1145-5a8b-4ac1-b790-bff3a1934fd2 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:46.935671 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1289/2551] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:50.879840 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87f8b7-99c9-4041-b93b-1dc0620f2df2 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:50.943975 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87f8b7-99c9-4041-b93b-1dc0620f2df2 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:50.948882 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77761a-e0c2-475a-8663-389fb4c2da3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:50.949527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77761a-e0c2-475a-8663-389fb4c2da3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:50.949806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77761a-e0c2-475a-8663-389fb4c2da3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:50.950076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77761a-e0c2-475a-8663-389fb4c2da3e admin admin] PATH_INFO: `/v3/users/22bc7d39bbb44808a5b67c5da673bb34` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:50.951233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77761a-e0c2-475a-8663-389fb4c2da3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=22bc7d39bbb44808a5b67c5da673bb34)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:50.953152 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77761a-e0c2-475a-8663-389fb4c2da3e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:51.151062 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5e77761a-e0c2-475a-8663-389fb4c2da3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22bc7d39bbb44808a5b67c5da673bb34'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:51.155569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5e77761a-e0c2-475a-8663-389fb4c2da3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22bc7d39bbb44808a5b67c5da673bb34'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:51.164480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5e77761a-e0c2-475a-8663-389fb4c2da3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22bc7d39bbb44808a5b67c5da673bb34'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:51.171687 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5e77761a-e0c2-475a-8663-389fb4c2da3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22bc7d39bbb44808a5b67c5da673bb34'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:51.172386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5e77761a-e0c2-475a-8663-389fb4c2da3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22bc7d39bbb44808a5b67c5da673bb34'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:51.245887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1263/2552] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:50 2022] DELETE /identity/v3/users/22bc7d39bbb44808a5b67c5da673bb34 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:51.250446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0244129-76e2-4fcd-a792-85a5af7aad4f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:51.250908 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0244129-76e2-4fcd-a792-85a5af7aad4f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:51.251003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0244129-76e2-4fcd-a792-85a5af7aad4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:51.270771 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f0244129-76e2-4fcd-a792-85a5af7aad4f None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:51.272459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f0244129-76e2-4fcd-a792-85a5af7aad4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:51.331750 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1290/2553] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:51.341946 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77761a-e0c2-475a-8663-389fb4c2da3e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:51.343584 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5e77761a-e0c2-475a-8663-389fb4c2da3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:51.402327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77761a-e0c2-475a-8663-389fb4c2da3e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:51.406024 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca5e6f-9204-4e0c-b71d-241a22c6a5a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:51.406690 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca5e6f-9204-4e0c-b71d-241a22c6a5a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:51.406975 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca5e6f-9204-4e0c-b71d-241a22c6a5a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:51.407249 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca5e6f-9204-4e0c-b71d-241a22c6a5a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:51.416910 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca5e6f-9204-4e0c-b71d-241a22c6a5a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:51.418335 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca5e6f-9204-4e0c-b71d-241a22c6a5a7 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:51.428796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1264/2554] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:52.168132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0244129-76e2-4fcd-a792-85a5af7aad4f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:52.169605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f0244129-76e2-4fcd-a792-85a5af7aad4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:52.182575 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0244129-76e2-4fcd-a792-85a5af7aad4f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:52.187461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0128eec-4a15-4d78-a54d-ebb6c51a8f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:52.188115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0128eec-4a15-4d78-a54d-ebb6c51a8f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:52.188404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0128eec-4a15-4d78-a54d-ebb6c51a8f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:52.188686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0128eec-4a15-4d78-a54d-ebb6c51a8f61 admin admin] PATH_INFO: `/v3/projects/8385e3a1fbda4b3abce5600a9bb2835b` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:52.189959 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0128eec-4a15-4d78-a54d-ebb6c51a8f61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8385e3a1fbda4b3abce5600a9bb2835b)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:52.192427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0128eec-4a15-4d78-a54d-ebb6c51a8f61 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:52.325274 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c0128eec-4a15-4d78-a54d-ebb6c51a8f61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8385e3a1fbda4b3abce5600a9bb2835b', 'request_id': 'req-c0128eec-4a15-4d78-a54d-ebb6c51a8f61'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:52.390494 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c0128eec-4a15-4d78-a54d-ebb6c51a8f61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8385e3a1fbda4b3abce5600a9bb2835b', 'request_id': 'req-c0128eec-4a15-4d78-a54d-ebb6c51a8f61'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:52.397601 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c0128eec-4a15-4d78-a54d-ebb6c51a8f61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8385e3a1fbda4b3abce5600a9bb2835b', 'request_id': 'req-c0128eec-4a15-4d78-a54d-ebb6c51a8f61'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:52.408692 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c0128eec-4a15-4d78-a54d-ebb6c51a8f61 admin admin] The token cache is being invalidate because project 8385e3a1fbda4b3abce5600a9bb2835b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:52.409062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c0128eec-4a15-4d78-a54d-ebb6c51a8f61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:52.409704 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c0128eec-4a15-4d78-a54d-ebb6c51a8f61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:52.411218 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1291/2555] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:52 2022] DELETE /identity/v3/projects/8385e3a1fbda4b3abce5600a9bb2835b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:52.415381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca5e6f-9204-4e0c-b71d-241a22c6a5a7 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:52.425099 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca5e6f-9204-4e0c-b71d-241a22c6a5a7 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:52.443515 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:52.481210 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776f9cf-fd91-46d6-b0f8-02173f2ba120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:52.481853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776f9cf-fd91-46d6-b0f8-02173f2ba120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:52.482138 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776f9cf-fd91-46d6-b0f8-02173f2ba120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:52.482417 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776f9cf-fd91-46d6-b0f8-02173f2ba120 admin admin] PATH_INFO: `/v3/users/147c7e5874d14bb49430b66c4200b106` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:52.483580 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776f9cf-fd91-46d6-b0f8-02173f2ba120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=147c7e5874d14bb49430b66c4200b106)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:52.485535 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776f9cf-fd91-46d6-b0f8-02173f2ba120 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:52.647559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3776f9cf-fd91-46d6-b0f8-02173f2ba120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147c7e5874d14bb49430b66c4200b106'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:52.648164 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3776f9cf-fd91-46d6-b0f8-02173f2ba120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147c7e5874d14bb49430b66c4200b106'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:52.660235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3776f9cf-fd91-46d6-b0f8-02173f2ba120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147c7e5874d14bb49430b66c4200b106'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:52.667401 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3776f9cf-fd91-46d6-b0f8-02173f2ba120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147c7e5874d14bb49430b66c4200b106'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:52.668059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3776f9cf-fd91-46d6-b0f8-02173f2ba120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147c7e5874d14bb49430b66c4200b106'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:52.765688 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1265/2556] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:52 2022] DELETE /identity/v3/users/147c7e5874d14bb49430b66c4200b106 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:53.164566 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0128eec-4a15-4d78-a54d-ebb6c51a8f61 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:53.166068 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c0128eec-4a15-4d78-a54d-ebb6c51a8f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:53.179898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0128eec-4a15-4d78-a54d-ebb6c51a8f61 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:53.185023 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:53.238284 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8d5c2-74a0-45e3-a93e-de5a6efb29fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:53.238939 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8d5c2-74a0-45e3-a93e-de5a6efb29fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:53.239226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8d5c2-74a0-45e3-a93e-de5a6efb29fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:53.239507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8d5c2-74a0-45e3-a93e-de5a6efb29fe admin admin] PATH_INFO: `/v3/projects/1880e8dbb0814d029faffe85ecbef8e9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:53.240760 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8d5c2-74a0-45e3-a93e-de5a6efb29fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=1880e8dbb0814d029faffe85ecbef8e9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:53.242844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8d5c2-74a0-45e3-a93e-de5a6efb29fe admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:53.368581 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5cf8d5c2-74a0-45e3-a93e-de5a6efb29fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1880e8dbb0814d029faffe85ecbef8e9', 'request_id': 'req-5cf8d5c2-74a0-45e3-a93e-de5a6efb29fe'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:53.447435 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5cf8d5c2-74a0-45e3-a93e-de5a6efb29fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1880e8dbb0814d029faffe85ecbef8e9', 'request_id': 'req-5cf8d5c2-74a0-45e3-a93e-de5a6efb29fe'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:53.453317 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5cf8d5c2-74a0-45e3-a93e-de5a6efb29fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1880e8dbb0814d029faffe85ecbef8e9', 'request_id': 'req-5cf8d5c2-74a0-45e3-a93e-de5a6efb29fe'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:53.465721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5cf8d5c2-74a0-45e3-a93e-de5a6efb29fe admin admin] The token cache is being invalidate because project 1880e8dbb0814d029faffe85ecbef8e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:53.466032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5cf8d5c2-74a0-45e3-a93e-de5a6efb29fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:53.469316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5cf8d5c2-74a0-45e3-a93e-de5a6efb29fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:53.469316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1292/2557] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:53 2022] DELETE /identity/v3/projects/1880e8dbb0814d029faffe85ecbef8e9 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:53.474080 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab949a5-1fe8-46e5-be12-3ffa50f467a7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:53.474607 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab949a5-1fe8-46e5-be12-3ffa50f467a7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:53.474712 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab949a5-1fe8-46e5-be12-3ffa50f467a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:53.494746 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-dab949a5-1fe8-46e5-be12-3ffa50f467a7 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:53.495948 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dab949a5-1fe8-46e5-be12-3ffa50f467a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:53.553779 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1266/2558] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:53.562829 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97467e36-d524-4bed-8314-d5c9d06777b5 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:53.563147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97467e36-d524-4bed-8314-d5c9d06777b5 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:53.563435 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97467e36-d524-4bed-8314-d5c9d06777b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:53.587652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-97467e36-d524-4bed-8314-d5c9d06777b5 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:53.588958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-97467e36-d524-4bed-8314-d5c9d06777b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:53.597419 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1293/2559] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:53.601883 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab949a5-1fe8-46e5-be12-3ffa50f467a7 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:53.611905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab949a5-1fe8-46e5-be12-3ffa50f467a7 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:53.617313 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c3020-0603-469a-9dad-15e3a58ad872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:53.617924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c3020-0603-469a-9dad-15e3a58ad872 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:53.618207 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c3020-0603-469a-9dad-15e3a58ad872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:53.618484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c3020-0603-469a-9dad-15e3a58ad872 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:53.619185 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c3020-0603-469a-9dad-15e3a58ad872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:16:53.619493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c3020-0603-469a-9dad-15e3a58ad872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:53.621116 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c3020-0603-469a-9dad-15e3a58ad872 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:53.633129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1267/2560] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:16:53.637474 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97467e36-d524-4bed-8314-d5c9d06777b5 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:53.646982 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97467e36-d524-4bed-8314-d5c9d06777b5 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:53.651592 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea7914-fd1b-4d3e-8366-a61b72413203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:53.652202 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea7914-fd1b-4d3e-8366-a61b72413203 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:53.652484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea7914-fd1b-4d3e-8366-a61b72413203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:53.652780 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea7914-fd1b-4d3e-8366-a61b72413203 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:53.653455 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea7914-fd1b-4d3e-8366-a61b72413203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:53.655410 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea7914-fd1b-4d3e-8366-a61b72413203 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:53.758025 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1294/2561] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:53 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:53.762240 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c3020-0603-469a-9dad-15e3a58ad872 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:53.772387 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c3020-0603-469a-9dad-15e3a58ad872 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:53.798767 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:53.830522 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e0277-0fa0-49bf-9197-3003572d2bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:53.831791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e0277-0fa0-49bf-9197-3003572d2bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:53.831978 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e0277-0fa0-49bf-9197-3003572d2bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:53.832254 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e0277-0fa0-49bf-9197-3003572d2bb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:53.833004 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e0277-0fa0-49bf-9197-3003572d2bb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:53.835541 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e0277-0fa0-49bf-9197-3003572d2bb0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:53.926145 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1268/2562] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:53 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:53.930384 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea7914-fd1b-4d3e-8366-a61b72413203 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:53.941655 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea7914-fd1b-4d3e-8366-a61b72413203 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:53.946324 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fc654-d268-417d-a422-002bce33b553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:53.946934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fc654-d268-417d-a422-002bce33b553 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:53.947211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fc654-d268-417d-a422-002bce33b553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:53.947485 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fc654-d268-417d-a422-002bce33b553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:53.948176 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fc654-d268-417d-a422-002bce33b553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:53.949799 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fc654-d268-417d-a422-002bce33b553 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:53.963906 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1295/2563] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:53.965080 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e0277-0fa0-49bf-9197-3003572d2bb0 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:53.975438 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e0277-0fa0-49bf-9197-3003572d2bb0 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:53.980113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634db0b9-2c74-4c14-9f5f-b1c8994eb4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:53.980673 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634db0b9-2c74-4c14-9f5f-b1c8994eb4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:53.980988 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634db0b9-2c74-4c14-9f5f-b1c8994eb4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:53.981262 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634db0b9-2c74-4c14-9f5f-b1c8994eb4e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:53.981952 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634db0b9-2c74-4c14-9f5f-b1c8994eb4e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:53.983529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634db0b9-2c74-4c14-9f5f-b1c8994eb4e9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:53.994492 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1269/2564] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:53.998790 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fc654-d268-417d-a422-002bce33b553 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:54.009775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fc654-d268-417d-a422-002bce33b553 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:54.014665 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17efa1-0121-4266-b3a6-2433fce41e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:54.015356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17efa1-0121-4266-b3a6-2433fce41e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:54.015642 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17efa1-0121-4266-b3a6-2433fce41e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:54.016074 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17efa1-0121-4266-b3a6-2433fce41e8a admin admin] PATH_INFO: `/v3/projects/4e1ce8f847a6411ca2f1421294b87bf1/users/2068abdf74314040b861a379bda922de/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:54.031298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17efa1-0121-4266-b3a6-2433fce41e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1ce8f847a6411ca2f1421294b87bf1, user_id=2068abdf74314040b861a379bda922de, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:54.034018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17efa1-0121-4266-b3a6-2433fce41e8a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:54.135110 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1296/2565] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:53 2022] PUT /identity/v3/projects/4e1ce8f847a6411ca2f1421294b87bf1/users/2068abdf74314040b861a379bda922de/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:54.151844 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4a311-7b68-43ab-94e3-430b426a4178 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:54.151970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4a311-7b68-43ab-94e3-430b426a4178 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:54.152242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4a311-7b68-43ab-94e3-430b426a4178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:54.182420 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-25e4a311-7b68-43ab-94e3-430b426a4178 None None] MFA Rules not processed for user `2068abdf74314040b861a379bda922de`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:54.183759 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-25e4a311-7b68-43ab-94e3-430b426a4178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:54.251097 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1270/2566] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:16:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:54.256319 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17efa1-0121-4266-b3a6-2433fce41e8a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:54.295512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:54.320465 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17efa1-0121-4266-b3a6-2433fce41e8a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:54.325300 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed15f9b-b2e8-419b-a09b-371392379e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:54.325929 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed15f9b-b2e8-419b-a09b-371392379e53 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:54.330269 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed15f9b-b2e8-419b-a09b-371392379e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:54.330269 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed15f9b-b2e8-419b-a09b-371392379e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:54.330269 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed15f9b-b2e8-419b-a09b-371392379e53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:54.330269 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed15f9b-b2e8-419b-a09b-371392379e53 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:54.449119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1297/2567] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:54 2022] POST /identity/v3/projects => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:54.453488 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4a311-7b68-43ab-94e3-430b426a4178 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:54.464910 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4a311-7b68-43ab-94e3-430b426a4178 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:54.522975 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c55f5-d18f-4a56-84a9-c7b3c38dbe05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:54.523667 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c55f5-d18f-4a56-84a9-c7b3c38dbe05 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:54.523921 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c55f5-d18f-4a56-84a9-c7b3c38dbe05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:54.524193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c55f5-d18f-4a56-84a9-c7b3c38dbe05 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:54.524900 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c55f5-d18f-4a56-84a9-c7b3c38dbe05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:54.526808 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c55f5-d18f-4a56-84a9-c7b3c38dbe05 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:54.630609 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1271/2568] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:54 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:54.634865 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed15f9b-b2e8-419b-a09b-371392379e53 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:54.645882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed15f9b-b2e8-419b-a09b-371392379e53 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:54.650734 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6591aac-a1f2-433e-b847-2647b4784a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:54.651375 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6591aac-a1f2-433e-b847-2647b4784a63 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:54.651730 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6591aac-a1f2-433e-b847-2647b4784a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:54.652057 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6591aac-a1f2-433e-b847-2647b4784a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:54.653110 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6591aac-a1f2-433e-b847-2647b4784a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:54.655759 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6591aac-a1f2-433e-b847-2647b4784a63 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:54.666410 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1298/2569] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:54.670681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c55f5-d18f-4a56-84a9-c7b3c38dbe05 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:54.681594 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c55f5-d18f-4a56-84a9-c7b3c38dbe05 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:54.686255 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a70b1a-d238-4026-baf7-c72b9911e5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:54.686922 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a70b1a-d238-4026-baf7-c72b9911e5e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:54.687202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a70b1a-d238-4026-baf7-c72b9911e5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:54.687481 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a70b1a-d238-4026-baf7-c72b9911e5e5 admin admin] PATH_INFO: `/v3/projects/163b29260d1f4f34a85393162c425fb9/users/c86d5789103f418c89af316fa6644f96/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:54.704040 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a70b1a-d238-4026-baf7-c72b9911e5e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=163b29260d1f4f34a85393162c425fb9, user_id=c86d5789103f418c89af316fa6644f96, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:54.706749 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a70b1a-d238-4026-baf7-c72b9911e5e5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:54.777841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1272/2570] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:54 2022] PUT /identity/v3/projects/163b29260d1f4f34a85393162c425fb9/users/c86d5789103f418c89af316fa6644f96/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:54.781632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6591aac-a1f2-433e-b847-2647b4784a63 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:54.792404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6591aac-a1f2-433e-b847-2647b4784a63 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:54.850927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfeb8f-bbc7-4f0e-9d15-c2741db08f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:54.851614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfeb8f-bbc7-4f0e-9d15-c2741db08f21 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:54.851898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfeb8f-bbc7-4f0e-9d15-c2741db08f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:54.852172 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfeb8f-bbc7-4f0e-9d15-c2741db08f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:54.852920 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfeb8f-bbc7-4f0e-9d15-c2741db08f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:54.854567 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfeb8f-bbc7-4f0e-9d15-c2741db08f21 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:54.867802 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1299/2571] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:54.869015 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a70b1a-d238-4026-baf7-c72b9911e5e5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:54.874404 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:54.880033 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a70b1a-d238-4026-baf7-c72b9911e5e5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:54.884569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d4da5-4298-4157-971c-2fc777575888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:54.885267 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d4da5-4298-4157-971c-2fc777575888 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:54.885547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d4da5-4298-4157-971c-2fc777575888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:54.885822 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d4da5-4298-4157-971c-2fc777575888 admin admin] PATH_INFO: `/v3/projects/163b29260d1f4f34a85393162c425fb9/users/c86d5789103f418c89af316fa6644f96/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:54.887763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d4da5-4298-4157-971c-2fc777575888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=163b29260d1f4f34a85393162c425fb9, user_id=c86d5789103f418c89af316fa6644f96, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:54.890436 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d4da5-4298-4157-971c-2fc777575888 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:54.901424 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1273/2572] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:54 2022] PUT /identity/v3/projects/163b29260d1f4f34a85393162c425fb9/users/c86d5789103f418c89af316fa6644f96/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:54.917720 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41c2a7-b629-4a02-a50e-cafa323642da None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:54.918065 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41c2a7-b629-4a02-a50e-cafa323642da None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:54.918332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41c2a7-b629-4a02-a50e-cafa323642da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:54.946181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-2e41c2a7-b629-4a02-a50e-cafa323642da None None] MFA Rules not processed for user `c86d5789103f418c89af316fa6644f96`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:54.947723 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2e41c2a7-b629-4a02-a50e-cafa323642da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:55.018302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1300/2573] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:16:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:55.030041 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d4da5-4298-4157-971c-2fc777575888 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:55.031736 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7f3d4da5-4298-4157-971c-2fc777575888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:55.091988 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d4da5-4298-4157-971c-2fc777575888 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:55.095689 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0be2f1-a229-4ccf-96e3-6e590fde1a87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:55.096312 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0be2f1-a229-4ccf-96e3-6e590fde1a87 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:55.096595 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0be2f1-a229-4ccf-96e3-6e590fde1a87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:55.096919 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0be2f1-a229-4ccf-96e3-6e590fde1a87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:55.106934 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0be2f1-a229-4ccf-96e3-6e590fde1a87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:55.108383 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0be2f1-a229-4ccf-96e3-6e590fde1a87 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:55.118511 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1274/2574] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:55 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:55.228116 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41c2a7-b629-4a02-a50e-cafa323642da None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:55.237659 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41c2a7-b629-4a02-a50e-cafa323642da None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:55.241804 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c022889-4a89-49b4-9172-839c2ccfdb41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:55.242417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c022889-4a89-49b4-9172-839c2ccfdb41 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:55.242693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c022889-4a89-49b4-9172-839c2ccfdb41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:55.242963 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c022889-4a89-49b4-9172-839c2ccfdb41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:55.274949 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:55.308357 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c022889-4a89-49b4-9172-839c2ccfdb41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:55.308357 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c022889-4a89-49b4-9172-839c2ccfdb41 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:55.313480 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1301/2575] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:55 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:58.440268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0be2f1-a229-4ccf-96e3-6e590fde1a87 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:58.441743 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7c0be2f1-a229-4ccf-96e3-6e590fde1a87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:58.499352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0be2f1-a229-4ccf-96e3-6e590fde1a87 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:58.502919 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd06d80-92cf-4af7-b6ee-f10692c80485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:58.503526 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd06d80-92cf-4af7-b6ee-f10692c80485 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:58.503804 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd06d80-92cf-4af7-b6ee-f10692c80485 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:58.504078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd06d80-92cf-4af7-b6ee-f10692c80485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:58.506376 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cfd06d80-92cf-4af7-b6ee-f10692c80485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:58.569175 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd06d80-92cf-4af7-b6ee-f10692c80485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:58.570722 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd06d80-92cf-4af7-b6ee-f10692c80485 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:58.580856 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1275/2576] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:00.332684 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c022889-4a89-49b4-9172-839c2ccfdb41 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:00.400539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c022889-4a89-49b4-9172-839c2ccfdb41 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:00.406314 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376962b-56c1-4f2b-9cfd-d03b6f592c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:00.407053 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376962b-56c1-4f2b-9cfd-d03b6f592c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:00.407371 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376962b-56c1-4f2b-9cfd-d03b6f592c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:00.407645 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376962b-56c1-4f2b-9cfd-d03b6f592c27 admin admin] PATH_INFO: `/v3/users/2068abdf74314040b861a379bda922de` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:00.408865 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376962b-56c1-4f2b-9cfd-d03b6f592c27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2068abdf74314040b861a379bda922de)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:00.410816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376962b-56c1-4f2b-9cfd-d03b6f592c27 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:00.635563 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0376962b-56c1-4f2b-9cfd-d03b6f592c27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2068abdf74314040b861a379bda922de'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:00.762445 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0376962b-56c1-4f2b-9cfd-d03b6f592c27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2068abdf74314040b861a379bda922de'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:00.775614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0376962b-56c1-4f2b-9cfd-d03b6f592c27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2068abdf74314040b861a379bda922de'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:00.785629 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0376962b-56c1-4f2b-9cfd-d03b6f592c27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2068abdf74314040b861a379bda922de'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:00.787282 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0376962b-56c1-4f2b-9cfd-d03b6f592c27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2068abdf74314040b861a379bda922de'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:00.795877 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1302/2577] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:17:00 2022] DELETE /identity/v3/users/2068abdf74314040b861a379bda922de => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:00.800782 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe1962-36ec-4507-befb-a8e72fd219a2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:00.800782 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe1962-36ec-4507-befb-a8e72fd219a2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:00.801337 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe1962-36ec-4507-befb-a8e72fd219a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:00.826166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ecfe1962-36ec-4507-befb-a8e72fd219a2 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:00.827479 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ecfe1962-36ec-4507-befb-a8e72fd219a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:00.872088 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:00.898877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1276/2578] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:00.909671 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376962b-56c1-4f2b-9cfd-d03b6f592c27 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:00.911801 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0376962b-56c1-4f2b-9cfd-d03b6f592c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:00.982307 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:00.988907 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376962b-56c1-4f2b-9cfd-d03b6f592c27 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:00.996544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bc88b-4922-4a95-a571-26a0f7013c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:00.996544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bc88b-4922-4a95-a571-26a0f7013c0f service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:00.996544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bc88b-4922-4a95-a571-26a0f7013c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:00.996544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bc88b-4922-4a95-a571-26a0f7013c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:01.009090 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bc88b-4922-4a95-a571-26a0f7013c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:01.011720 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bc88b-4922-4a95-a571-26a0f7013c0f service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:01.025109 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1303/2579] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:01.512193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe1962-36ec-4507-befb-a8e72fd219a2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:01.516436 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ecfe1962-36ec-4507-befb-a8e72fd219a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:01.526320 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe1962-36ec-4507-befb-a8e72fd219a2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:01.531276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89729420-4d28-4b86-a689-4c4c9490d43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:01.532017 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89729420-4d28-4b86-a689-4c4c9490d43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:01.532194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89729420-4d28-4b86-a689-4c4c9490d43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:01.532446 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89729420-4d28-4b86-a689-4c4c9490d43c admin admin] PATH_INFO: `/v3/projects/4e1ce8f847a6411ca2f1421294b87bf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:01.534143 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89729420-4d28-4b86-a689-4c4c9490d43c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1ce8f847a6411ca2f1421294b87bf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:01.536063 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89729420-4d28-4b86-a689-4c4c9490d43c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:01.682815 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-89729420-4d28-4b86-a689-4c4c9490d43c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1ce8f847a6411ca2f1421294b87bf1', 'request_id': 'req-89729420-4d28-4b86-a689-4c4c9490d43c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:01.690076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-89729420-4d28-4b86-a689-4c4c9490d43c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1ce8f847a6411ca2f1421294b87bf1', 'request_id': 'req-89729420-4d28-4b86-a689-4c4c9490d43c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:01.697899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-89729420-4d28-4b86-a689-4c4c9490d43c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1ce8f847a6411ca2f1421294b87bf1', 'request_id': 'req-89729420-4d28-4b86-a689-4c4c9490d43c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:01.794368 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-89729420-4d28-4b86-a689-4c4c9490d43c admin admin] The token cache is being invalidate because project 4e1ce8f847a6411ca2f1421294b87bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:17:01.799637 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-89729420-4d28-4b86-a689-4c4c9490d43c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:01.799637 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-89729420-4d28-4b86-a689-4c4c9490d43c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:01.799637 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1277/2580] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:17:01 2022] DELETE /identity/v3/projects/4e1ce8f847a6411ca2f1421294b87bf1 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:17:01.801335 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bc88b-4922-4a95-a571-26a0f7013c0f service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:01.811512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bc88b-4922-4a95-a571-26a0f7013c0f service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:01.867663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bcd2d-fb2c-4bdd-bc0b-1d3a7862f26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:01.868308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bcd2d-fb2c-4bdd-bc0b-1d3a7862f26a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:01.868583 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bcd2d-fb2c-4bdd-bc0b-1d3a7862f26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:01.868890 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bcd2d-fb2c-4bdd-bc0b-1d3a7862f26a admin admin] PATH_INFO: `/v3/users/c86d5789103f418c89af316fa6644f96` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:01.870039 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bcd2d-fb2c-4bdd-bc0b-1d3a7862f26a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c86d5789103f418c89af316fa6644f96)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:01.871968 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bcd2d-fb2c-4bdd-bc0b-1d3a7862f26a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:02.053860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2b4bcd2d-fb2c-4bdd-bc0b-1d3a7862f26a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c86d5789103f418c89af316fa6644f96'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:02.127387 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2b4bcd2d-fb2c-4bdd-bc0b-1d3a7862f26a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c86d5789103f418c89af316fa6644f96'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:02.140858 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2b4bcd2d-fb2c-4bdd-bc0b-1d3a7862f26a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c86d5789103f418c89af316fa6644f96'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:02.148653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2b4bcd2d-fb2c-4bdd-bc0b-1d3a7862f26a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c86d5789103f418c89af316fa6644f96'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:02.149384 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2b4bcd2d-fb2c-4bdd-bc0b-1d3a7862f26a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c86d5789103f418c89af316fa6644f96'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:02.155373 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1304/2581] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:17:01 2022] DELETE /identity/v3/users/c86d5789103f418c89af316fa6644f96 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:02.576563 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89729420-4d28-4b86-a689-4c4c9490d43c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:02.578197 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-89729420-4d28-4b86-a689-4c4c9490d43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:02.592104 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89729420-4d28-4b86-a689-4c4c9490d43c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:02.653748 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129ed6b-8c2b-430e-b1c6-4f75bbbbc835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:02.654396 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129ed6b-8c2b-430e-b1c6-4f75bbbbc835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:02.654677 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129ed6b-8c2b-430e-b1c6-4f75bbbbc835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:02.654953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129ed6b-8c2b-430e-b1c6-4f75bbbbc835 admin admin] PATH_INFO: `/v3/projects/163b29260d1f4f34a85393162c425fb9` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:02.656110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129ed6b-8c2b-430e-b1c6-4f75bbbbc835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=163b29260d1f4f34a85393162c425fb9)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:02.658093 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129ed6b-8c2b-430e-b1c6-4f75bbbbc835 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:02.810497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8129ed6b-8c2b-430e-b1c6-4f75bbbbc835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '163b29260d1f4f34a85393162c425fb9', 'request_id': 'req-8129ed6b-8c2b-430e-b1c6-4f75bbbbc835'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:02.817859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8129ed6b-8c2b-430e-b1c6-4f75bbbbc835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '163b29260d1f4f34a85393162c425fb9', 'request_id': 'req-8129ed6b-8c2b-430e-b1c6-4f75bbbbc835'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:02.824967 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8129ed6b-8c2b-430e-b1c6-4f75bbbbc835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '163b29260d1f4f34a85393162c425fb9', 'request_id': 'req-8129ed6b-8c2b-430e-b1c6-4f75bbbbc835'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:02.828493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:02.932535 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8129ed6b-8c2b-430e-b1c6-4f75bbbbc835 admin admin] The token cache is being invalidate because project 163b29260d1f4f34a85393162c425fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:17:02.932864 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8129ed6b-8c2b-430e-b1c6-4f75bbbbc835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:02.933489 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8129ed6b-8c2b-430e-b1c6-4f75bbbbc835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:02.935002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1278/2582] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:17:02 2022] DELETE /identity/v3/projects/163b29260d1f4f34a85393162c425fb9 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:02.942294 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee9aa-97fa-4ac0-ad95-a30ee32737c6 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:02.942818 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee9aa-97fa-4ac0-ad95-a30ee32737c6 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:02.943156 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee9aa-97fa-4ac0-ad95-a30ee32737c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:02.965152 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-891ee9aa-97fa-4ac0-ad95-a30ee32737c6 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:02.966373 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-891ee9aa-97fa-4ac0-ad95-a30ee32737c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:03.029887 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1305/2583] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:17:03.038817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ff572-ffa1-4e19-9944-506e3fe2ed4f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:03.039087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ff572-ffa1-4e19-9944-506e3fe2ed4f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:03.039366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ff572-ffa1-4e19-9944-506e3fe2ed4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:03.059266 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4c4ff572-ffa1-4e19-9944-506e3fe2ed4f None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:03.060516 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4c4ff572-ffa1-4e19-9944-506e3fe2ed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:03.068682 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1279/2584] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:03.073808 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ee9aa-97fa-4ac0-ad95-a30ee32737c6 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:03.084040 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ee9aa-97fa-4ac0-ad95-a30ee32737c6 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:03.089957 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970c1de-0f5a-4808-a39b-41116f6120ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:03.095898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970c1de-0f5a-4808-a39b-41116f6120ad admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:03.095898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970c1de-0f5a-4808-a39b-41116f6120ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:03.095898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970c1de-0f5a-4808-a39b-41116f6120ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:03.095898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970c1de-0f5a-4808-a39b-41116f6120ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:17:03.095898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970c1de-0f5a-4808-a39b-41116f6120ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:03.095898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970c1de-0f5a-4808-a39b-41116f6120ad admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:03.101568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:03.107071 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1306/2585] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:17:03.116938 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ff572-ffa1-4e19-9944-506e3fe2ed4f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:03.126323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ff572-ffa1-4e19-9944-506e3fe2ed4f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:03.131555 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a8d00-cd99-4fb9-8a19-4d7257c71a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:03.132140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a8d00-cd99-4fb9-8a19-4d7257c71a3a admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:03.132421 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a8d00-cd99-4fb9-8a19-4d7257c71a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:03.132710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a8d00-cd99-4fb9-8a19-4d7257c71a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:03.133916 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a8d00-cd99-4fb9-8a19-4d7257c71a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:03.135843 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a8d00-cd99-4fb9-8a19-4d7257c71a3a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:03.232153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1280/2586] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:17:03 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:17:03.236329 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970c1de-0f5a-4808-a39b-41116f6120ad admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:03.246330 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970c1de-0f5a-4808-a39b-41116f6120ad admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:03.304050 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba1f32-6d3a-400f-88a1-f48a8729c2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:03.304682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba1f32-6d3a-400f-88a1-f48a8729c2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:03.305598 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba1f32-6d3a-400f-88a1-f48a8729c2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:03.305881 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba1f32-6d3a-400f-88a1-f48a8729c2a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:03.306578 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba1f32-6d3a-400f-88a1-f48a8729c2a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:03.308546 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba1f32-6d3a-400f-88a1-f48a8729c2a3 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:03.413610 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1307/2587] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:17:03 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:17:03.417718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a8d00-cd99-4fb9-8a19-4d7257c71a3a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:03.427994 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a8d00-cd99-4fb9-8a19-4d7257c71a3a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:03.433181 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401a7f3-d349-4dc6-8d24-b7330b3052fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:03.433793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401a7f3-d349-4dc6-8d24-b7330b3052fe admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:03.434077 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401a7f3-d349-4dc6-8d24-b7330b3052fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:03.434385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401a7f3-d349-4dc6-8d24-b7330b3052fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:03.435081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401a7f3-d349-4dc6-8d24-b7330b3052fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:03.436674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401a7f3-d349-4dc6-8d24-b7330b3052fe admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:03.447402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1281/2588] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:03.451345 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba1f32-6d3a-400f-88a1-f48a8729c2a3 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:03.461753 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba1f32-6d3a-400f-88a1-f48a8729c2a3 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:03.466381 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25e8c3-b02c-449e-92dd-ed2e020d64a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:03.466988 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25e8c3-b02c-449e-92dd-ed2e020d64a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:03.467277 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25e8c3-b02c-449e-92dd-ed2e020d64a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:03.467555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25e8c3-b02c-449e-92dd-ed2e020d64a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:03.468246 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25e8c3-b02c-449e-92dd-ed2e020d64a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:03.469905 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25e8c3-b02c-449e-92dd-ed2e020d64a2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:03.480525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1308/2589] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:03.484645 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401a7f3-d349-4dc6-8d24-b7330b3052fe admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:03.495520 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401a7f3-d349-4dc6-8d24-b7330b3052fe admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:03.502121 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159954c-ab98-4305-8b8f-0bce158ea845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:03.502799 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159954c-ab98-4305-8b8f-0bce158ea845 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:03.503107 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159954c-ab98-4305-8b8f-0bce158ea845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:03.503380 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159954c-ab98-4305-8b8f-0bce158ea845 admin admin] PATH_INFO: `/v3/projects/985237c4bf69478baf7128a66c34dcc8/users/466c7f73c90b43a9b1cb68bbb643ddd6/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:03.521473 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159954c-ab98-4305-8b8f-0bce158ea845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985237c4bf69478baf7128a66c34dcc8, user_id=466c7f73c90b43a9b1cb68bbb643ddd6, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:03.524276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159954c-ab98-4305-8b8f-0bce158ea845 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:03.688504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1282/2590] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:17:03 2022] PUT /identity/v3/projects/985237c4bf69478baf7128a66c34dcc8/users/466c7f73c90b43a9b1cb68bbb643ddd6/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:17:03.699230 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2f918-a797-472f-b71e-d103ba5c9a78 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:03.699526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2f918-a797-472f-b71e-d103ba5c9a78 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:03.699806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2f918-a797-472f-b71e-d103ba5c9a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:03.728501 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-06a2f918-a797-472f-b71e-d103ba5c9a78 None None] MFA Rules not processed for user `466c7f73c90b43a9b1cb68bbb643ddd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:03.731156 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-06a2f918-a797-472f-b71e-d103ba5c9a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:03.799999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1309/2591] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:03.812436 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159954c-ab98-4305-8b8f-0bce158ea845 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:03.814178 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0159954c-ab98-4305-8b8f-0bce158ea845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:03.879970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159954c-ab98-4305-8b8f-0bce158ea845 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:03.879970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76970ce0-bef3-4b3a-9d21-12d017150e58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:03.879970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76970ce0-bef3-4b3a-9d21-12d017150e58 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:03.879970 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76970ce0-bef3-4b3a-9d21-12d017150e58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:03.880356 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76970ce0-bef3-4b3a-9d21-12d017150e58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:03.888368 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76970ce0-bef3-4b3a-9d21-12d017150e58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:03.889788 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76970ce0-bef3-4b3a-9d21-12d017150e58 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:03.899619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1283/2592] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:13.796923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:13.894742 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=55,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:23.946507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2f918-a797-472f-b71e-d103ba5c9a78 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:23.947988 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-06a2f918-a797-472f-b71e-d103ba5c9a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:24.023083 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2f918-a797-472f-b71e-d103ba5c9a78 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:24.028507 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151472c-eb7d-4e6c-bb96-487389d03261 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:24.029160 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151472c-eb7d-4e6c-bb96-487389d03261 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:24.029446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151472c-eb7d-4e6c-bb96-487389d03261 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:24.029728 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151472c-eb7d-4e6c-bb96-487389d03261 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:24.031499 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a151472c-eb7d-4e6c-bb96-487389d03261 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:24.113192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151472c-eb7d-4e6c-bb96-487389d03261 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:24.114737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151472c-eb7d-4e6c-bb96-487389d03261 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:24.133492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1310/2593] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:24.301513 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76970ce0-bef3-4b3a-9d21-12d017150e58 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:24.367126 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76970ce0-bef3-4b3a-9d21-12d017150e58 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:24.371726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cfe7c-6633-45cc-a657-1fc71c030007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:24.372362 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cfe7c-6633-45cc-a657-1fc71c030007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:24.372642 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cfe7c-6633-45cc-a657-1fc71c030007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:24.372946 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cfe7c-6633-45cc-a657-1fc71c030007 admin admin] PATH_INFO: `/v3/users/466c7f73c90b43a9b1cb68bbb643ddd6` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:24.374121 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104cfe7c-6633-45cc-a657-1fc71c030007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=466c7f73c90b43a9b1cb68bbb643ddd6)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:24.376140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104cfe7c-6633-45cc-a657-1fc71c030007 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:24.619721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-104cfe7c-6633-45cc-a657-1fc71c030007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '466c7f73c90b43a9b1cb68bbb643ddd6'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:24.620286 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-104cfe7c-6633-45cc-a657-1fc71c030007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '466c7f73c90b43a9b1cb68bbb643ddd6'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:24.633243 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-104cfe7c-6633-45cc-a657-1fc71c030007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '466c7f73c90b43a9b1cb68bbb643ddd6'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:24.640285 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-104cfe7c-6633-45cc-a657-1fc71c030007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '466c7f73c90b43a9b1cb68bbb643ddd6'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:24.640974 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-104cfe7c-6633-45cc-a657-1fc71c030007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '466c7f73c90b43a9b1cb68bbb643ddd6'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:24.748531 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1284/2594] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:17:24 2022] DELETE /identity/v3/users/466c7f73c90b43a9b1cb68bbb643ddd6 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:17:24.753145 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608588e-adae-4933-a602-8d21af7286f9 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:24.753442 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608588e-adae-4933-a602-8d21af7286f9 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:24.753724 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608588e-adae-4933-a602-8d21af7286f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:24.783370 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-3608588e-adae-4933-a602-8d21af7286f9 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:24.783370 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3608588e-adae-4933-a602-8d21af7286f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:24.845786 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1311/2595] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:24.856570 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cfe7c-6633-45cc-a657-1fc71c030007 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:24.858006 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-104cfe7c-6633-45cc-a657-1fc71c030007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:24.919344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cfe7c-6633-45cc-a657-1fc71c030007 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:24.922923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142eb187-f31f-4926-ab72-136cb58feb35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:24.923544 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142eb187-f31f-4926-ab72-136cb58feb35 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:24.923828 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142eb187-f31f-4926-ab72-136cb58feb35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:24.924105 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142eb187-f31f-4926-ab72-136cb58feb35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:24.933265 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142eb187-f31f-4926-ab72-136cb58feb35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:24.934733 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142eb187-f31f-4926-ab72-136cb58feb35 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:24.944303 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1285/2596] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:17:25.385984 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608588e-adae-4933-a602-8d21af7286f9 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:25.388077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3608588e-adae-4933-a602-8d21af7286f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:25.403880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608588e-adae-4933-a602-8d21af7286f9 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:25.411560 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40054dc2-da1b-4412-861f-5bbd91a449c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:25.411560 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40054dc2-da1b-4412-861f-5bbd91a449c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:25.411560 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40054dc2-da1b-4412-861f-5bbd91a449c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:25.411560 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40054dc2-da1b-4412-861f-5bbd91a449c2 admin admin] PATH_INFO: `/v3/projects/985237c4bf69478baf7128a66c34dcc8` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:25.411962 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40054dc2-da1b-4412-861f-5bbd91a449c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=985237c4bf69478baf7128a66c34dcc8)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:25.414335 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40054dc2-da1b-4412-861f-5bbd91a449c2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:25.417107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:25.521191 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-40054dc2-da1b-4412-861f-5bbd91a449c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985237c4bf69478baf7128a66c34dcc8', 'request_id': 'req-40054dc2-da1b-4412-861f-5bbd91a449c2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:25.590527 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-40054dc2-da1b-4412-861f-5bbd91a449c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985237c4bf69478baf7128a66c34dcc8', 'request_id': 'req-40054dc2-da1b-4412-861f-5bbd91a449c2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:25.596951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-40054dc2-da1b-4412-861f-5bbd91a449c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985237c4bf69478baf7128a66c34dcc8', 'request_id': 'req-40054dc2-da1b-4412-861f-5bbd91a449c2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:25.608416 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-40054dc2-da1b-4412-861f-5bbd91a449c2 admin admin] The token cache is being invalidate because project 985237c4bf69478baf7128a66c34dcc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:17:25.612485 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-40054dc2-da1b-4412-861f-5bbd91a449c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:25.612485 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-40054dc2-da1b-4412-861f-5bbd91a449c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:25.612485 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1312/2597] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:17:25 2022] DELETE /identity/v3/projects/985237c4bf69478baf7128a66c34dcc8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:17:25.616112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36589766-dd59-46d6-add7-10ae90299993 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:25.616594 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36589766-dd59-46d6-add7-10ae90299993 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:25.616860 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36589766-dd59-46d6-add7-10ae90299993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:25.635968 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-36589766-dd59-46d6-add7-10ae90299993 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:25.637785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-36589766-dd59-46d6-add7-10ae90299993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:25.654946 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:25.700161 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1286/2598] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:17:25.708907 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfe27f-f05a-4f24-81ca-ce2ed4b0040f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:25.709196 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfe27f-f05a-4f24-81ca-ce2ed4b0040f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:25.709471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfe27f-f05a-4f24-81ca-ce2ed4b0040f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:25.729078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4fcfe27f-f05a-4f24-81ca-ce2ed4b0040f None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:25.730285 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4fcfe27f-f05a-4f24-81ca-ce2ed4b0040f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:25.738611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1313/2599] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:25.744019 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36589766-dd59-46d6-add7-10ae90299993 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:25.754163 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36589766-dd59-46d6-add7-10ae90299993 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:25.758923 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a5d3a-6b59-46ca-a6c4-98a902091a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:25.763841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a5d3a-6b59-46ca-a6c4-98a902091a2a admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:25.763841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a5d3a-6b59-46ca-a6c4-98a902091a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:25.763841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a5d3a-6b59-46ca-a6c4-98a902091a2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:25.763841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a5d3a-6b59-46ca-a6c4-98a902091a2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:17:25.763841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a5d3a-6b59-46ca-a6c4-98a902091a2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:25.764289 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a5d3a-6b59-46ca-a6c4-98a902091a2a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:25.775503 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1287/2600] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:17:25.779850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfe27f-f05a-4f24-81ca-ce2ed4b0040f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:25.789165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfe27f-f05a-4f24-81ca-ce2ed4b0040f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:25.793931 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bbcc1-742b-40b6-8619-323273322454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:25.794537 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bbcc1-742b-40b6-8619-323273322454 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:25.794815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bbcc1-742b-40b6-8619-323273322454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:25.795085 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bbcc1-742b-40b6-8619-323273322454 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:25.795744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bbcc1-742b-40b6-8619-323273322454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:25.798656 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bbcc1-742b-40b6-8619-323273322454 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:25.915792 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1314/2601] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:17:25 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:17:25.919939 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a5d3a-6b59-46ca-a6c4-98a902091a2a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:25.930038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a5d3a-6b59-46ca-a6c4-98a902091a2a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:25.987813 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe88ca-c00c-4fd2-a10e-03e6543eeac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:25.988421 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe88ca-c00c-4fd2-a10e-03e6543eeac2 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:25.988701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe88ca-c00c-4fd2-a10e-03e6543eeac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:25.989191 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe88ca-c00c-4fd2-a10e-03e6543eeac2 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:25.989869 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe88ca-c00c-4fd2-a10e-03e6543eeac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:25.991821 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe88ca-c00c-4fd2-a10e-03e6543eeac2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:26.081117 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1288/2602] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:17:25 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:17:26.086484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bbcc1-742b-40b6-8619-323273322454 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:26.097210 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bbcc1-742b-40b6-8619-323273322454 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:26.101913 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421e84c-dbdb-41b8-b32b-0578aa8eeb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:26.104429 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421e84c-dbdb-41b8-b32b-0578aa8eeb5a admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:26.104429 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421e84c-dbdb-41b8-b32b-0578aa8eeb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:26.104429 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421e84c-dbdb-41b8-b32b-0578aa8eeb5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:26.104429 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421e84c-dbdb-41b8-b32b-0578aa8eeb5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:26.106044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421e84c-dbdb-41b8-b32b-0578aa8eeb5a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:26.116643 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1315/2603] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:26.120213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe88ca-c00c-4fd2-a10e-03e6543eeac2 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:26.131254 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe88ca-c00c-4fd2-a10e-03e6543eeac2 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:26.136116 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2019b7-4f3c-4aa6-9431-adc99fdb5a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:26.138953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2019b7-4f3c-4aa6-9431-adc99fdb5a59 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:26.138953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2019b7-4f3c-4aa6-9431-adc99fdb5a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:26.138953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2019b7-4f3c-4aa6-9431-adc99fdb5a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:26.138953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2019b7-4f3c-4aa6-9431-adc99fdb5a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:26.139841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2019b7-4f3c-4aa6-9431-adc99fdb5a59 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:26.151899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1289/2604] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:26.159063 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421e84c-dbdb-41b8-b32b-0578aa8eeb5a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:26.169851 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421e84c-dbdb-41b8-b32b-0578aa8eeb5a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:26.174735 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01723ce1-26fc-4a54-b9f0-b4fe708af741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:26.175399 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01723ce1-26fc-4a54-b9f0-b4fe708af741 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:26.175686 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01723ce1-26fc-4a54-b9f0-b4fe708af741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:26.175964 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01723ce1-26fc-4a54-b9f0-b4fe708af741 admin admin] PATH_INFO: `/v3/projects/562226c1518649dd839b8208cb310df3/users/fb8b74e89d1045a4a9d3dc9fc7270a30/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:26.191401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01723ce1-26fc-4a54-b9f0-b4fe708af741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=562226c1518649dd839b8208cb310df3, user_id=fb8b74e89d1045a4a9d3dc9fc7270a30, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:26.194161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01723ce1-26fc-4a54-b9f0-b4fe708af741 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:26.264447 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1316/2605] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:17:26 2022] PUT /identity/v3/projects/562226c1518649dd839b8208cb310df3/users/fb8b74e89d1045a4a9d3dc9fc7270a30/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:26.274636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63debf18-9825-40c6-affd-361e554e4901 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:26.275235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63debf18-9825-40c6-affd-361e554e4901 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:26.275235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63debf18-9825-40c6-affd-361e554e4901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:26.303722 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-63debf18-9825-40c6-affd-361e554e4901 None None] MFA Rules not processed for user `fb8b74e89d1045a4a9d3dc9fc7270a30`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:26.304981 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-63debf18-9825-40c6-affd-361e554e4901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:26.374853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1290/2606] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:26.385833 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01723ce1-26fc-4a54-b9f0-b4fe708af741 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:26.387614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-01723ce1-26fc-4a54-b9f0-b4fe708af741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:26.448869 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01723ce1-26fc-4a54-b9f0-b4fe708af741 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:26.452573 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561205e-fd57-4256-a9ad-e89eeb18bb32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:26.453613 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561205e-fd57-4256-a9ad-e89eeb18bb32 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:26.453613 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561205e-fd57-4256-a9ad-e89eeb18bb32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:26.453817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561205e-fd57-4256-a9ad-e89eeb18bb32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:26.462070 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561205e-fd57-4256-a9ad-e89eeb18bb32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:26.463525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561205e-fd57-4256-a9ad-e89eeb18bb32 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:26.472983 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1317/2607] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:31.005911 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63debf18-9825-40c6-affd-361e554e4901 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:31.010364 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-63debf18-9825-40c6-affd-361e554e4901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:31.020414 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63debf18-9825-40c6-affd-361e554e4901 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:31.024642 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21792f9f-2a4a-44cb-b464-b629116ecc5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:31.025314 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21792f9f-2a4a-44cb-b464-b629116ecc5c service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:31.025595 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21792f9f-2a4a-44cb-b464-b629116ecc5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:31.025870 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21792f9f-2a4a-44cb-b464-b629116ecc5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:31.028384 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-21792f9f-2a4a-44cb-b464-b629116ecc5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:31.048296 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:31.121662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21792f9f-2a4a-44cb-b464-b629116ecc5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:31.123133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21792f9f-2a4a-44cb-b464-b629116ecc5c service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:31.141918 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1291/2608] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:17:31.518183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561205e-fd57-4256-a9ad-e89eeb18bb32 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:31.551904 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:31.582587 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561205e-fd57-4256-a9ad-e89eeb18bb32 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:31.588271 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c07f9-fcb1-4c4e-a4bd-82d6284988b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:31.588967 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c07f9-fcb1-4c4e-a4bd-82d6284988b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:31.589258 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c07f9-fcb1-4c4e-a4bd-82d6284988b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:31.589544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c07f9-fcb1-4c4e-a4bd-82d6284988b0 admin admin] PATH_INFO: `/v3/users/fb8b74e89d1045a4a9d3dc9fc7270a30` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:31.590932 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c07f9-fcb1-4c4e-a4bd-82d6284988b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb8b74e89d1045a4a9d3dc9fc7270a30)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:31.593433 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c07f9-fcb1-4c4e-a4bd-82d6284988b0 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:31.848160 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-678c07f9-fcb1-4c4e-a4bd-82d6284988b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb8b74e89d1045a4a9d3dc9fc7270a30'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:31.932406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-678c07f9-fcb1-4c4e-a4bd-82d6284988b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb8b74e89d1045a4a9d3dc9fc7270a30'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:31.946933 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-678c07f9-fcb1-4c4e-a4bd-82d6284988b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb8b74e89d1045a4a9d3dc9fc7270a30'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:31.954728 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-678c07f9-fcb1-4c4e-a4bd-82d6284988b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb8b74e89d1045a4a9d3dc9fc7270a30'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:31.955437 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-678c07f9-fcb1-4c4e-a4bd-82d6284988b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb8b74e89d1045a4a9d3dc9fc7270a30'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:31.961508 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1318/2609] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:17:31 2022] DELETE /identity/v3/users/fb8b74e89d1045a4a9d3dc9fc7270a30 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:31.966428 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515b20d-75eb-4088-b10c-f4d9c9a8000c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:31.966714 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515b20d-75eb-4088-b10c-f4d9c9a8000c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:31.966990 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515b20d-75eb-4088-b10c-f4d9c9a8000c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:31.986100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c515b20d-75eb-4088-b10c-f4d9c9a8000c None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:31.987566 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c515b20d-75eb-4088-b10c-f4d9c9a8000c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:32.045850 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1292/2610] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:32.055476 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c07f9-fcb1-4c4e-a4bd-82d6284988b0 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:32.056930 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-678c07f9-fcb1-4c4e-a4bd-82d6284988b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:32.116065 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c07f9-fcb1-4c4e-a4bd-82d6284988b0 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:32.119719 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8a86d-f802-4c8e-ac6a-07c618290925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:32.120342 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8a86d-f802-4c8e-ac6a-07c618290925 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:32.120741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8a86d-f802-4c8e-ac6a-07c618290925 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:32.121068 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8a86d-f802-4c8e-ac6a-07c618290925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:32.130160 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8a86d-f802-4c8e-ac6a-07c618290925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:32.131654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8a86d-f802-4c8e-ac6a-07c618290925 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:32.141697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1319/2611] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:32.606499 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515b20d-75eb-4088-b10c-f4d9c9a8000c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:32.608053 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c515b20d-75eb-4088-b10c-f4d9c9a8000c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:32.620400 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515b20d-75eb-4088-b10c-f4d9c9a8000c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:32.626112 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc0c1b-e932-4523-a053-204bf80dfb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:32.626775 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc0c1b-e932-4523-a053-204bf80dfb44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:32.627084 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc0c1b-e932-4523-a053-204bf80dfb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:32.627330 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc0c1b-e932-4523-a053-204bf80dfb44 admin admin] PATH_INFO: `/v3/projects/562226c1518649dd839b8208cb310df3` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:32.628643 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc0c1b-e932-4523-a053-204bf80dfb44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=562226c1518649dd839b8208cb310df3)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:32.630616 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc0c1b-e932-4523-a053-204bf80dfb44 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:32.768257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a2cc0c1b-e932-4523-a053-204bf80dfb44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '562226c1518649dd839b8208cb310df3', 'request_id': 'req-a2cc0c1b-e932-4523-a053-204bf80dfb44'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:32.774033 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a2cc0c1b-e932-4523-a053-204bf80dfb44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '562226c1518649dd839b8208cb310df3', 'request_id': 'req-a2cc0c1b-e932-4523-a053-204bf80dfb44'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:32.780906 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a2cc0c1b-e932-4523-a053-204bf80dfb44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '562226c1518649dd839b8208cb310df3', 'request_id': 'req-a2cc0c1b-e932-4523-a053-204bf80dfb44'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:32.850315 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a2cc0c1b-e932-4523-a053-204bf80dfb44 admin admin] The token cache is being invalidate because project 562226c1518649dd839b8208cb310df3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:17:32.850520 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a2cc0c1b-e932-4523-a053-204bf80dfb44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:32.851160 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a2cc0c1b-e932-4523-a053-204bf80dfb44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:32.852706 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1293/2612] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:17:32 2022] DELETE /identity/v3/projects/562226c1518649dd839b8208cb310df3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:32.858338 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace01234-8444-4a97-ac75-e8a35ce6847e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:32.858794 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace01234-8444-4a97-ac75-e8a35ce6847e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:32.858896 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace01234-8444-4a97-ac75-e8a35ce6847e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:32.879165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-ace01234-8444-4a97-ac75-e8a35ce6847e None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:32.880390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ace01234-8444-4a97-ac75-e8a35ce6847e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:32.927566 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:32.941067 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1320/2613] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:32.948959 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96530d2f-3749-49d8-8bc2-556bcad56001 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:32.949253 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96530d2f-3749-49d8-8bc2-556bcad56001 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:32.949534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96530d2f-3749-49d8-8bc2-556bcad56001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:32.969312 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-96530d2f-3749-49d8-8bc2-556bcad56001 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:32.970523 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-96530d2f-3749-49d8-8bc2-556bcad56001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:32.979168 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1294/2614] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:32.984227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace01234-8444-4a97-ac75-e8a35ce6847e None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:32.994363 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace01234-8444-4a97-ac75-e8a35ce6847e None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:33.000349 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744686e-9751-40a1-bf02-3b4dac26d327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:33.001142 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744686e-9751-40a1-bf02-3b4dac26d327 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:33.001517 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744686e-9751-40a1-bf02-3b4dac26d327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:33.001862 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744686e-9751-40a1-bf02-3b4dac26d327 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:33.002636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744686e-9751-40a1-bf02-3b4dac26d327 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:17:33.003015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744686e-9751-40a1-bf02-3b4dac26d327 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:33.004778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744686e-9751-40a1-bf02-3b4dac26d327 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:33.020668 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1321/2615] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:17:33.021887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96530d2f-3749-49d8-8bc2-556bcad56001 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:33.027920 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:33.031570 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96530d2f-3749-49d8-8bc2-556bcad56001 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:33.037170 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d01f73-cfe2-440a-a3e5-b66a7e8380f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:33.037897 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d01f73-cfe2-440a-a3e5-b66a7e8380f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:33.038296 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d01f73-cfe2-440a-a3e5-b66a7e8380f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:33.038578 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d01f73-cfe2-440a-a3e5-b66a7e8380f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:33.039248 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d01f73-cfe2-440a-a3e5-b66a7e8380f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:33.041175 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d01f73-cfe2-440a-a3e5-b66a7e8380f9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:33.134317 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1295/2616] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:17:33 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:17:33.138571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744686e-9751-40a1-bf02-3b4dac26d327 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:33.148415 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744686e-9751-40a1-bf02-3b4dac26d327 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:33.209174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d353d25-f543-412a-b2da-8f63bd650929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:33.209795 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d353d25-f543-412a-b2da-8f63bd650929 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:33.210077 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d353d25-f543-412a-b2da-8f63bd650929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:33.210356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d353d25-f543-412a-b2da-8f63bd650929 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:33.211087 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d353d25-f543-412a-b2da-8f63bd650929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:33.213265 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d353d25-f543-412a-b2da-8f63bd650929 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:33.316927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1322/2617] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:17:33 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:17:33.318515 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d01f73-cfe2-440a-a3e5-b66a7e8380f9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:33.329421 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d01f73-cfe2-440a-a3e5-b66a7e8380f9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:33.334214 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff3685-fdb5-446c-a447-18dd3356a6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:33.334852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff3685-fdb5-446c-a447-18dd3356a6bb admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:33.335138 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff3685-fdb5-446c-a447-18dd3356a6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:33.335416 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff3685-fdb5-446c-a447-18dd3356a6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:33.336249 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff3685-fdb5-446c-a447-18dd3356a6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:33.337912 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff3685-fdb5-446c-a447-18dd3356a6bb admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:33.349999 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1296/2618] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:33.354727 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d353d25-f543-412a-b2da-8f63bd650929 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:33.366146 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d353d25-f543-412a-b2da-8f63bd650929 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:33.370743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6986c-1ae5-4bba-b236-07965fd53bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:33.371353 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6986c-1ae5-4bba-b236-07965fd53bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:33.377161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6986c-1ae5-4bba-b236-07965fd53bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:33.377161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6986c-1ae5-4bba-b236-07965fd53bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:33.377161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6986c-1ae5-4bba-b236-07965fd53bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:33.377161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6986c-1ae5-4bba-b236-07965fd53bf8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:33.385393 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1323/2619] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:33.389700 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff3685-fdb5-446c-a447-18dd3356a6bb admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:33.399873 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff3685-fdb5-446c-a447-18dd3356a6bb admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:33.405249 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e2975-8fd4-4f83-b70b-ccd65f58f413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:33.405924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e2975-8fd4-4f83-b70b-ccd65f58f413 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:33.406242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e2975-8fd4-4f83-b70b-ccd65f58f413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:33.406527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e2975-8fd4-4f83-b70b-ccd65f58f413 admin admin] PATH_INFO: `/v3/projects/9fd33d55197a497790a349d4c26fdad9/users/e5e7655dae404be8969c3c8c576bd71f/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:33.421954 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e2975-8fd4-4f83-b70b-ccd65f58f413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd33d55197a497790a349d4c26fdad9, user_id=e5e7655dae404be8969c3c8c576bd71f, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:33.426457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e2975-8fd4-4f83-b70b-ccd65f58f413 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:33.493427 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1297/2620] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:17:33 2022] PUT /identity/v3/projects/9fd33d55197a497790a349d4c26fdad9/users/e5e7655dae404be8969c3c8c576bd71f/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:33.504716 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26978fe-0a98-46cd-9754-9e5639c43754 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:33.505051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26978fe-0a98-46cd-9754-9e5639c43754 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:33.505360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26978fe-0a98-46cd-9754-9e5639c43754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:33.533764 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e26978fe-0a98-46cd-9754-9e5639c43754 None None] MFA Rules not processed for user `e5e7655dae404be8969c3c8c576bd71f`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:33.534978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e26978fe-0a98-46cd-9754-9e5639c43754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:33.600625 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1324/2621] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:33.612343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e2975-8fd4-4f83-b70b-ccd65f58f413 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:33.614196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4a5e2975-8fd4-4f83-b70b-ccd65f58f413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:33.671832 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e2975-8fd4-4f83-b70b-ccd65f58f413 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:33.675472 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f885c3f-1a44-45dd-9b0b-4734693f1d93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:33.676093 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f885c3f-1a44-45dd-9b0b-4734693f1d93 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:33.676378 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f885c3f-1a44-45dd-9b0b-4734693f1d93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:33.676657 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f885c3f-1a44-45dd-9b0b-4734693f1d93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:33.685092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f885c3f-1a44-45dd-9b0b-4734693f1d93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:33.686603 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f885c3f-1a44-45dd-9b0b-4734693f1d93 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:33.696057 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1298/2622] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:35.107838 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26978fe-0a98-46cd-9754-9e5639c43754 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:35.110675 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e26978fe-0a98-46cd-9754-9e5639c43754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:35.171450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:35.209522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26978fe-0a98-46cd-9754-9e5639c43754 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:35.217002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d349144-6cb4-407f-9cfc-33f7bcd948cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:35.220547 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d349144-6cb4-407f-9cfc-33f7bcd948cb service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:35.220547 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d349144-6cb4-407f-9cfc-33f7bcd948cb service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:35.220547 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d349144-6cb4-407f-9cfc-33f7bcd948cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:35.220547 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3d349144-6cb4-407f-9cfc-33f7bcd948cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:35.234989 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d349144-6cb4-407f-9cfc-33f7bcd948cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:35.237519 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d349144-6cb4-407f-9cfc-33f7bcd948cb service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:35.255616 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1325/2623] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:37.881117 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f885c3f-1a44-45dd-9b0b-4734693f1d93 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:37.955693 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f885c3f-1a44-45dd-9b0b-4734693f1d93 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:37.961123 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf32d3-8491-40d2-8d3b-88ca1c3c1c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:37.965805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf32d3-8491-40d2-8d3b-88ca1c3c1c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:37.965805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf32d3-8491-40d2-8d3b-88ca1c3c1c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:37.965805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf32d3-8491-40d2-8d3b-88ca1c3c1c55 admin admin] PATH_INFO: `/v3/users/e5e7655dae404be8969c3c8c576bd71f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:37.965805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf32d3-8491-40d2-8d3b-88ca1c3c1c55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5e7655dae404be8969c3c8c576bd71f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:37.965805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf32d3-8491-40d2-8d3b-88ca1c3c1c55 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:38.175704 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-85bf32d3-8491-40d2-8d3b-88ca1c3c1c55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5e7655dae404be8969c3c8c576bd71f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:38.176543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-85bf32d3-8491-40d2-8d3b-88ca1c3c1c55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5e7655dae404be8969c3c8c576bd71f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:38.184023 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:38.193860 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-85bf32d3-8491-40d2-8d3b-88ca1c3c1c55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5e7655dae404be8969c3c8c576bd71f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:38.203383 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-85bf32d3-8491-40d2-8d3b-88ca1c3c1c55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5e7655dae404be8969c3c8c576bd71f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:38.204213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-85bf32d3-8491-40d2-8d3b-88ca1c3c1c55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5e7655dae404be8969c3c8c576bd71f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:38.313234 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1299/2624] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:17:37 2022] DELETE /identity/v3/users/e5e7655dae404be8969c3c8c576bd71f => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:38.317741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f1574-6220-42a7-93e0-75974917144e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:38.318644 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f1574-6220-42a7-93e0-75974917144e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:38.319228 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f1574-6220-42a7-93e0-75974917144e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:38.340076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-a88f1574-6220-42a7-93e0-75974917144e None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:38.349135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a88f1574-6220-42a7-93e0-75974917144e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:38.414965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1326/2625] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:38.424670 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf32d3-8491-40d2-8d3b-88ca1c3c1c55 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:38.426201 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-85bf32d3-8491-40d2-8d3b-88ca1c3c1c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:38.498070 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf32d3-8491-40d2-8d3b-88ca1c3c1c55 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:38.502722 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1a91f-aaa2-4353-8a99-1c8b08aefdd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:38.503419 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1a91f-aaa2-4353-8a99-1c8b08aefdd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:38.503700 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1a91f-aaa2-4353-8a99-1c8b08aefdd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:38.504629 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1a91f-aaa2-4353-8a99-1c8b08aefdd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:38.519725 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1a91f-aaa2-4353-8a99-1c8b08aefdd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:38.523496 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1a91f-aaa2-4353-8a99-1c8b08aefdd4 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:38.538474 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1300/2626] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:17:39.123492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f1574-6220-42a7-93e0-75974917144e None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:39.127608 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a88f1574-6220-42a7-93e0-75974917144e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:39.141255 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f1574-6220-42a7-93e0-75974917144e None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:39.146237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bc2f8-b0c4-42b3-82d3-e7b6dcbee7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:39.146996 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bc2f8-b0c4-42b3-82d3-e7b6dcbee7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:39.147179 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bc2f8-b0c4-42b3-82d3-e7b6dcbee7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:39.147487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bc2f8-b0c4-42b3-82d3-e7b6dcbee7f3 admin admin] PATH_INFO: `/v3/projects/9fd33d55197a497790a349d4c26fdad9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:39.148664 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bc2f8-b0c4-42b3-82d3-e7b6dcbee7f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fd33d55197a497790a349d4c26fdad9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:39.150755 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bc2f8-b0c4-42b3-82d3-e7b6dcbee7f3 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:39.280353 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-338bc2f8-b0c4-42b3-82d3-e7b6dcbee7f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fd33d55197a497790a349d4c26fdad9', 'request_id': 'req-338bc2f8-b0c4-42b3-82d3-e7b6dcbee7f3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:39.336175 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-338bc2f8-b0c4-42b3-82d3-e7b6dcbee7f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fd33d55197a497790a349d4c26fdad9', 'request_id': 'req-338bc2f8-b0c4-42b3-82d3-e7b6dcbee7f3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:39.343400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-338bc2f8-b0c4-42b3-82d3-e7b6dcbee7f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fd33d55197a497790a349d4c26fdad9', 'request_id': 'req-338bc2f8-b0c4-42b3-82d3-e7b6dcbee7f3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:39.356107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-338bc2f8-b0c4-42b3-82d3-e7b6dcbee7f3 admin admin] The token cache is being invalidate because project 9fd33d55197a497790a349d4c26fdad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:17:39.356395 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-338bc2f8-b0c4-42b3-82d3-e7b6dcbee7f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:39.357075 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-338bc2f8-b0c4-42b3-82d3-e7b6dcbee7f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:39.358832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1327/2627] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:17:39 2022] DELETE /identity/v3/projects/9fd33d55197a497790a349d4c26fdad9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:39.364269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1fda1-8e52-46a0-8de0-f094c15c5d68 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:39.364783 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1fda1-8e52-46a0-8de0-f094c15c5d68 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:39.364886 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1fda1-8e52-46a0-8de0-f094c15c5d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:39.384866 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-94f1fda1-8e52-46a0-8de0-f094c15c5d68 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:39.386091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-94f1fda1-8e52-46a0-8de0-f094c15c5d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:39.446849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1301/2628] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:39.454601 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6350d01-7ac6-4fec-b31d-49ee00e70665 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:39.454834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6350d01-7ac6-4fec-b31d-49ee00e70665 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:39.455119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6350d01-7ac6-4fec-b31d-49ee00e70665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:39.475280 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e6350d01-7ac6-4fec-b31d-49ee00e70665 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:39.476498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e6350d01-7ac6-4fec-b31d-49ee00e70665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:39.485566 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1328/2629] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:39.496026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1fda1-8e52-46a0-8de0-f094c15c5d68 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:39.506258 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1fda1-8e52-46a0-8de0-f094c15c5d68 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:39.510940 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87001cfb-9806-4f2c-8473-3bf3dd89321c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:39.511567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87001cfb-9806-4f2c-8473-3bf3dd89321c admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:39.511909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87001cfb-9806-4f2c-8473-3bf3dd89321c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:39.512189 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87001cfb-9806-4f2c-8473-3bf3dd89321c admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:39.513043 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87001cfb-9806-4f2c-8473-3bf3dd89321c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:17:39.513358 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87001cfb-9806-4f2c-8473-3bf3dd89321c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:39.516543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87001cfb-9806-4f2c-8473-3bf3dd89321c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:39.527225 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1302/2630] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:17:39.531905 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6350d01-7ac6-4fec-b31d-49ee00e70665 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:39.541428 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6350d01-7ac6-4fec-b31d-49ee00e70665 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:39.547200 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0c8a7-726e-447f-8b2d-10d933c2dd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:39.547855 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0c8a7-726e-447f-8b2d-10d933c2dd58 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:39.548142 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0c8a7-726e-447f-8b2d-10d933c2dd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:39.548425 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0c8a7-726e-447f-8b2d-10d933c2dd58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:39.549137 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0c8a7-726e-447f-8b2d-10d933c2dd58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:39.551071 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0c8a7-726e-447f-8b2d-10d933c2dd58 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:39.640956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1329/2631] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:17:39 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:17:39.645208 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87001cfb-9806-4f2c-8473-3bf3dd89321c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:39.656030 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87001cfb-9806-4f2c-8473-3bf3dd89321c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:39.711613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224dc65-0a21-4a7d-9e75-827ce7242ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:39.712208 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224dc65-0a21-4a7d-9e75-827ce7242ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:39.712493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224dc65-0a21-4a7d-9e75-827ce7242ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:39.712793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224dc65-0a21-4a7d-9e75-827ce7242ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:39.713460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224dc65-0a21-4a7d-9e75-827ce7242ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:39.716038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224dc65-0a21-4a7d-9e75-827ce7242ef3 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:39.727784 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:39.802524 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1303/2632] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:17:39 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:17:39.803816 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0c8a7-726e-447f-8b2d-10d933c2dd58 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:39.814611 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0c8a7-726e-447f-8b2d-10d933c2dd58 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:39.819368 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d36ff-6c0d-4ea1-8fba-83e9f263ce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:39.819976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d36ff-6c0d-4ea1-8fba-83e9f263ce2f admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:39.820260 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d36ff-6c0d-4ea1-8fba-83e9f263ce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:39.820590 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d36ff-6c0d-4ea1-8fba-83e9f263ce2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:39.821331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d36ff-6c0d-4ea1-8fba-83e9f263ce2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:39.822942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d36ff-6c0d-4ea1-8fba-83e9f263ce2f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:39.833550 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1330/2633] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:17:39.837639 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224dc65-0a21-4a7d-9e75-827ce7242ef3 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:39.848255 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224dc65-0a21-4a7d-9e75-827ce7242ef3 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:39.853020 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70294b-dffd-40e5-b8c3-d953ac640b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:39.853630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70294b-dffd-40e5-b8c3-d953ac640b21 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:39.853915 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70294b-dffd-40e5-b8c3-d953ac640b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:39.854194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70294b-dffd-40e5-b8c3-d953ac640b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:39.854890 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70294b-dffd-40e5-b8c3-d953ac640b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:39.856490 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70294b-dffd-40e5-b8c3-d953ac640b21 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:39.867397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1304/2634] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:39.871478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d36ff-6c0d-4ea1-8fba-83e9f263ce2f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:39.881487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d36ff-6c0d-4ea1-8fba-83e9f263ce2f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:39.886192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51d2d3-76b2-4b53-bde4-85c1edcf7157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:39.886868 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51d2d3-76b2-4b53-bde4-85c1edcf7157 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:39.887154 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51d2d3-76b2-4b53-bde4-85c1edcf7157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:39.887431 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51d2d3-76b2-4b53-bde4-85c1edcf7157 admin admin] PATH_INFO: `/v3/projects/777fa66329e644bba31019b0ca4caf35/users/481892300c9041aa9f53c0bfbb4ac226/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:39.902629 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51d2d3-76b2-4b53-bde4-85c1edcf7157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=777fa66329e644bba31019b0ca4caf35, user_id=481892300c9041aa9f53c0bfbb4ac226, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:39.906045 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51d2d3-76b2-4b53-bde4-85c1edcf7157 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:39.908368 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:39.989783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1331/2635] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:17:39 2022] PUT /identity/v3/projects/777fa66329e644bba31019b0ca4caf35/users/481892300c9041aa9f53c0bfbb4ac226/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:17:40.001298 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bb6b4-1e5b-4b17-ba98-23b0cd94b740 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:40.001589 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bb6b4-1e5b-4b17-ba98-23b0cd94b740 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:40.001869 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bb6b4-1e5b-4b17-ba98-23b0cd94b740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:40.030042 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-316bb6b4-1e5b-4b17-ba98-23b0cd94b740 None None] MFA Rules not processed for user `481892300c9041aa9f53c0bfbb4ac226`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:40.031316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-316bb6b4-1e5b-4b17-ba98-23b0cd94b740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:40.115979 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1305/2636] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:40.128720 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51d2d3-76b2-4b53-bde4-85c1edcf7157 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:40.130461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0a51d2d3-76b2-4b53-bde4-85c1edcf7157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:40.188894 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51d2d3-76b2-4b53-bde4-85c1edcf7157 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:40.192469 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b085d-5b8b-4c47-9431-503742ba85ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1837a832a0da4d698984ce62057b81f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:40.193141 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b085d-5b8b-4c47-9431-503742ba85ff service glance] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:40.193432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b085d-5b8b-4c47-9431-503742ba85ff service glance] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:40.193719 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b085d-5b8b-4c47-9431-503742ba85ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:40.204869 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b085d-5b8b-4c47-9431-503742ba85ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:40.206976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b085d-5b8b-4c47-9431-503742ba85ff service glance] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:40.215709 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1332/2637] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:41.802310 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bb6b4-1e5b-4b17-ba98-23b0cd94b740 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:41.803989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-316bb6b4-1e5b-4b17-ba98-23b0cd94b740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:41.863317 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bb6b4-1e5b-4b17-ba98-23b0cd94b740 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:41.866929 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232acbc-06c5-4e18-8849-bfd3c7ca7113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:41.867555 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232acbc-06c5-4e18-8849-bfd3c7ca7113 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:41.867836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232acbc-06c5-4e18-8849-bfd3c7ca7113 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:41.868135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232acbc-06c5-4e18-8849-bfd3c7ca7113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:41.869953 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f232acbc-06c5-4e18-8849-bfd3c7ca7113 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:41.932893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232acbc-06c5-4e18-8849-bfd3c7ca7113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:41.934292 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232acbc-06c5-4e18-8849-bfd3c7ca7113 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:41.944818 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1306/2638] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:45.565823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b085d-5b8b-4c47-9431-503742ba85ff service glance] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:45.577532 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b085d-5b8b-4c47-9431-503742ba85ff service glance] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:45.581402 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1de678-00f4-423a-84c6-b4fc185773f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:45.582029 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1de678-00f4-423a-84c6-b4fc185773f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:45.582343 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1de678-00f4-423a-84c6-b4fc185773f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:45.582580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1de678-00f4-423a-84c6-b4fc185773f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:45.584369 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5c1de678-00f4-423a-84c6-b4fc185773f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:45.597444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1de678-00f4-423a-84c6-b4fc185773f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:45.599450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1de678-00f4-423a-84c6-b4fc185773f6 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:45.617868 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1333/2639] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:45.788392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232acbc-06c5-4e18-8849-bfd3c7ca7113 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:45.789925 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f232acbc-06c5-4e18-8849-bfd3c7ca7113 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:45.803743 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232acbc-06c5-4e18-8849-bfd3c7ca7113 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:45.811250 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948afb4-f202-4e05-8ef6-2b3a7031485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:45.812263 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948afb4-f202-4e05-8ef6-2b3a7031485d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:45.812799 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948afb4-f202-4e05-8ef6-2b3a7031485d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:45.818251 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948afb4-f202-4e05-8ef6-2b3a7031485d admin admin] PATH_INFO: `/v3/users/0130232e2fd44fe09dd82a173da0a12d` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:45.818251 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948afb4-f202-4e05-8ef6-2b3a7031485d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0130232e2fd44fe09dd82a173da0a12d)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:45.818251 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948afb4-f202-4e05-8ef6-2b3a7031485d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:45.839099 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:INSERT=3,keystone:SELECT=96,keystone:DELETE=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:46.002877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d948afb4-f202-4e05-8ef6-2b3a7031485d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0130232e2fd44fe09dd82a173da0a12d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:46.003648 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d948afb4-f202-4e05-8ef6-2b3a7031485d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0130232e2fd44fe09dd82a173da0a12d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:46.021390 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d948afb4-f202-4e05-8ef6-2b3a7031485d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0130232e2fd44fe09dd82a173da0a12d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:46.028429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d948afb4-f202-4e05-8ef6-2b3a7031485d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0130232e2fd44fe09dd82a173da0a12d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:46.029225 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d948afb4-f202-4e05-8ef6-2b3a7031485d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0130232e2fd44fe09dd82a173da0a12d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:46.102273 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1307/2640] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:17:45 2022] DELETE /identity/v3/users/0130232e2fd44fe09dd82a173da0a12d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:46.367618 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1de678-00f4-423a-84c6-b4fc185773f6 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:46.403976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1de678-00f4-423a-84c6-b4fc185773f6 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:46.480337 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b0582-199f-41a9-a8f0-9b121a557312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:46.480977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b0582-199f-41a9-a8f0-9b121a557312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:46.481313 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b0582-199f-41a9-a8f0-9b121a557312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:46.481595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b0582-199f-41a9-a8f0-9b121a557312 admin admin] PATH_INFO: `/v3/projects/a6f352d7ada9490a83075b7fb59c8cec` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:46.482822 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b0582-199f-41a9-a8f0-9b121a557312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f352d7ada9490a83075b7fb59c8cec)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:46.484849 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b0582-199f-41a9-a8f0-9b121a557312 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:46.593769 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-961b0582-199f-41a9-a8f0-9b121a557312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f352d7ada9490a83075b7fb59c8cec', 'request_id': 'req-961b0582-199f-41a9-a8f0-9b121a557312'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:46.668730 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-961b0582-199f-41a9-a8f0-9b121a557312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f352d7ada9490a83075b7fb59c8cec', 'request_id': 'req-961b0582-199f-41a9-a8f0-9b121a557312'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:46.676194 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-961b0582-199f-41a9-a8f0-9b121a557312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f352d7ada9490a83075b7fb59c8cec', 'request_id': 'req-961b0582-199f-41a9-a8f0-9b121a557312'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:46.689177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-961b0582-199f-41a9-a8f0-9b121a557312 admin admin] The token cache is being invalidate because project a6f352d7ada9490a83075b7fb59c8cec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:17:46.697437 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-961b0582-199f-41a9-a8f0-9b121a557312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:46.697437 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-961b0582-199f-41a9-a8f0-9b121a557312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:46.697437 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1334/2641] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:17:46 2022] DELETE /identity/v3/projects/a6f352d7ada9490a83075b7fb59c8cec => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:17:46.697767 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1f6ee-032f-4913-9dec-ef71653a90bd None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:46.697767 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1f6ee-032f-4913-9dec-ef71653a90bd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:46.697767 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1f6ee-032f-4913-9dec-ef71653a90bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:46.723624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a0c1f6ee-032f-4913-9dec-ef71653a90bd None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:46.724910 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a0c1f6ee-032f-4913-9dec-ef71653a90bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:46.805033 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1308/2642] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:46.812124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ca109-41fa-4715-a68f-e629771c7e89 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:46.812426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ca109-41fa-4715-a68f-e629771c7e89 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:46.812727 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ca109-41fa-4715-a68f-e629771c7e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:46.835602 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-184ca109-41fa-4715-a68f-e629771c7e89 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:46.836898 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-184ca109-41fa-4715-a68f-e629771c7e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:46.846558 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1335/2643] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:46.851024 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1f6ee-032f-4913-9dec-ef71653a90bd None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:46.864326 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1f6ee-032f-4913-9dec-ef71653a90bd None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:46.870337 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2691322-17da-45e4-938a-de38d096fa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:46.871100 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2691322-17da-45e4-938a-de38d096fa06 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:46.871453 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2691322-17da-45e4-938a-de38d096fa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:46.871799 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2691322-17da-45e4-938a-de38d096fa06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:46.872617 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2691322-17da-45e4-938a-de38d096fa06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:17:46.873071 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2691322-17da-45e4-938a-de38d096fa06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:46.874821 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2691322-17da-45e4-938a-de38d096fa06 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:46.888256 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1309/2644] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:17:46.892728 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ca109-41fa-4715-a68f-e629771c7e89 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:46.902438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ca109-41fa-4715-a68f-e629771c7e89 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:46.908571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb68af-42aa-475c-8399-a66cb90c9608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:46.909251 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb68af-42aa-475c-8399-a66cb90c9608 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:46.909537 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb68af-42aa-475c-8399-a66cb90c9608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:46.909814 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb68af-42aa-475c-8399-a66cb90c9608 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:46.910510 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb68af-42aa-475c-8399-a66cb90c9608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:46.912460 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb68af-42aa-475c-8399-a66cb90c9608 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:46.917360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:47.035360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1336/2645] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:17:46 2022] POST /identity/v3/projects => generated 405 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:17:47.039605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2691322-17da-45e4-938a-de38d096fa06 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:47.050524 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2691322-17da-45e4-938a-de38d096fa06 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:47.108382 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ace8f-a833-4e06-8bdf-59c3c8787f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:47.109044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ace8f-a833-4e06-8bdf-59c3c8787f0e admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:47.109327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ace8f-a833-4e06-8bdf-59c3c8787f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:47.109602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ace8f-a833-4e06-8bdf-59c3c8787f0e admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:47.110278 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ace8f-a833-4e06-8bdf-59c3c8787f0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:47.112468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ace8f-a833-4e06-8bdf-59c3c8787f0e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:47.220371 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1310/2646] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:17:47 2022] POST /identity/v3/users => generated 303 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:17:47.221306 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb68af-42aa-475c-8399-a66cb90c9608 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:47.231821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb68af-42aa-475c-8399-a66cb90c9608 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:47.236889 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9cc113-a656-44b7-9d24-784986343e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:47.241859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cc113-a656-44b7-9d24-784986343e69 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:47.241859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cc113-a656-44b7-9d24-784986343e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:47.241859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cc113-a656-44b7-9d24-784986343e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:47.241859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9cc113-a656-44b7-9d24-784986343e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:47.241859 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9cc113-a656-44b7-9d24-784986343e69 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:47.251188 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1337/2647] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:17:47.255093 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ace8f-a833-4e06-8bdf-59c3c8787f0e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:47.266642 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ace8f-a833-4e06-8bdf-59c3c8787f0e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:47.272656 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8507c-abfa-4243-a34d-5daa4d5bdfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:47.273937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8507c-abfa-4243-a34d-5daa4d5bdfbd admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:47.274438 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8507c-abfa-4243-a34d-5daa4d5bdfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:47.274722 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8507c-abfa-4243-a34d-5daa4d5bdfbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:47.275755 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8507c-abfa-4243-a34d-5daa4d5bdfbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:47.277466 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8507c-abfa-4243-a34d-5daa4d5bdfbd admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:47.279426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:47.290640 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1311/2648] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:47.294872 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9cc113-a656-44b7-9d24-784986343e69 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:47.305181 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9cc113-a656-44b7-9d24-784986343e69 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:47.310830 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3fe00-5d4a-4b19-bfa9-d55d1814d095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:47.311552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3fe00-5d4a-4b19-bfa9-d55d1814d095 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:47.312001 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3fe00-5d4a-4b19-bfa9-d55d1814d095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:47.312469 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3fe00-5d4a-4b19-bfa9-d55d1814d095 admin admin] PATH_INFO: `/v3/projects/9e8674c9c1be4295bb8038a94b1e4eeb/users/d82f42b0516e4354bd32140f96771f88/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:47.332191 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3fe00-5d4a-4b19-bfa9-d55d1814d095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8674c9c1be4295bb8038a94b1e4eeb, user_id=d82f42b0516e4354bd32140f96771f88, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:47.338518 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3fe00-5d4a-4b19-bfa9-d55d1814d095 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:47.408627 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1338/2649] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:17:47 2022] PUT /identity/v3/projects/9e8674c9c1be4295bb8038a94b1e4eeb/users/d82f42b0516e4354bd32140f96771f88/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:17:47.421343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfe73e-6404-4b0b-97ad-533ca5c87160 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:47.421343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfe73e-6404-4b0b-97ad-533ca5c87160 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:47.421343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfe73e-6404-4b0b-97ad-533ca5c87160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:47.443083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e5bfe73e-6404-4b0b-97ad-533ca5c87160 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:47.444577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e5bfe73e-6404-4b0b-97ad-533ca5c87160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:47.523237 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1312/2650] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:17:47.534958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3fe00-5d4a-4b19-bfa9-d55d1814d095 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:47.537647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bfe3fe00-5d4a-4b19-bfa9-d55d1814d095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:47.611820 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3fe00-5d4a-4b19-bfa9-d55d1814d095 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:47.616819 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b1d5a-534a-49cd-85c8-086d51e390ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:47.617650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b1d5a-534a-49cd-85c8-086d51e390ba service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:47.618007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b1d5a-534a-49cd-85c8-086d51e390ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:47.618355 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b1d5a-534a-49cd-85c8-086d51e390ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:47.630329 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b1d5a-534a-49cd-85c8-086d51e390ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:47.632443 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b1d5a-534a-49cd-85c8-086d51e390ba service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:47.644884 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1339/2651] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:17:49.097461 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7c30d-91d2-4619-9a7e-8483cb5ab064 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:49.097994 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7c30d-91d2-4619-9a7e-8483cb5ab064 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:49.098092 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7c30d-91d2-4619-9a7e-8483cb5ab064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:49.135221 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7dd7c30d-91d2-4619-9a7e-8483cb5ab064 None None] MFA Rules not processed for user `d82f42b0516e4354bd32140f96771f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:49.136524 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7dd7c30d-91d2-4619-9a7e-8483cb5ab064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:49.238834 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1313/2652] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:49 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:49.243159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b1d5a-534a-49cd-85c8-086d51e390ba service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:49.253729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b1d5a-534a-49cd-85c8-086d51e390ba service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:49.261829 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa487737-906c-445e-839f-117a978998ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:49.263019 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa487737-906c-445e-839f-117a978998ef admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:49.263303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa487737-906c-445e-839f-117a978998ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:49.263581 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa487737-906c-445e-839f-117a978998ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:49.264261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa487737-906c-445e-839f-117a978998ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:49.267231 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa487737-906c-445e-839f-117a978998ef admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:49.392929 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1340/2653] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:17:49 2022] POST /identity/v3/projects => generated 405 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:17:49.394204 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7c30d-91d2-4619-9a7e-8483cb5ab064 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:49.406129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7c30d-91d2-4619-9a7e-8483cb5ab064 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:49.466230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f737e-ba4d-4c4a-a9a6-432ee8d76016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:49.466905 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f737e-ba4d-4c4a-a9a6-432ee8d76016 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:49.467190 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f737e-ba4d-4c4a-a9a6-432ee8d76016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:49.467466 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f737e-ba4d-4c4a-a9a6-432ee8d76016 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:49.468156 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f737e-ba4d-4c4a-a9a6-432ee8d76016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:49.470160 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f737e-ba4d-4c4a-a9a6-432ee8d76016 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:49.630734 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1314/2654] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:17:49 2022] POST /identity/v3/users => generated 309 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:17:49.630839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa487737-906c-445e-839f-117a978998ef admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:49.665317 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa487737-906c-445e-839f-117a978998ef admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:49.665317 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdff98-cbbc-43a2-9f35-ec9ff19878c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:49.665317 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdff98-cbbc-43a2-9f35-ec9ff19878c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:49.665317 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdff98-cbbc-43a2-9f35-ec9ff19878c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:49.665667 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdff98-cbbc-43a2-9f35-ec9ff19878c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:49.665667 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cdff98-cbbc-43a2-9f35-ec9ff19878c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:49.665847 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cdff98-cbbc-43a2-9f35-ec9ff19878c2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:49.680229 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1341/2655] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:49.684700 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f737e-ba4d-4c4a-a9a6-432ee8d76016 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:49.705664 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f737e-ba4d-4c4a-a9a6-432ee8d76016 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:49.712298 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64a08f-c6e6-45ce-8ddb-4c54eb734669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:49.713061 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64a08f-c6e6-45ce-8ddb-4c54eb734669 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:49.713349 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64a08f-c6e6-45ce-8ddb-4c54eb734669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:49.713627 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64a08f-c6e6-45ce-8ddb-4c54eb734669 admin admin] PATH_INFO: `/v3/projects/0eaf7faf5cbe4491b4e18672e5d4a0ae/users/9040c4dd2b424ff8bd89dfee2bc2cb5a/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:49.728288 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:49.732164 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64a08f-c6e6-45ce-8ddb-4c54eb734669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaf7faf5cbe4491b4e18672e5d4a0ae, user_id=9040c4dd2b424ff8bd89dfee2bc2cb5a, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:49.735454 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64a08f-c6e6-45ce-8ddb-4c54eb734669 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:49.833928 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1315/2656] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:17:49 2022] PUT /identity/v3/projects/0eaf7faf5cbe4491b4e18672e5d4a0ae/users/9040c4dd2b424ff8bd89dfee2bc2cb5a/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:17:49.838175 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdff98-cbbc-43a2-9f35-ec9ff19878c2 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:49.849065 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdff98-cbbc-43a2-9f35-ec9ff19878c2 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:49.869626 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64a08f-c6e6-45ce-8ddb-4c54eb734669 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:49.871427 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3c64a08f-c6e6-45ce-8ddb-4c54eb734669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:49.932330 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfae518-e411-4f22-a392-5dbf374facc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:49.933314 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfae518-e411-4f22-a392-5dbf374facc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:49.933314 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfae518-e411-4f22-a392-5dbf374facc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:49.933542 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfae518-e411-4f22-a392-5dbf374facc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:49.934391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfae518-e411-4f22-a392-5dbf374facc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:49.935930 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfae518-e411-4f22-a392-5dbf374facc4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:49.946819 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1342/2657] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:49.951473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfae518-e411-4f22-a392-5dbf374facc4 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:49.962296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfae518-e411-4f22-a392-5dbf374facc4 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:49.967983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64a08f-c6e6-45ce-8ddb-4c54eb734669 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:49.969373 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d32093-8678-4d56-a8ea-e748c568b3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:49.970172 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d32093-8678-4d56-a8ea-e748c568b3c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:49.970561 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d32093-8678-4d56-a8ea-e748c568b3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:49.970880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d32093-8678-4d56-a8ea-e748c568b3c7 admin admin] PATH_INFO: `/v3/projects/0eaf7faf5cbe4491b4e18672e5d4a0ae/users/9040c4dd2b424ff8bd89dfee2bc2cb5a/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:49.973013 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d32093-8678-4d56-a8ea-e748c568b3c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaf7faf5cbe4491b4e18672e5d4a0ae, user_id=9040c4dd2b424ff8bd89dfee2bc2cb5a, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:49.973256 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d3ea3-a5c0-4038-a067-514493344859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:49.973993 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d3ea3-a5c0-4038-a067-514493344859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:49.974352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d3ea3-a5c0-4038-a067-514493344859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:49.974702 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d3ea3-a5c0-4038-a067-514493344859 admin admin] PATH_INFO: `/v3/users/922506341d4a43c4a5f0cf9f610c4b5f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:49.976001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d3ea3-a5c0-4038-a067-514493344859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=922506341d4a43c4a5f0cf9f610c4b5f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:49.976129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d32093-8678-4d56-a8ea-e748c568b3c7 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:49.978171 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d3ea3-a5c0-4038-a067-514493344859 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:49.991343 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1343/2658] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:17:49 2022] PUT /identity/v3/projects/0eaf7faf5cbe4491b4e18672e5d4a0ae/users/9040c4dd2b424ff8bd89dfee2bc2cb5a/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:50.193997 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0f5d3ea3-a5c0-4038-a067-514493344859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '922506341d4a43c4a5f0cf9f610c4b5f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:50.197009 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0f5d3ea3-a5c0-4038-a067-514493344859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '922506341d4a43c4a5f0cf9f610c4b5f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:50.212414 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0f5d3ea3-a5c0-4038-a067-514493344859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '922506341d4a43c4a5f0cf9f610c4b5f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:50.219835 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0f5d3ea3-a5c0-4038-a067-514493344859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '922506341d4a43c4a5f0cf9f610c4b5f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:50.220606 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0f5d3ea3-a5c0-4038-a067-514493344859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '922506341d4a43c4a5f0cf9f610c4b5f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:50.304259 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1316/2659] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:17:49 2022] DELETE /identity/v3/users/922506341d4a43c4a5f0cf9f610c4b5f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:17:50.574218 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d32093-8678-4d56-a8ea-e748c568b3c7 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:50.576895 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-28d32093-8678-4d56-a8ea-e748c568b3c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:50.582824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:50.663444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d32093-8678-4d56-a8ea-e748c568b3c7 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:50.728858 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb9e35-4475-4090-95b9-0f2a419f31e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:50.729522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb9e35-4475-4090-95b9-0f2a419f31e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:50.729808 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb9e35-4475-4090-95b9-0f2a419f31e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:50.730088 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb9e35-4475-4090-95b9-0f2a419f31e4 admin admin] PATH_INFO: `/v3/projects/0092634549c047ec9936926fec4cee98` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:50.731814 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb9e35-4475-4090-95b9-0f2a419f31e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0092634549c047ec9936926fec4cee98)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:50.733844 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb9e35-4475-4090-95b9-0f2a419f31e4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:50.849827 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bfdb9e35-4475-4090-95b9-0f2a419f31e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0092634549c047ec9936926fec4cee98', 'request_id': 'req-bfdb9e35-4475-4090-95b9-0f2a419f31e4'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:50.927020 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bfdb9e35-4475-4090-95b9-0f2a419f31e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0092634549c047ec9936926fec4cee98', 'request_id': 'req-bfdb9e35-4475-4090-95b9-0f2a419f31e4'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:50.933713 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bfdb9e35-4475-4090-95b9-0f2a419f31e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0092634549c047ec9936926fec4cee98', 'request_id': 'req-bfdb9e35-4475-4090-95b9-0f2a419f31e4'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:50.947049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bfdb9e35-4475-4090-95b9-0f2a419f31e4 admin admin] The token cache is being invalidate because project 0092634549c047ec9936926fec4cee98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:17:50.947340 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bfdb9e35-4475-4090-95b9-0f2a419f31e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:50.947998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bfdb9e35-4475-4090-95b9-0f2a419f31e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:50.949734 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1344/2660] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:17:50 2022] DELETE /identity/v3/projects/0092634549c047ec9936926fec4cee98 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:50.955839 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443b21f-c306-41a0-89e5-180d7fe8e491 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:50.959792 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443b21f-c306-41a0-89e5-180d7fe8e491 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:50.959792 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443b21f-c306-41a0-89e5-180d7fe8e491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:50.977129 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4443b21f-c306-41a0-89e5-180d7fe8e491 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:50.978346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4443b21f-c306-41a0-89e5-180d7fe8e491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:51.045710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1317/2661] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:51.053867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff5e22-a505-4278-b4d8-d29ca34b13d7 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:51.054161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff5e22-a505-4278-b4d8-d29ca34b13d7 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:51.054446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff5e22-a505-4278-b4d8-d29ca34b13d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:51.074615 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-49ff5e22-a505-4278-b4d8-d29ca34b13d7 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:51.076436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-49ff5e22-a505-4278-b4d8-d29ca34b13d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:51.084455 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1345/2662] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:51.088667 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443b21f-c306-41a0-89e5-180d7fe8e491 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:51.098474 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443b21f-c306-41a0-89e5-180d7fe8e491 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:51.107763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e888d-fa34-4ae6-a971-e92b392becb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:51.107763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e888d-fa34-4ae6-a971-e92b392becb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:51.107763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e888d-fa34-4ae6-a971-e92b392becb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:51.107763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e888d-fa34-4ae6-a971-e92b392becb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:51.108265 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e888d-fa34-4ae6-a971-e92b392becb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:17:51.108265 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e888d-fa34-4ae6-a971-e92b392becb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:51.109117 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e888d-fa34-4ae6-a971-e92b392becb8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:51.117452 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:51.126917 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1318/2663] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:17:51.127997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff5e22-a505-4278-b4d8-d29ca34b13d7 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:51.138045 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff5e22-a505-4278-b4d8-d29ca34b13d7 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:51.142773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f76075-c4f7-4d79-b456-be2e9c042f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:51.143381 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f76075-c4f7-4d79-b456-be2e9c042f1b admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:51.143667 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f76075-c4f7-4d79-b456-be2e9c042f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:51.143943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f76075-c4f7-4d79-b456-be2e9c042f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:51.144632 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f76075-c4f7-4d79-b456-be2e9c042f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:51.146652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f76075-c4f7-4d79-b456-be2e9c042f1b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:51.285118 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1346/2664] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:17:51 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:17:51.297015 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e888d-fa34-4ae6-a971-e92b392becb8 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:51.299299 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4931f82-e02d-4ea2-92e5-85b7f0f70d81 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:51.299577 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4931f82-e02d-4ea2-92e5-85b7f0f70d81 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:51.299907 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4931f82-e02d-4ea2-92e5-85b7f0f70d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:51.301575 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e888d-fa34-4ae6-a971-e92b392becb8 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:51.326482 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:51.334720 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e4931f82-e02d-4ea2-92e5-85b7f0f70d81 None None] MFA Rules not processed for user `9040c4dd2b424ff8bd89dfee2bc2cb5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:51.336695 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e4931f82-e02d-4ea2-92e5-85b7f0f70d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:51.366862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34a8d0-7a15-4c63-b9bb-860c4696a6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:51.367907 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34a8d0-7a15-4c63-b9bb-860c4696a6dd admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:51.368380 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34a8d0-7a15-4c63-b9bb-860c4696a6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:51.368660 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34a8d0-7a15-4c63-b9bb-860c4696a6dd admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:51.369372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34a8d0-7a15-4c63-b9bb-860c4696a6dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:51.374124 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34a8d0-7a15-4c63-b9bb-860c4696a6dd admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:51.423820 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1347/2665] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:51 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:51.491043 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1319/2666] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:17:51 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:17:51.495438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4931f82-e02d-4ea2-92e5-85b7f0f70d81 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:51.507207 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4931f82-e02d-4ea2-92e5-85b7f0f70d81 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:51.512120 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b91c3-4511-4ab5-bdd9-24a11d3bcb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:51.512882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b91c3-4511-4ab5-bdd9-24a11d3bcb50 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:51.513183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b91c3-4511-4ab5-bdd9-24a11d3bcb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:51.513444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b91c3-4511-4ab5-bdd9-24a11d3bcb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:51.514147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b91c3-4511-4ab5-bdd9-24a11d3bcb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:51.515783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b91c3-4511-4ab5-bdd9-24a11d3bcb50 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:51.526702 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1348/2667] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:51.531130 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34a8d0-7a15-4c63-b9bb-860c4696a6dd admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:51.541146 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34a8d0-7a15-4c63-b9bb-860c4696a6dd admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:51.547140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf1e91-41a8-4d4d-a205-d972184ded90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:51.547796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf1e91-41a8-4d4d-a205-d972184ded90 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:51.548082 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf1e91-41a8-4d4d-a205-d972184ded90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:51.548357 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf1e91-41a8-4d4d-a205-d972184ded90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:51.549086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf1e91-41a8-4d4d-a205-d972184ded90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:51.550876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf1e91-41a8-4d4d-a205-d972184ded90 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:51.561729 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1320/2668] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:51.565943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b91c3-4511-4ab5-bdd9-24a11d3bcb50 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:51.576463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b91c3-4511-4ab5-bdd9-24a11d3bcb50 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:51.581423 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2fc9e-2e8d-4252-a580-fc1b0e279e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:51.584882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2fc9e-2e8d-4252-a580-fc1b0e279e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:51.584882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2fc9e-2e8d-4252-a580-fc1b0e279e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:51.584882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2fc9e-2e8d-4252-a580-fc1b0e279e10 admin admin] PATH_INFO: `/v3/projects/2ec549cce605410fa5a81f92b2fc0c88/users/32a619041f40434aaba93fdda6499026/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:51.601361 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2fc9e-2e8d-4252-a580-fc1b0e279e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec549cce605410fa5a81f92b2fc0c88, user_id=32a619041f40434aaba93fdda6499026, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:51.604388 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2fc9e-2e8d-4252-a580-fc1b0e279e10 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:51.690694 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1349/2669] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:17:51 2022] PUT /identity/v3/projects/2ec549cce605410fa5a81f92b2fc0c88/users/32a619041f40434aaba93fdda6499026/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:51.701728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8073b34-4750-4cf4-ad3d-5dd1483d59d9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:51.702023 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8073b34-4750-4cf4-ad3d-5dd1483d59d9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:51.702645 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8073b34-4750-4cf4-ad3d-5dd1483d59d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:51.743598 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d8073b34-4750-4cf4-ad3d-5dd1483d59d9 None None] MFA Rules not processed for user `32a619041f40434aaba93fdda6499026`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:51.744879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d8073b34-4750-4cf4-ad3d-5dd1483d59d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:51.829177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1321/2670] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:51.840595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2fc9e-2e8d-4252-a580-fc1b0e279e10 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:51.842369 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e9f2fc9e-2e8d-4252-a580-fc1b0e279e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:51.923430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2fc9e-2e8d-4252-a580-fc1b0e279e10 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:51.929218 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b134ba-c02f-46d2-95a2-ab87e9116f77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:51.929853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b134ba-c02f-46d2-95a2-ab87e9116f77 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:51.932278 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b134ba-c02f-46d2-95a2-ab87e9116f77 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:51.932278 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b134ba-c02f-46d2-95a2-ab87e9116f77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:51.939234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b134ba-c02f-46d2-95a2-ab87e9116f77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:51.940922 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b134ba-c02f-46d2-95a2-ab87e9116f77 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:51.950007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1350/2671] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:52.841021 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8073b34-4750-4cf4-ad3d-5dd1483d59d9 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:52.842633 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d8073b34-4750-4cf4-ad3d-5dd1483d59d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:52.911153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8073b34-4750-4cf4-ad3d-5dd1483d59d9 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:52.915739 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4dcf6-9c22-43e2-8a75-4e196f474ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:52.916381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4dcf6-9c22-43e2-8a75-4e196f474ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:52.923044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4dcf6-9c22-43e2-8a75-4e196f474ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:52.923044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4dcf6-9c22-43e2-8a75-4e196f474ea6 admin admin] PATH_INFO: `/v3/users/d82f42b0516e4354bd32140f96771f88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:52.923044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4dcf6-9c22-43e2-8a75-4e196f474ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d82f42b0516e4354bd32140f96771f88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:52.923044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4dcf6-9c22-43e2-8a75-4e196f474ea6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:52.925527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:53.103300 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-78a4dcf6-9c22-43e2-8a75-4e196f474ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd82f42b0516e4354bd32140f96771f88'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:53.103874 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-78a4dcf6-9c22-43e2-8a75-4e196f474ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd82f42b0516e4354bd32140f96771f88'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:53.116294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-78a4dcf6-9c22-43e2-8a75-4e196f474ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd82f42b0516e4354bd32140f96771f88'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:53.123701 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-78a4dcf6-9c22-43e2-8a75-4e196f474ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd82f42b0516e4354bd32140f96771f88'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:53.124366 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-78a4dcf6-9c22-43e2-8a75-4e196f474ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd82f42b0516e4354bd32140f96771f88'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:53.187246 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1322/2672] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:17:52 2022] DELETE /identity/v3/users/d82f42b0516e4354bd32140f96771f88 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:53.425938 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b134ba-c02f-46d2-95a2-ab87e9116f77 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:53.446673 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b134ba-c02f-46d2-95a2-ab87e9116f77 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:53.494117 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:53.507206 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e4ef6-a79e-488e-a45b-25af5ff8136e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:53.507854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e4ef6-a79e-488e-a45b-25af5ff8136e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:53.508138 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e4ef6-a79e-488e-a45b-25af5ff8136e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:53.508421 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e4ef6-a79e-488e-a45b-25af5ff8136e admin admin] PATH_INFO: `/v3/projects/9e8674c9c1be4295bb8038a94b1e4eeb` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:53.510265 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e4ef6-a79e-488e-a45b-25af5ff8136e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e8674c9c1be4295bb8038a94b1e4eeb)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:53.512236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e4ef6-a79e-488e-a45b-25af5ff8136e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:53.626995 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-602e4ef6-a79e-488e-a45b-25af5ff8136e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e8674c9c1be4295bb8038a94b1e4eeb', 'request_id': 'req-602e4ef6-a79e-488e-a45b-25af5ff8136e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:53.715512 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-602e4ef6-a79e-488e-a45b-25af5ff8136e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e8674c9c1be4295bb8038a94b1e4eeb', 'request_id': 'req-602e4ef6-a79e-488e-a45b-25af5ff8136e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:53.722192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-602e4ef6-a79e-488e-a45b-25af5ff8136e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e8674c9c1be4295bb8038a94b1e4eeb', 'request_id': 'req-602e4ef6-a79e-488e-a45b-25af5ff8136e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:53.734591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-602e4ef6-a79e-488e-a45b-25af5ff8136e admin admin] The token cache is being invalidate because project 9e8674c9c1be4295bb8038a94b1e4eeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:17:53.734882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-602e4ef6-a79e-488e-a45b-25af5ff8136e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:53.735526 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-602e4ef6-a79e-488e-a45b-25af5ff8136e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:53.737542 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1351/2673] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:17:53 2022] DELETE /identity/v3/projects/9e8674c9c1be4295bb8038a94b1e4eeb => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:53.747476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4dcf6-9c22-43e2-8a75-4e196f474ea6 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:53.747476 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-78a4dcf6-9c22-43e2-8a75-4e196f474ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:53.757039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4dcf6-9c22-43e2-8a75-4e196f474ea6 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:53.822196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308319d-77e2-4741-9a22-387f03c468fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:53.822976 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308319d-77e2-4741-9a22-387f03c468fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:53.823262 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308319d-77e2-4741-9a22-387f03c468fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:53.823538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308319d-77e2-4741-9a22-387f03c468fc admin admin] PATH_INFO: `/v3/users/9040c4dd2b424ff8bd89dfee2bc2cb5a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:53.824852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308319d-77e2-4741-9a22-387f03c468fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9040c4dd2b424ff8bd89dfee2bc2cb5a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:53.826991 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308319d-77e2-4741-9a22-387f03c468fc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:54.029887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c308319d-77e2-4741-9a22-387f03c468fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9040c4dd2b424ff8bd89dfee2bc2cb5a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:54.030562 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c308319d-77e2-4741-9a22-387f03c468fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9040c4dd2b424ff8bd89dfee2bc2cb5a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:54.042594 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c308319d-77e2-4741-9a22-387f03c468fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9040c4dd2b424ff8bd89dfee2bc2cb5a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:54.050081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c308319d-77e2-4741-9a22-387f03c468fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9040c4dd2b424ff8bd89dfee2bc2cb5a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:54.050862 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c308319d-77e2-4741-9a22-387f03c468fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9040c4dd2b424ff8bd89dfee2bc2cb5a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:54.109681 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1323/2674] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:17:53 2022] DELETE /identity/v3/users/9040c4dd2b424ff8bd89dfee2bc2cb5a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:54.348625 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e4ef6-a79e-488e-a45b-25af5ff8136e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:54.350096 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-602e4ef6-a79e-488e-a45b-25af5ff8136e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:54.370768 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e4ef6-a79e-488e-a45b-25af5ff8136e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:54.428967 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ec004-2464-42cc-aba2-b4683177b5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:54.429613 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ec004-2464-42cc-aba2-b4683177b5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:54.429891 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ec004-2464-42cc-aba2-b4683177b5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:54.430174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ec004-2464-42cc-aba2-b4683177b5b8 admin admin] PATH_INFO: `/v3/projects/0eaf7faf5cbe4491b4e18672e5d4a0ae` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:54.431343 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ec004-2464-42cc-aba2-b4683177b5b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eaf7faf5cbe4491b4e18672e5d4a0ae)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:54.433341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ec004-2464-42cc-aba2-b4683177b5b8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:54.565719 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e23ec004-2464-42cc-aba2-b4683177b5b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eaf7faf5cbe4491b4e18672e5d4a0ae', 'request_id': 'req-e23ec004-2464-42cc-aba2-b4683177b5b8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:54.661249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e23ec004-2464-42cc-aba2-b4683177b5b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eaf7faf5cbe4491b4e18672e5d4a0ae', 'request_id': 'req-e23ec004-2464-42cc-aba2-b4683177b5b8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:54.667119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e23ec004-2464-42cc-aba2-b4683177b5b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eaf7faf5cbe4491b4e18672e5d4a0ae', 'request_id': 'req-e23ec004-2464-42cc-aba2-b4683177b5b8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:54.678494 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e23ec004-2464-42cc-aba2-b4683177b5b8 admin admin] The token cache is being invalidate because project 0eaf7faf5cbe4491b4e18672e5d4a0ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:17:54.678784 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e23ec004-2464-42cc-aba2-b4683177b5b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:54.679414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e23ec004-2464-42cc-aba2-b4683177b5b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:54.680961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1352/2675] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:17:54 2022] DELETE /identity/v3/projects/0eaf7faf5cbe4491b4e18672e5d4a0ae => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:54.686467 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1630b6e-ff03-4cba-a850-5e26e0007df3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:54.686755 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1630b6e-ff03-4cba-a850-5e26e0007df3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:54.687039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1630b6e-ff03-4cba-a850-5e26e0007df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:54.695525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:54.706789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c1630b6e-ff03-4cba-a850-5e26e0007df3 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:54.714616 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c1630b6e-ff03-4cba-a850-5e26e0007df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:54.771775 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1324/2676] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:54.779557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2ad51-0cc3-44a7-a01d-2c98ab0151a3 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:54.779852 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2ad51-0cc3-44a7-a01d-2c98ab0151a3 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:54.780137 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2ad51-0cc3-44a7-a01d-2c98ab0151a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:54.795000 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:54.932200 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-5af2ad51-0cc3-44a7-a01d-2c98ab0151a3 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:54.933505 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5af2ad51-0cc3-44a7-a01d-2c98ab0151a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:54.946514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1353/2677] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:54.950684 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1630b6e-ff03-4cba-a850-5e26e0007df3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:54.960413 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1630b6e-ff03-4cba-a850-5e26e0007df3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:54.965386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81624b49-6ab9-4979-8b24-53dff52b7b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:54.970211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81624b49-6ab9-4979-8b24-53dff52b7b23 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:54.970211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81624b49-6ab9-4979-8b24-53dff52b7b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:54.970211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81624b49-6ab9-4979-8b24-53dff52b7b23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:54.970211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81624b49-6ab9-4979-8b24-53dff52b7b23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:17:54.970211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81624b49-6ab9-4979-8b24-53dff52b7b23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:54.970211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81624b49-6ab9-4979-8b24-53dff52b7b23 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:54.981654 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1325/2678] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:17:54.986139 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2ad51-0cc3-44a7-a01d-2c98ab0151a3 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:54.995814 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2ad51-0cc3-44a7-a01d-2c98ab0151a3 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:55.001137 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da00ed-7567-4c66-9cd1-3509488261d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:55.001757 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da00ed-7567-4c66-9cd1-3509488261d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:55.002040 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da00ed-7567-4c66-9cd1-3509488261d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:55.002314 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da00ed-7567-4c66-9cd1-3509488261d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:55.002985 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da00ed-7567-4c66-9cd1-3509488261d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:55.004926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da00ed-7567-4c66-9cd1-3509488261d8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:55.087594 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1354/2679] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:17:54 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:17:55.091800 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81624b49-6ab9-4979-8b24-53dff52b7b23 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:55.102086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81624b49-6ab9-4979-8b24-53dff52b7b23 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:55.164797 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b30bf-a5d1-4b5d-991c-308ad3540b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:55.165431 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b30bf-a5d1-4b5d-991c-308ad3540b9e admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:55.167706 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b30bf-a5d1-4b5d-991c-308ad3540b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:55.167706 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b30bf-a5d1-4b5d-991c-308ad3540b9e admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:55.167706 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b30bf-a5d1-4b5d-991c-308ad3540b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:55.168699 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b30bf-a5d1-4b5d-991c-308ad3540b9e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:55.282775 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1326/2680] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:17:55 2022] POST /identity/v3/users => generated 285 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:17:55.283924 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da00ed-7567-4c66-9cd1-3509488261d8 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:55.294198 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da00ed-7567-4c66-9cd1-3509488261d8 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:55.300010 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fcab0-334c-4f10-b049-3f0ac9bc33af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:55.300798 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fcab0-334c-4f10-b049-3f0ac9bc33af admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:55.301090 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fcab0-334c-4f10-b049-3f0ac9bc33af admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:55.301366 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fcab0-334c-4f10-b049-3f0ac9bc33af admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:55.302617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fcab0-334c-4f10-b049-3f0ac9bc33af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:55.303817 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fcab0-334c-4f10-b049-3f0ac9bc33af admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:55.317733 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1355/2681] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:55.318979 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b30bf-a5d1-4b5d-991c-308ad3540b9e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:55.329153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b30bf-a5d1-4b5d-991c-308ad3540b9e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:55.333871 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51431170-5545-4a19-b576-dd486650c802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:55.334492 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51431170-5545-4a19-b576-dd486650c802 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:55.334900 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51431170-5545-4a19-b576-dd486650c802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:55.335182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51431170-5545-4a19-b576-dd486650c802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:55.335916 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51431170-5545-4a19-b576-dd486650c802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:55.337897 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51431170-5545-4a19-b576-dd486650c802 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:55.354424 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1327/2682] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:55.359601 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fcab0-334c-4f10-b049-3f0ac9bc33af admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:55.370036 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fcab0-334c-4f10-b049-3f0ac9bc33af admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:55.375062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686c610-64d1-42aa-b3e6-41d04464dbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:55.375785 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686c610-64d1-42aa-b3e6-41d04464dbfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:55.376062 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686c610-64d1-42aa-b3e6-41d04464dbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:55.376424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686c610-64d1-42aa-b3e6-41d04464dbfe admin admin] PATH_INFO: `/v3/projects/a8f3dd570b6a47588f20a6c876f5e6c7/users/17bb44373b0941cc89392486a30b4784/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:55.391339 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686c610-64d1-42aa-b3e6-41d04464dbfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f3dd570b6a47588f20a6c876f5e6c7, user_id=17bb44373b0941cc89392486a30b4784, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:55.394223 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686c610-64d1-42aa-b3e6-41d04464dbfe admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:55.493106 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1356/2683] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:17:55 2022] PUT /identity/v3/projects/a8f3dd570b6a47588f20a6c876f5e6c7/users/17bb44373b0941cc89392486a30b4784/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:55.505117 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe456304-3431-44a3-9824-c3ee05e1d28b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:55.505411 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe456304-3431-44a3-9824-c3ee05e1d28b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:55.505692 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe456304-3431-44a3-9824-c3ee05e1d28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:55.533661 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fe456304-3431-44a3-9824-c3ee05e1d28b None None] MFA Rules not processed for user `17bb44373b0941cc89392486a30b4784`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:55.534889 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fe456304-3431-44a3-9824-c3ee05e1d28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:55.596886 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:55.600386 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1328/2684] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:55.604950 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686c610-64d1-42aa-b3e6-41d04464dbfe admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:55.667024 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686c610-64d1-42aa-b3e6-41d04464dbfe admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:55.671971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e30370-4a71-4e17-8777-3ef08e931753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:55.672602 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e30370-4a71-4e17-8777-3ef08e931753 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:55.672924 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e30370-4a71-4e17-8777-3ef08e931753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:55.673197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e30370-4a71-4e17-8777-3ef08e931753 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:55.675768 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e30370-4a71-4e17-8777-3ef08e931753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:55.675768 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e30370-4a71-4e17-8777-3ef08e931753 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:55.774007 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1357/2685] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:17:55 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:17:55.782265 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe456304-3431-44a3-9824-c3ee05e1d28b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:55.793464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe456304-3431-44a3-9824-c3ee05e1d28b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:55.850272 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ec071-b6fd-4519-895d-39b76a9e13e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:55.850821 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ec071-b6fd-4519-895d-39b76a9e13e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:55.851101 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ec071-b6fd-4519-895d-39b76a9e13e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:55.851379 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ec071-b6fd-4519-895d-39b76a9e13e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:55.852040 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ec071-b6fd-4519-895d-39b76a9e13e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:55.853983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ec071-b6fd-4519-895d-39b76a9e13e7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:55.954170 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1329/2686] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:17:55 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:17:55.958079 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e30370-4a71-4e17-8777-3ef08e931753 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:55.969056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e30370-4a71-4e17-8777-3ef08e931753 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:55.973622 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e6436-30ee-4834-82ac-6970e3269aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:55.974549 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e6436-30ee-4834-82ac-6970e3269aba admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:55.974549 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e6436-30ee-4834-82ac-6970e3269aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:55.974780 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e6436-30ee-4834-82ac-6970e3269aba admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:55.975461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e6436-30ee-4834-82ac-6970e3269aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:55.977118 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e6436-30ee-4834-82ac-6970e3269aba admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:55.987602 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1358/2687] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:55.996168 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ec071-b6fd-4519-895d-39b76a9e13e7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:56.003002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ec071-b6fd-4519-895d-39b76a9e13e7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:56.007638 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f31e5d-f371-40a7-a6f9-965a545c6f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:56.012371 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f31e5d-f371-40a7-a6f9-965a545c6f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:56.012371 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f31e5d-f371-40a7-a6f9-965a545c6f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:56.012371 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f31e5d-f371-40a7-a6f9-965a545c6f70 admin admin] PATH_INFO: `/v3/projects/82d8b8d12d564b34b10d244939255c8a/users/18f1cb0e6acc458f977572fe74611ec4/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:56.024933 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f31e5d-f371-40a7-a6f9-965a545c6f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82d8b8d12d564b34b10d244939255c8a, user_id=18f1cb0e6acc458f977572fe74611ec4, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:56.027729 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f31e5d-f371-40a7-a6f9-965a545c6f70 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:56.101198 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1330/2688] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:17:55 2022] PUT /identity/v3/projects/82d8b8d12d564b34b10d244939255c8a/users/18f1cb0e6acc458f977572fe74611ec4/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:17:56.105132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e6436-30ee-4834-82ac-6970e3269aba admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:56.115515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e6436-30ee-4834-82ac-6970e3269aba admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:56.173703 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8bf72-2edd-4389-a4d6-53915cd31855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:56.174323 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8bf72-2edd-4389-a4d6-53915cd31855 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:56.174601 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8bf72-2edd-4389-a4d6-53915cd31855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:56.174871 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8bf72-2edd-4389-a4d6-53915cd31855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:56.175555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8bf72-2edd-4389-a4d6-53915cd31855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:56.177203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8bf72-2edd-4389-a4d6-53915cd31855 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:56.190769 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1359/2689] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:56.192065 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f31e5d-f371-40a7-a6f9-965a545c6f70 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:56.203425 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f31e5d-f371-40a7-a6f9-965a545c6f70 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:56.208470 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9729ad-f60e-4472-bab2-2a0daf162d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:56.209180 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9729ad-f60e-4472-bab2-2a0daf162d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:56.209462 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9729ad-f60e-4472-bab2-2a0daf162d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:56.209740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9729ad-f60e-4472-bab2-2a0daf162d0a admin admin] PATH_INFO: `/v3/projects/82d8b8d12d564b34b10d244939255c8a/users/18f1cb0e6acc458f977572fe74611ec4/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:56.211759 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9729ad-f60e-4472-bab2-2a0daf162d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=82d8b8d12d564b34b10d244939255c8a, user_id=18f1cb0e6acc458f977572fe74611ec4, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:56.214507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9729ad-f60e-4472-bab2-2a0daf162d0a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:56.231227 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1331/2690] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:17:56 2022] PUT /identity/v3/projects/82d8b8d12d564b34b10d244939255c8a/users/18f1cb0e6acc458f977572fe74611ec4/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:17:56.231371 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8bf72-2edd-4389-a4d6-53915cd31855 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:56.232834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-54c8bf72-2edd-4389-a4d6-53915cd31855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:56.240177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2b05d-42b8-4546-aebf-e47b5693b5c8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:56.240564 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2b05d-42b8-4546-aebf-e47b5693b5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:56.240893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2b05d-42b8-4546-aebf-e47b5693b5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:56.245741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8bf72-2edd-4389-a4d6-53915cd31855 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:56.259047 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:56.273863 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1de2b05d-42b8-4546-aebf-e47b5693b5c8 None None] MFA Rules not processed for user `18f1cb0e6acc458f977572fe74611ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:56.276188 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1de2b05d-42b8-4546-aebf-e47b5693b5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:56.306958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea1e2a-ccd2-4567-816a-4b0a33d15aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:56.307610 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea1e2a-ccd2-4567-816a-4b0a33d15aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:56.307955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea1e2a-ccd2-4567-816a-4b0a33d15aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:56.308234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea1e2a-ccd2-4567-816a-4b0a33d15aa4 admin admin] PATH_INFO: `/v3/users/32a619041f40434aaba93fdda6499026` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:56.309534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea1e2a-ccd2-4567-816a-4b0a33d15aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a619041f40434aaba93fdda6499026)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:56.312186 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea1e2a-ccd2-4567-816a-4b0a33d15aa4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:56.349552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1332/2691] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:56 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:17:56.360881 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2b05d-42b8-4546-aebf-e47b5693b5c8 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:56.362502 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1de2b05d-42b8-4546-aebf-e47b5693b5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:56.403803 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:56.428729 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2b05d-42b8-4546-aebf-e47b5693b5c8 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:56.434351 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6a2c5-22fb-45fc-826b-639b3664373c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:56.435010 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6a2c5-22fb-45fc-826b-639b3664373c service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:56.435895 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6a2c5-22fb-45fc-826b-639b3664373c service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:56.436217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6a2c5-22fb-45fc-826b-639b3664373c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:56.445515 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6a2c5-22fb-45fc-826b-639b3664373c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:56.446984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6a2c5-22fb-45fc-826b-639b3664373c service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:56.456649 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1333/2692] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:56 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:17:56.523167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-21ea1e2a-ccd2-4567-816a-4b0a33d15aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a619041f40434aaba93fdda6499026'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:56.612805 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-21ea1e2a-ccd2-4567-816a-4b0a33d15aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a619041f40434aaba93fdda6499026'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:56.627598 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-21ea1e2a-ccd2-4567-816a-4b0a33d15aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a619041f40434aaba93fdda6499026'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:56.634610 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-21ea1e2a-ccd2-4567-816a-4b0a33d15aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a619041f40434aaba93fdda6499026'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:56.635289 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-21ea1e2a-ccd2-4567-816a-4b0a33d15aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a619041f40434aaba93fdda6499026'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:56.641190 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1360/2693] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:17:56 2022] DELETE /identity/v3/users/32a619041f40434aaba93fdda6499026 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:56.645785 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429f1af-5efe-4a01-a25a-1cfb33286182 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:56.646071 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429f1af-5efe-4a01-a25a-1cfb33286182 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:56.646352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429f1af-5efe-4a01-a25a-1cfb33286182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:56.665035 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f429f1af-5efe-4a01-a25a-1cfb33286182 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:56.666364 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f429f1af-5efe-4a01-a25a-1cfb33286182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:56.726073 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1334/2694] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:56.737300 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea1e2a-ccd2-4567-816a-4b0a33d15aa4 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:56.738756 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-21ea1e2a-ccd2-4567-816a-4b0a33d15aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:56.806557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea1e2a-ccd2-4567-816a-4b0a33d15aa4 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:56.806863 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc646b2e-1a9a-4357-b85c-59a502187dd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:56.807669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc646b2e-1a9a-4357-b85c-59a502187dd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:56.807991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc646b2e-1a9a-4357-b85c-59a502187dd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:56.808234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc646b2e-1a9a-4357-b85c-59a502187dd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:56.818147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc646b2e-1a9a-4357-b85c-59a502187dd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:56.819641 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc646b2e-1a9a-4357-b85c-59a502187dd9 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:56.829551 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1361/2695] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:57.213869 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429f1af-5efe-4a01-a25a-1cfb33286182 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:57.215392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f429f1af-5efe-4a01-a25a-1cfb33286182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:57.228743 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429f1af-5efe-4a01-a25a-1cfb33286182 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:57.234177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44a494-315c-4398-9adb-09fbb69e03fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:57.234949 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44a494-315c-4398-9adb-09fbb69e03fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:57.235823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44a494-315c-4398-9adb-09fbb69e03fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:57.236634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44a494-315c-4398-9adb-09fbb69e03fc admin admin] PATH_INFO: `/v3/projects/2ec549cce605410fa5a81f92b2fc0c88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:57.238012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44a494-315c-4398-9adb-09fbb69e03fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ec549cce605410fa5a81f92b2fc0c88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:57.240163 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44a494-315c-4398-9adb-09fbb69e03fc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:57.354423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ba44a494-315c-4398-9adb-09fbb69e03fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ec549cce605410fa5a81f92b2fc0c88', 'request_id': 'req-ba44a494-315c-4398-9adb-09fbb69e03fc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:57.361007 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ba44a494-315c-4398-9adb-09fbb69e03fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ec549cce605410fa5a81f92b2fc0c88', 'request_id': 'req-ba44a494-315c-4398-9adb-09fbb69e03fc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:57.368463 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ba44a494-315c-4398-9adb-09fbb69e03fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ec549cce605410fa5a81f92b2fc0c88', 'request_id': 'req-ba44a494-315c-4398-9adb-09fbb69e03fc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:57.467295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ba44a494-315c-4398-9adb-09fbb69e03fc admin admin] The token cache is being invalidate because project 2ec549cce605410fa5a81f92b2fc0c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:17:57.467745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ba44a494-315c-4398-9adb-09fbb69e03fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:57.468385 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ba44a494-315c-4398-9adb-09fbb69e03fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:57.470568 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1335/2696] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:17:57 2022] DELETE /identity/v3/projects/2ec549cce605410fa5a81f92b2fc0c88 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:57.475506 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aa375-e425-4af9-9efe-60cee6bdcfa7 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:57.477285 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aa375-e425-4af9-9efe-60cee6bdcfa7 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:57.477285 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aa375-e425-4af9-9efe-60cee6bdcfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:57.497468 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d19aa375-e425-4af9-9efe-60cee6bdcfa7 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:57.499503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d19aa375-e425-4af9-9efe-60cee6bdcfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:57.532603 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:57.561592 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1362/2697] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:57.569597 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae178f-ecf9-4c9c-afaf-c0afda794943 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:57.569904 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae178f-ecf9-4c9c-afaf-c0afda794943 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:57.570182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae178f-ecf9-4c9c-afaf-c0afda794943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:57.590919 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-dcae178f-ecf9-4c9c-afaf-c0afda794943 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:57.592821 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dcae178f-ecf9-4c9c-afaf-c0afda794943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:57.602188 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1336/2698] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:17:57.606437 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aa375-e425-4af9-9efe-60cee6bdcfa7 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:57.616949 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aa375-e425-4af9-9efe-60cee6bdcfa7 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:57.622174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592bab0-029b-46af-9337-ab6b7d401db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:57.622798 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592bab0-029b-46af-9337-ab6b7d401db5 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:57.623082 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592bab0-029b-46af-9337-ab6b7d401db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:57.623362 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592bab0-029b-46af-9337-ab6b7d401db5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:57.624209 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592bab0-029b-46af-9337-ab6b7d401db5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:17:57.624527 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592bab0-029b-46af-9337-ab6b7d401db5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:57.626188 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592bab0-029b-46af-9337-ab6b7d401db5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:57.639815 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1363/2699] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:17:57.645790 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae178f-ecf9-4c9c-afaf-c0afda794943 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:57.655824 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae178f-ecf9-4c9c-afaf-c0afda794943 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:57.660679 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a3a7b-709b-4343-8c4a-f4c73543a75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:57.661374 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a3a7b-709b-4343-8c4a-f4c73543a75b admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:57.661654 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a3a7b-709b-4343-8c4a-f4c73543a75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:57.661930 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a3a7b-709b-4343-8c4a-f4c73543a75b admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:57.662610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a3a7b-709b-4343-8c4a-f4c73543a75b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:57.664511 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a3a7b-709b-4343-8c4a-f4c73543a75b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:57.757688 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1337/2700] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:17:57 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:17:57.761939 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592bab0-029b-46af-9337-ab6b7d401db5 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:57.772452 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592bab0-029b-46af-9337-ab6b7d401db5 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:57.833390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe11f7-dcd2-42ae-bce9-44f32fcf046f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:57.834097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe11f7-dcd2-42ae-bce9-44f32fcf046f admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:57.834447 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe11f7-dcd2-42ae-bce9-44f32fcf046f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:57.834724 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe11f7-dcd2-42ae-bce9-44f32fcf046f admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:57.835382 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe11f7-dcd2-42ae-bce9-44f32fcf046f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:57.837463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe11f7-dcd2-42ae-bce9-44f32fcf046f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:57.936103 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1364/2701] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:17:57 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:17:57.940424 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a3a7b-709b-4343-8c4a-f4c73543a75b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:57.951414 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a3a7b-709b-4343-8c4a-f4c73543a75b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:57.956745 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89923595-4067-4a12-ae3a-3f740494abdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:57.957376 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923595-4067-4a12-ae3a-3f740494abdb admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:57.957660 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923595-4067-4a12-ae3a-3f740494abdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:57.957936 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923595-4067-4a12-ae3a-3f740494abdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:57.958629 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89923595-4067-4a12-ae3a-3f740494abdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:57.960219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89923595-4067-4a12-ae3a-3f740494abdb admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:57.971438 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1338/2702] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:57.975567 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe11f7-dcd2-42ae-bce9-44f32fcf046f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:57.985545 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe11f7-dcd2-42ae-bce9-44f32fcf046f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:57.990469 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c96b-2cb8-47b4-aecb-ac786fc3cda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:57.991075 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c96b-2cb8-47b4-aecb-ac786fc3cda9 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:57.991359 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c96b-2cb8-47b4-aecb-ac786fc3cda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:57.991634 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c96b-2cb8-47b4-aecb-ac786fc3cda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:57.992352 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742c96b-2cb8-47b4-aecb-ac786fc3cda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:57.994049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742c96b-2cb8-47b4-aecb-ac786fc3cda9 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:58.004159 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1365/2703] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:58.008397 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89923595-4067-4a12-ae3a-3f740494abdb admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:58.019346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89923595-4067-4a12-ae3a-3f740494abdb admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:58.024364 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e3b32-93e9-43e4-b6df-396d3e9f6567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:58.025063 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e3b32-93e9-43e4-b6df-396d3e9f6567 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:58.025347 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e3b32-93e9-43e4-b6df-396d3e9f6567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:58.025626 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e3b32-93e9-43e4-b6df-396d3e9f6567 admin admin] PATH_INFO: `/v3/projects/fe5acc5e43fb4142949604b648d9542a/users/34966d03380b416fa71d72fcf0ff6c9f/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:58.041545 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e3b32-93e9-43e4-b6df-396d3e9f6567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5acc5e43fb4142949604b648d9542a, user_id=34966d03380b416fa71d72fcf0ff6c9f, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:58.044210 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e3b32-93e9-43e4-b6df-396d3e9f6567 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:58.122754 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:58.127664 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1339/2704] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:17:58 2022] PUT /identity/v3/projects/fe5acc5e43fb4142949604b648d9542a/users/34966d03380b416fa71d72fcf0ff6c9f/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:58.148726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dbfcf-ff8d-4328-9b04-2e9bc23b14f3 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:58.149047 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dbfcf-ff8d-4328-9b04-2e9bc23b14f3 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:58.149346 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dbfcf-ff8d-4328-9b04-2e9bc23b14f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:58.179668 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c03dbfcf-ff8d-4328-9b04-2e9bc23b14f3 None None] MFA Rules not processed for user `34966d03380b416fa71d72fcf0ff6c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:58.181015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c03dbfcf-ff8d-4328-9b04-2e9bc23b14f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:58.248697 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1366/2705] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:58.261552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e3b32-93e9-43e4-b6df-396d3e9f6567 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:58.263345 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-642e3b32-93e9-43e4-b6df-396d3e9f6567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:58.343332 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e3b32-93e9-43e4-b6df-396d3e9f6567 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:58.351182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e2731-d682-4394-acad-466b62dc7a20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:58.352067 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e2731-d682-4394-acad-466b62dc7a20 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:58.352508 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e2731-d682-4394-acad-466b62dc7a20 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:58.353012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e2731-d682-4394-acad-466b62dc7a20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:58.363285 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e2731-d682-4394-acad-466b62dc7a20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:58.365037 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e2731-d682-4394-acad-466b62dc7a20 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:58.374831 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1340/2706] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:58.609971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dbfcf-ff8d-4328-9b04-2e9bc23b14f3 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:58.645048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:58.673548 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dbfcf-ff8d-4328-9b04-2e9bc23b14f3 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:58.678107 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a1a2c-317a-4cbc-8aaa-bde2cee55f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:58.678746 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a1a2c-317a-4cbc-8aaa-bde2cee55f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:58.679030 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a1a2c-317a-4cbc-8aaa-bde2cee55f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:58.679306 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a1a2c-317a-4cbc-8aaa-bde2cee55f3d admin admin] PATH_INFO: `/v3/users/34966d03380b416fa71d72fcf0ff6c9f` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:58.680473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a1a2c-317a-4cbc-8aaa-bde2cee55f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=34966d03380b416fa71d72fcf0ff6c9f)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:58.682461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a1a2c-317a-4cbc-8aaa-bde2cee55f3d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:58.868015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e61a1a2c-317a-4cbc-8aaa-bde2cee55f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34966d03380b416fa71d72fcf0ff6c9f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:58.960651 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e61a1a2c-317a-4cbc-8aaa-bde2cee55f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34966d03380b416fa71d72fcf0ff6c9f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:58.973653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e61a1a2c-317a-4cbc-8aaa-bde2cee55f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34966d03380b416fa71d72fcf0ff6c9f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:58.980596 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e61a1a2c-317a-4cbc-8aaa-bde2cee55f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34966d03380b416fa71d72fcf0ff6c9f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:58.981334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e61a1a2c-317a-4cbc-8aaa-bde2cee55f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34966d03380b416fa71d72fcf0ff6c9f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:58.988000 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1367/2707] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:17:58 2022] DELETE /identity/v3/users/34966d03380b416fa71d72fcf0ff6c9f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:58.992367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a1267-ddb1-448a-8545-96b968f8bc9b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:58.992660 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a1267-ddb1-448a-8545-96b968f8bc9b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:58.993034 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a1267-ddb1-448a-8545-96b968f8bc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:59.013387 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a72a1267-ddb1-448a-8545-96b968f8bc9b None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:59.014601 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a72a1267-ddb1-448a-8545-96b968f8bc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:59.077079 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1341/2708] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:59.087031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a1a2c-317a-4cbc-8aaa-bde2cee55f3d admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:59.088460 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e61a1a2c-317a-4cbc-8aaa-bde2cee55f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:59.150857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a1a2c-317a-4cbc-8aaa-bde2cee55f3d admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:59.155473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44809952-2588-41bd-b055-9c1047cd85dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:59.155976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44809952-2588-41bd-b055-9c1047cd85dc service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:59.156259 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44809952-2588-41bd-b055-9c1047cd85dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:59.156701 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44809952-2588-41bd-b055-9c1047cd85dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:59.166655 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44809952-2588-41bd-b055-9c1047cd85dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:59.168081 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44809952-2588-41bd-b055-9c1047cd85dc service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:59.183176 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1368/2709] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:59.628974 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a1267-ddb1-448a-8545-96b968f8bc9b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:59.630498 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a72a1267-ddb1-448a-8545-96b968f8bc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:59.643156 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a1267-ddb1-448a-8545-96b968f8bc9b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:59.648560 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33348132-586e-4b37-8eb4-d8696b951b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:59.649801 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33348132-586e-4b37-8eb4-d8696b951b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:59.650117 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33348132-586e-4b37-8eb4-d8696b951b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:59.650967 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33348132-586e-4b37-8eb4-d8696b951b4a admin admin] PATH_INFO: `/v3/projects/fe5acc5e43fb4142949604b648d9542a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:59.654391 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33348132-586e-4b37-8eb4-d8696b951b4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe5acc5e43fb4142949604b648d9542a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:59.656721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33348132-586e-4b37-8eb4-d8696b951b4a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:59.675410 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44809952-2588-41bd-b055-9c1047cd85dc service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:59.677042 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-44809952-2588-41bd-b055-9c1047cd85dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:59.690873 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44809952-2588-41bd-b055-9c1047cd85dc service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:59.695940 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40475e44-12c7-4acc-b83f-a972d2ff1923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:59.696134 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40475e44-12c7-4acc-b83f-a972d2ff1923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:59.696405 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40475e44-12c7-4acc-b83f-a972d2ff1923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:59.696675 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40475e44-12c7-4acc-b83f-a972d2ff1923 admin admin] PATH_INFO: `/v3/users/17bb44373b0941cc89392486a30b4784` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:59.697868 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40475e44-12c7-4acc-b83f-a972d2ff1923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17bb44373b0941cc89392486a30b4784)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:59.699789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40475e44-12c7-4acc-b83f-a972d2ff1923 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:59.789847 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-33348132-586e-4b37-8eb4-d8696b951b4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe5acc5e43fb4142949604b648d9542a', 'request_id': 'req-33348132-586e-4b37-8eb4-d8696b951b4a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:59.796079 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-33348132-586e-4b37-8eb4-d8696b951b4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe5acc5e43fb4142949604b648d9542a', 'request_id': 'req-33348132-586e-4b37-8eb4-d8696b951b4a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:59.802758 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-33348132-586e-4b37-8eb4-d8696b951b4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe5acc5e43fb4142949604b648d9542a', 'request_id': 'req-33348132-586e-4b37-8eb4-d8696b951b4a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:59.889649 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-33348132-586e-4b37-8eb4-d8696b951b4a admin admin] The token cache is being invalidate because project fe5acc5e43fb4142949604b648d9542a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:17:59.889875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-33348132-586e-4b37-8eb4-d8696b951b4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:59.890490 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-33348132-586e-4b37-8eb4-d8696b951b4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:59.892308 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1342/2710] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:17:59 2022] DELETE /identity/v3/projects/fe5acc5e43fb4142949604b648d9542a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:59.896937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb0c42-14db-4e2c-b714-cc2be681ebcb None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:59.897226 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb0c42-14db-4e2c-b714-cc2be681ebcb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:59.897503 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb0c42-14db-4e2c-b714-cc2be681ebcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:59.917178 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-59cb0c42-14db-4e2c-b714-cc2be681ebcb None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:59.918399 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-59cb0c42-14db-4e2c-b714-cc2be681ebcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:59.923876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:59.929782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-40475e44-12c7-4acc-b83f-a972d2ff1923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17bb44373b0941cc89392486a30b4784'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:59.931583 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:59.978283 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1343/2711] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:17:59.988134 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6c38c-6057-41a6-aa15-372c2b2a8b1e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:59.988424 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6c38c-6057-41a6-aa15-372c2b2a8b1e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:59.988708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6c38c-6057-41a6-aa15-372c2b2a8b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:00.000474 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-40475e44-12c7-4acc-b83f-a972d2ff1923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17bb44373b0941cc89392486a30b4784'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:00.008560 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b6e6c38c-6057-41a6-aa15-372c2b2a8b1e None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:00.009799 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b6e6c38c-6057-41a6-aa15-372c2b2a8b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:00.013787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-40475e44-12c7-4acc-b83f-a972d2ff1923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17bb44373b0941cc89392486a30b4784'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:00.018284 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1344/2712] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:18:00.020907 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-40475e44-12c7-4acc-b83f-a972d2ff1923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17bb44373b0941cc89392486a30b4784'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:00.021891 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-40475e44-12c7-4acc-b83f-a972d2ff1923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17bb44373b0941cc89392486a30b4784'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:00.022427 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6c38c-6057-41a6-aa15-372c2b2a8b1e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:00.027787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1369/2713] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:17:59 2022] DELETE /identity/v3/users/17bb44373b0941cc89392486a30b4784 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:18:00.031770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6c38c-6057-41a6-aa15-372c2b2a8b1e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:00.031971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ace49-70e6-467b-b175-b7db795198f2 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:00.032315 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ace49-70e6-467b-b175-b7db795198f2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:00.032599 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ace49-70e6-467b-b175-b7db795198f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:00.052868 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-203ace49-70e6-467b-b175-b7db795198f2 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:00.054082 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-203ace49-70e6-467b-b175-b7db795198f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:00.090582 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbc18d-3ada-4fee-983a-b660913dd008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:00.091212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbc18d-3ada-4fee-983a-b660913dd008 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:00.091495 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbc18d-3ada-4fee-983a-b660913dd008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:00.091776 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbc18d-3ada-4fee-983a-b660913dd008 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:00.092478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbc18d-3ada-4fee-983a-b660913dd008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:18:00.092805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbc18d-3ada-4fee-983a-b660913dd008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:00.094425 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbc18d-3ada-4fee-983a-b660913dd008 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:00.106168 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1345/2714] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:18:00.111135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbc18d-3ada-4fee-983a-b660913dd008 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:00.113235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f8dbc18d-3ada-4fee-983a-b660913dd008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:00.115886 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1370/2715] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:18:00.127115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ace49-70e6-467b-b175-b7db795198f2 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:00.128426 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbc18d-3ada-4fee-983a-b660913dd008 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:00.128572 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-203ace49-70e6-467b-b175-b7db795198f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:00.133371 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c3acc-ed8d-457f-88c2-a555de2933f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:00.133988 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c3acc-ed8d-457f-88c2-a555de2933f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:00.134274 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c3acc-ed8d-457f-88c2-a555de2933f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:00.134553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c3acc-ed8d-457f-88c2-a555de2933f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:00.135458 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c3acc-ed8d-457f-88c2-a555de2933f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:00.137406 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c3acc-ed8d-457f-88c2-a555de2933f6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:00.188397 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ace49-70e6-467b-b175-b7db795198f2 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:00.195179 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb7850-84b6-426b-b0b7-8f7cd2dc59c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:00.195179 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb7850-84b6-426b-b0b7-8f7cd2dc59c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:00.195179 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb7850-84b6-426b-b0b7-8f7cd2dc59c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:00.195179 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb7850-84b6-426b-b0b7-8f7cd2dc59c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:00.204444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb7850-84b6-426b-b0b7-8f7cd2dc59c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:00.206044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb7850-84b6-426b-b0b7-8f7cd2dc59c8 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:00.228720 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1371/2716] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:18:00.235693 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1346/2717] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:18:00 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:18:00.237132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb7850-84b6-426b-b0b7-8f7cd2dc59c8 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:00.246879 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb7850-84b6-426b-b0b7-8f7cd2dc59c8 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:00.306995 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f98d4d-0e6e-42d4-b219-412e45369741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:00.307627 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f98d4d-0e6e-42d4-b219-412e45369741 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:00.307912 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f98d4d-0e6e-42d4-b219-412e45369741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:00.308234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f98d4d-0e6e-42d4-b219-412e45369741 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:00.309015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f98d4d-0e6e-42d4-b219-412e45369741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:00.313515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f98d4d-0e6e-42d4-b219-412e45369741 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:00.410624 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:00.419877 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1372/2718] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:18:00 2022] POST /identity/v3/users => generated 283 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:18:00.421194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c3acc-ed8d-457f-88c2-a555de2933f6 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:00.432269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c3acc-ed8d-457f-88c2-a555de2933f6 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:00.439553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d14ec-2a77-4822-ae36-fbd866f10fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:00.440188 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d14ec-2a77-4822-ae36-fbd866f10fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:00.440563 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d14ec-2a77-4822-ae36-fbd866f10fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:00.440872 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d14ec-2a77-4822-ae36-fbd866f10fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:00.441601 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d14ec-2a77-4822-ae36-fbd866f10fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:00.443213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d14ec-2a77-4822-ae36-fbd866f10fc6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:00.455021 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1347/2719] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:00.459724 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f98d4d-0e6e-42d4-b219-412e45369741 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:00.470514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f98d4d-0e6e-42d4-b219-412e45369741 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:00.475324 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf8839-abeb-49fe-a4f3-a070efdd1771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:00.476008 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf8839-abeb-49fe-a4f3-a070efdd1771 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:00.476303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf8839-abeb-49fe-a4f3-a070efdd1771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:00.476583 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf8839-abeb-49fe-a4f3-a070efdd1771 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:00.480473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf8839-abeb-49fe-a4f3-a070efdd1771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:00.480473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf8839-abeb-49fe-a4f3-a070efdd1771 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:00.489574 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1373/2720] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:00.493723 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d14ec-2a77-4822-ae36-fbd866f10fc6 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:00.504983 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d14ec-2a77-4822-ae36-fbd866f10fc6 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:00.510218 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88847d-d501-44eb-b4ad-be4baecb4c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:00.510901 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88847d-d501-44eb-b4ad-be4baecb4c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:00.511183 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88847d-d501-44eb-b4ad-be4baecb4c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:00.511564 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88847d-d501-44eb-b4ad-be4baecb4c93 admin admin] PATH_INFO: `/v3/projects/7ed034ce1d16449dab92dd7ff5ab0b4a/users/f089ba9709a044c3a7d2ca8a3813976d/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:00.528887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88847d-d501-44eb-b4ad-be4baecb4c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed034ce1d16449dab92dd7ff5ab0b4a, user_id=f089ba9709a044c3a7d2ca8a3813976d, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:00.531613 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88847d-d501-44eb-b4ad-be4baecb4c93 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:00.650339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1348/2721] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:18:00 2022] PUT /identity/v3/projects/7ed034ce1d16449dab92dd7ff5ab0b4a/users/f089ba9709a044c3a7d2ca8a3813976d/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:00.661049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457d9e9-0dfb-421e-a3bd-02abf34704fc None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:00.661447 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457d9e9-0dfb-421e-a3bd-02abf34704fc None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:00.661796 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457d9e9-0dfb-421e-a3bd-02abf34704fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:00.665920 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88847d-d501-44eb-b4ad-be4baecb4c93 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:00.667754 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ab88847d-d501-44eb-b4ad-be4baecb4c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:00.701132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-1457d9e9-0dfb-421e-a3bd-02abf34704fc None None] MFA Rules not processed for user `f089ba9709a044c3a7d2ca8a3813976d`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:00.702392 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1457d9e9-0dfb-421e-a3bd-02abf34704fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:00.716567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:00.738338 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88847d-d501-44eb-b4ad-be4baecb4c93 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:00.743346 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c30f27-c2a5-4e96-a400-f87235feceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:00.744250 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c30f27-c2a5-4e96-a400-f87235feceb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:00.744547 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c30f27-c2a5-4e96-a400-f87235feceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:00.744856 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c30f27-c2a5-4e96-a400-f87235feceb0 admin admin] PATH_INFO: `/v3/projects/a8f3dd570b6a47588f20a6c876f5e6c7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:00.746069 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c30f27-c2a5-4e96-a400-f87235feceb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f3dd570b6a47588f20a6c876f5e6c7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:00.748727 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c30f27-c2a5-4e96-a400-f87235feceb0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:00.775555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1374/2722] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:00.780126 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457d9e9-0dfb-421e-a3bd-02abf34704fc None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:00.790576 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457d9e9-0dfb-421e-a3bd-02abf34704fc None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:00.797677 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5da0c9-28e8-4a13-b069-8afb8056e639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:00.798738 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5da0c9-28e8-4a13-b069-8afb8056e639 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:00.799011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5da0c9-28e8-4a13-b069-8afb8056e639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:00.799427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5da0c9-28e8-4a13-b069-8afb8056e639 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:00.801089 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5da0c9-28e8-4a13-b069-8afb8056e639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:00.807536 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5da0c9-28e8-4a13-b069-8afb8056e639 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:00.876291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-18c30f27-c2a5-4e96-a400-f87235feceb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f3dd570b6a47588f20a6c876f5e6c7', 'request_id': 'req-18c30f27-c2a5-4e96-a400-f87235feceb0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:00.881712 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-18c30f27-c2a5-4e96-a400-f87235feceb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f3dd570b6a47588f20a6c876f5e6c7', 'request_id': 'req-18c30f27-c2a5-4e96-a400-f87235feceb0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:00.887922 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-18c30f27-c2a5-4e96-a400-f87235feceb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f3dd570b6a47588f20a6c876f5e6c7', 'request_id': 'req-18c30f27-c2a5-4e96-a400-f87235feceb0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:00.929252 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1375/2723] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:18:00 2022] POST /identity/v3/projects => generated 363 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:18:00.933249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5da0c9-28e8-4a13-b069-8afb8056e639 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:00.992883 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-18c30f27-c2a5-4e96-a400-f87235feceb0 admin admin] The token cache is being invalidate because project a8f3dd570b6a47588f20a6c876f5e6c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:18:00.993187 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-18c30f27-c2a5-4e96-a400-f87235feceb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:00.993956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-18c30f27-c2a5-4e96-a400-f87235feceb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:00.995304 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5da0c9-28e8-4a13-b069-8afb8056e639 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:00.995996 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1349/2724] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:18:00 2022] DELETE /identity/v3/projects/a8f3dd570b6a47588f20a6c876f5e6c7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:00.999859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c30f27-c2a5-4e96-a400-f87235feceb0 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:01.001227 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-18c30f27-c2a5-4e96-a400-f87235feceb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:01.003070 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abc8a2-d791-48b7-a391-a5f8cfc88909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:01.003702 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abc8a2-d791-48b7-a391-a5f8cfc88909 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:01.003976 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abc8a2-d791-48b7-a391-a5f8cfc88909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:01.004246 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abc8a2-d791-48b7-a391-a5f8cfc88909 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:01.004950 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abc8a2-d791-48b7-a391-a5f8cfc88909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:01.006857 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abc8a2-d791-48b7-a391-a5f8cfc88909 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:01.066014 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c30f27-c2a5-4e96-a400-f87235feceb0 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:01.070680 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c8eba-e4c3-45a9-a510-8eee09ac0e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:01.071376 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c8eba-e4c3-45a9-a510-8eee09ac0e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:01.071662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c8eba-e4c3-45a9-a510-8eee09ac0e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:01.071945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c8eba-e4c3-45a9-a510-8eee09ac0e70 admin admin] PATH_INFO: `/v3/users/18f1cb0e6acc458f977572fe74611ec4` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:01.073164 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c8eba-e4c3-45a9-a510-8eee09ac0e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18f1cb0e6acc458f977572fe74611ec4)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:01.075102 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c8eba-e4c3-45a9-a510-8eee09ac0e70 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:01.132714 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1376/2725] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:18:00 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:18:01.136567 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abc8a2-d791-48b7-a391-a5f8cfc88909 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:01.138126 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e9abc8a2-d791-48b7-a391-a5f8cfc88909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:01.150099 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abc8a2-d791-48b7-a391-a5f8cfc88909 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:01.155278 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b53636-f9db-4aa3-8586-1c63a3913796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:01.155874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b53636-f9db-4aa3-8586-1c63a3913796 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:01.156151 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b53636-f9db-4aa3-8586-1c63a3913796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:01.156421 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b53636-f9db-4aa3-8586-1c63a3913796 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:01.157134 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b53636-f9db-4aa3-8586-1c63a3913796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:01.158726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b53636-f9db-4aa3-8586-1c63a3913796 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:01.169232 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1377/2726] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:18:01.173894 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b53636-f9db-4aa3-8586-1c63a3913796 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:01.183636 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b53636-f9db-4aa3-8586-1c63a3913796 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:01.188456 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2184e-5d23-45de-87e7-9b5c122ff1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:01.189140 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2184e-5d23-45de-87e7-9b5c122ff1e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:01.189609 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2184e-5d23-45de-87e7-9b5c122ff1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:01.189892 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2184e-5d23-45de-87e7-9b5c122ff1e9 admin admin] PATH_INFO: `/v3/projects/0c09f98c17ed40e6a6985121e7629dd4/users/16624ea59efe4480b0c3669ed7cbf117/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:01.204452 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2184e-5d23-45de-87e7-9b5c122ff1e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c09f98c17ed40e6a6985121e7629dd4, user_id=16624ea59efe4480b0c3669ed7cbf117, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:01.207183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2184e-5d23-45de-87e7-9b5c122ff1e9 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:01.315226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1378/2727] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:18:01 2022] PUT /identity/v3/projects/0c09f98c17ed40e6a6985121e7629dd4/users/16624ea59efe4480b0c3669ed7cbf117/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:18:01.319064 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2184e-5d23-45de-87e7-9b5c122ff1e9 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:01.329450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:01.355157 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ae5c8eba-e4c3-45a9-a510-8eee09ac0e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18f1cb0e6acc458f977572fe74611ec4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:01.355812 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ae5c8eba-e4c3-45a9-a510-8eee09ac0e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18f1cb0e6acc458f977572fe74611ec4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:01.368389 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ae5c8eba-e4c3-45a9-a510-8eee09ac0e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18f1cb0e6acc458f977572fe74611ec4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:01.374101 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:01.376210 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ae5c8eba-e4c3-45a9-a510-8eee09ac0e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18f1cb0e6acc458f977572fe74611ec4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:01.376924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ae5c8eba-e4c3-45a9-a510-8eee09ac0e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18f1cb0e6acc458f977572fe74611ec4'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:01.386186 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2184e-5d23-45de-87e7-9b5c122ff1e9 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:01.391575 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38902553-04a9-4d50-92ee-f3c60a237dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:01.392192 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38902553-04a9-4d50-92ee-f3c60a237dff admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:01.392475 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38902553-04a9-4d50-92ee-f3c60a237dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:01.392779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38902553-04a9-4d50-92ee-f3c60a237dff admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:01.393473 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38902553-04a9-4d50-92ee-f3c60a237dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:01.395089 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38902553-04a9-4d50-92ee-f3c60a237dff admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:01.406314 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1379/2728] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:18:01.410718 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38902553-04a9-4d50-92ee-f3c60a237dff admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:01.412367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-38902553-04a9-4d50-92ee-f3c60a237dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:01.424659 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38902553-04a9-4d50-92ee-f3c60a237dff admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:01.429301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a7f3f-2632-4651-883a-1d1a756f47b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:01.436224 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a7f3f-2632-4651-883a-1d1a756f47b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:01.436224 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a7f3f-2632-4651-883a-1d1a756f47b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:01.436224 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a7f3f-2632-4651-883a-1d1a756f47b8 admin admin] PATH_INFO: `/v3/projects/0c09f98c17ed40e6a6985121e7629dd4/users/16624ea59efe4480b0c3669ed7cbf117/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:01.436224 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a7f3f-2632-4651-883a-1d1a756f47b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c09f98c17ed40e6a6985121e7629dd4, user_id=16624ea59efe4480b0c3669ed7cbf117, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:01.436224 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a7f3f-2632-4651-883a-1d1a756f47b8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:01.444836 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1380/2729] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:18:01 2022] PUT /identity/v3/projects/0c09f98c17ed40e6a6985121e7629dd4/users/16624ea59efe4480b0c3669ed7cbf117/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:18:01.455496 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8ff24-b6a2-4e49-bb28-a01c913484a7 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:01.455789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8ff24-b6a2-4e49-bb28-a01c913484a7 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:01.456118 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8ff24-b6a2-4e49-bb28-a01c913484a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:01.462000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1350/2730] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:18:00 2022] DELETE /identity/v3/users/18f1cb0e6acc458f977572fe74611ec4 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:18:01.485031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e2d8ff24-b6a2-4e49-bb28-a01c913484a7 None None] MFA Rules not processed for user `16624ea59efe4480b0c3669ed7cbf117`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:01.486695 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e2d8ff24-b6a2-4e49-bb28-a01c913484a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:01.562295 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1381/2731] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:01 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:18:01.574864 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c8eba-e4c3-45a9-a510-8eee09ac0e70 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:01.576940 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ae5c8eba-e4c3-45a9-a510-8eee09ac0e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:01.635352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c8eba-e4c3-45a9-a510-8eee09ac0e70 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:01.639618 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c78ce-c20c-4ab9-a1a9-c2a5ff44acbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:01.640325 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c78ce-c20c-4ab9-a1a9-c2a5ff44acbe service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:01.640610 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c78ce-c20c-4ab9-a1a9-c2a5ff44acbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:01.640924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c78ce-c20c-4ab9-a1a9-c2a5ff44acbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:01.650081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c78ce-c20c-4ab9-a1a9-c2a5ff44acbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:01.651556 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c78ce-c20c-4ab9-a1a9-c2a5ff44acbe service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:01.663733 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1351/2732] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:01 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:18:01.905949 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8ff24-b6a2-4e49-bb28-a01c913484a7 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:01.907780 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e2d8ff24-b6a2-4e49-bb28-a01c913484a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:01.918294 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c78ce-c20c-4ab9-a1a9-c2a5ff44acbe service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:01.930740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c78ce-c20c-4ab9-a1a9-c2a5ff44acbe service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:01.935759 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdacf7-3ec8-4060-8f28-d70bd236777c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:01.936455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdacf7-3ec8-4060-8f28-d70bd236777c service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:01.936911 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdacf7-3ec8-4060-8f28-d70bd236777c service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:01.937304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdacf7-3ec8-4060-8f28-d70bd236777c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:01.940043 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-85fdacf7-3ec8-4060-8f28-d70bd236777c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:01.978385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8ff24-b6a2-4e49-bb28-a01c913484a7 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:01.984108 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0df8c-26e9-438e-8515-db6aba8fbcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:01.984788 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0df8c-26e9-438e-8515-db6aba8fbcef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:01.985071 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0df8c-26e9-438e-8515-db6aba8fbcef admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:01.985350 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0df8c-26e9-438e-8515-db6aba8fbcef admin admin] PATH_INFO: `/v3/projects/82d8b8d12d564b34b10d244939255c8a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:01.987222 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0df8c-26e9-438e-8515-db6aba8fbcef admin admin] RBAC: Authorizing `identity:delete_project(project_id=82d8b8d12d564b34b10d244939255c8a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:01.989220 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0df8c-26e9-438e-8515-db6aba8fbcef admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:02.006137 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdacf7-3ec8-4060-8f28-d70bd236777c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:02.007574 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdacf7-3ec8-4060-8f28-d70bd236777c service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:02.011384 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:02.018150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1352/2733] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:18:02.084037 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7ea0df8c-26e9-438e-8515-db6aba8fbcef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82d8b8d12d564b34b10d244939255c8a', 'request_id': 'req-7ea0df8c-26e9-438e-8515-db6aba8fbcef'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:02.183709 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7ea0df8c-26e9-438e-8515-db6aba8fbcef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82d8b8d12d564b34b10d244939255c8a', 'request_id': 'req-7ea0df8c-26e9-438e-8515-db6aba8fbcef'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:02.192249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7ea0df8c-26e9-438e-8515-db6aba8fbcef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82d8b8d12d564b34b10d244939255c8a', 'request_id': 'req-7ea0df8c-26e9-438e-8515-db6aba8fbcef'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:02.204411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7ea0df8c-26e9-438e-8515-db6aba8fbcef admin admin] The token cache is being invalidate because project 82d8b8d12d564b34b10d244939255c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:18:02.204702 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7ea0df8c-26e9-438e-8515-db6aba8fbcef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:02.205426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7ea0df8c-26e9-438e-8515-db6aba8fbcef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:02.206896 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1382/2734] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:18:01 2022] DELETE /identity/v3/projects/82d8b8d12d564b34b10d244939255c8a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:02.212721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610f1bb-f08a-4f67-ae01-8939f2d49674 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:02.213033 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610f1bb-f08a-4f67-ae01-8939f2d49674 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:02.213307 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610f1bb-f08a-4f67-ae01-8939f2d49674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:02.234032 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8610f1bb-f08a-4f67-ae01-8939f2d49674 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:02.235250 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8610f1bb-f08a-4f67-ae01-8939f2d49674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:02.293921 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1353/2735] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:02.306436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025bbad-d8bd-4a52-9ec6-2ef883c3e05b None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:02.306777 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025bbad-d8bd-4a52-9ec6-2ef883c3e05b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:02.307233 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025bbad-d8bd-4a52-9ec6-2ef883c3e05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:02.328614 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-8025bbad-d8bd-4a52-9ec6-2ef883c3e05b None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:02.330668 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8025bbad-d8bd-4a52-9ec6-2ef883c3e05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:02.349255 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1383/2736] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:18:02.353795 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610f1bb-f08a-4f67-ae01-8939f2d49674 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:02.365480 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610f1bb-f08a-4f67-ae01-8939f2d49674 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:02.370219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c92d6-84c1-422e-85e4-125a9953bd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:02.370842 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c92d6-84c1-422e-85e4-125a9953bd4d admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:02.371126 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c92d6-84c1-422e-85e4-125a9953bd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:02.371403 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c92d6-84c1-422e-85e4-125a9953bd4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:02.372106 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c92d6-84c1-422e-85e4-125a9953bd4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:18:02.372431 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c92d6-84c1-422e-85e4-125a9953bd4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:02.374841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c92d6-84c1-422e-85e4-125a9953bd4d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:02.386804 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1354/2737] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:18:02.391359 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025bbad-d8bd-4a52-9ec6-2ef883c3e05b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:02.400798 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025bbad-d8bd-4a52-9ec6-2ef883c3e05b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:02.406208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea2cfd-1b42-40f7-b549-a0d9569afe47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:02.406767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea2cfd-1b42-40f7-b549-a0d9569afe47 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:02.407052 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea2cfd-1b42-40f7-b549-a0d9569afe47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:02.407331 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea2cfd-1b42-40f7-b549-a0d9569afe47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:02.407999 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea2cfd-1b42-40f7-b549-a0d9569afe47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:02.410003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea2cfd-1b42-40f7-b549-a0d9569afe47 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:02.546984 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1384/2738] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:18:02 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:18:02.551235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c92d6-84c1-422e-85e4-125a9953bd4d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:02.561698 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c92d6-84c1-422e-85e4-125a9953bd4d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:02.574250 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:02.619744 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820d7bb-c3b9-4473-bbd5-94fd588a97ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:02.620401 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820d7bb-c3b9-4473-bbd5-94fd588a97ff admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:02.620740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820d7bb-c3b9-4473-bbd5-94fd588a97ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:02.621046 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820d7bb-c3b9-4473-bbd5-94fd588a97ff admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:02.621729 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820d7bb-c3b9-4473-bbd5-94fd588a97ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:02.623718 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820d7bb-c3b9-4473-bbd5-94fd588a97ff admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:02.739014 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1355/2739] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:18:02 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:18:02.743375 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea2cfd-1b42-40f7-b549-a0d9569afe47 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:02.753895 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea2cfd-1b42-40f7-b549-a0d9569afe47 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:02.758493 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdabff7-36d1-4f99-b3cf-444e7d02c1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:02.759102 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdabff7-36d1-4f99-b3cf-444e7d02c1ec admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:02.759397 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdabff7-36d1-4f99-b3cf-444e7d02c1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:02.759665 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdabff7-36d1-4f99-b3cf-444e7d02c1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:02.760360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdabff7-36d1-4f99-b3cf-444e7d02c1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:02.762037 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdabff7-36d1-4f99-b3cf-444e7d02c1ec admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:02.772808 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1385/2740] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:02.777034 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820d7bb-c3b9-4473-bbd5-94fd588a97ff admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:02.787646 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820d7bb-c3b9-4473-bbd5-94fd588a97ff admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:02.792372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa52fd-7962-4e86-96f8-292686a3bf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:02.793025 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa52fd-7962-4e86-96f8-292686a3bf70 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:02.793355 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa52fd-7962-4e86-96f8-292686a3bf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:02.793646 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa52fd-7962-4e86-96f8-292686a3bf70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:02.794338 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa52fd-7962-4e86-96f8-292686a3bf70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:02.795985 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa52fd-7962-4e86-96f8-292686a3bf70 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:02.806876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1356/2741] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:02.810992 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdabff7-36d1-4f99-b3cf-444e7d02c1ec admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:02.821915 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdabff7-36d1-4f99-b3cf-444e7d02c1ec admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:02.827338 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13950c8-663b-44b2-9852-3d96513b2d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:02.828157 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13950c8-663b-44b2-9852-3d96513b2d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:02.828430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13950c8-663b-44b2-9852-3d96513b2d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:02.828711 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13950c8-663b-44b2-9852-3d96513b2d66 admin admin] PATH_INFO: `/v3/projects/9ffe2a44c1194c4a9598534bd08568d9/users/163ce5cbd7064dfb97cf871a21e13e41/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:02.845171 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13950c8-663b-44b2-9852-3d96513b2d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ffe2a44c1194c4a9598534bd08568d9, user_id=163ce5cbd7064dfb97cf871a21e13e41, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:02.847971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13950c8-663b-44b2-9852-3d96513b2d66 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:02.947447 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1386/2742] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:18:02 2022] PUT /identity/v3/projects/9ffe2a44c1194c4a9598534bd08568d9/users/163ce5cbd7064dfb97cf871a21e13e41/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:02.958420 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e53e8-4eeb-48c0-9599-438b5a2f1b23 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:02.958716 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e53e8-4eeb-48c0-9599-438b5a2f1b23 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:02.959054 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e53e8-4eeb-48c0-9599-438b5a2f1b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:02.987810 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6d3e53e8-4eeb-48c0-9599-438b5a2f1b23 None None] MFA Rules not processed for user `163ce5cbd7064dfb97cf871a21e13e41`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:02.989043 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6d3e53e8-4eeb-48c0-9599-438b5a2f1b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:03.052597 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1357/2743] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:18:03.057365 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13950c8-663b-44b2-9852-3d96513b2d66 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:03.119536 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13950c8-663b-44b2-9852-3d96513b2d66 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:03.124705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bed12-ec63-4531-8d65-9a17a23f721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:03.125341 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bed12-ec63-4531-8d65-9a17a23f721f admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:03.125623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bed12-ec63-4531-8d65-9a17a23f721f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:03.125897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bed12-ec63-4531-8d65-9a17a23f721f admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:03.126593 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bed12-ec63-4531-8d65-9a17a23f721f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:03.128495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bed12-ec63-4531-8d65-9a17a23f721f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:03.211051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1387/2744] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:18:03 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:18:03.215166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e53e8-4eeb-48c0-9599-438b5a2f1b23 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:03.226272 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e53e8-4eeb-48c0-9599-438b5a2f1b23 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:03.284991 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb731f-a7a1-42bb-8527-489c0bbe9cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:03.285568 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb731f-a7a1-42bb-8527-489c0bbe9cde admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:03.285853 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb731f-a7a1-42bb-8527-489c0bbe9cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:03.286130 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb731f-a7a1-42bb-8527-489c0bbe9cde admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:03.286796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb731f-a7a1-42bb-8527-489c0bbe9cde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:03.288836 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb731f-a7a1-42bb-8527-489c0bbe9cde admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:03.399344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1358/2745] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:18:03 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:18:03.409265 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bed12-ec63-4531-8d65-9a17a23f721f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:03.419886 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bed12-ec63-4531-8d65-9a17a23f721f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:03.425298 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa151697-31e8-4925-bce3-c7fa3943b59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:03.425945 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa151697-31e8-4925-bce3-c7fa3943b59b admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:03.426214 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa151697-31e8-4925-bce3-c7fa3943b59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:03.426484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa151697-31e8-4925-bce3-c7fa3943b59b admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:03.427173 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa151697-31e8-4925-bce3-c7fa3943b59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:03.428823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa151697-31e8-4925-bce3-c7fa3943b59b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:03.439838 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1388/2746] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:03.443843 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb731f-a7a1-42bb-8527-489c0bbe9cde admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:03.454896 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb731f-a7a1-42bb-8527-489c0bbe9cde admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:03.459571 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35630dad-639f-4a15-b4e7-54a87dcca72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:03.460192 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35630dad-639f-4a15-b4e7-54a87dcca72e admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:03.460477 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35630dad-639f-4a15-b4e7-54a87dcca72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:03.460783 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35630dad-639f-4a15-b4e7-54a87dcca72e admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:03.461489 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35630dad-639f-4a15-b4e7-54a87dcca72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:03.463078 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35630dad-639f-4a15-b4e7-54a87dcca72e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:03.473324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1359/2747] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:03.477309 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa151697-31e8-4925-bce3-c7fa3943b59b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:03.488103 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa151697-31e8-4925-bce3-c7fa3943b59b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:03.492703 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dbad0-295c-4780-82a9-253679f58d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:03.493379 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dbad0-295c-4780-82a9-253679f58d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:03.493656 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dbad0-295c-4780-82a9-253679f58d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:03.493926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dbad0-295c-4780-82a9-253679f58d75 admin admin] PATH_INFO: `/v3/projects/13b126ceb54c4bfaa2320d0c1fb881d0/users/2a3cf28e0a29409aa7a0a0b424894805/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:03.508501 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339dbad0-295c-4780-82a9-253679f58d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b126ceb54c4bfaa2320d0c1fb881d0, user_id=2a3cf28e0a29409aa7a0a0b424894805, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:03.511152 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339dbad0-295c-4780-82a9-253679f58d75 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:03.513324 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:03.630190 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1389/2748] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:18:03 2022] PUT /identity/v3/projects/13b126ceb54c4bfaa2320d0c1fb881d0/users/2a3cf28e0a29409aa7a0a0b424894805/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:03.640402 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3acc3-e10d-4905-9150-d5fedcc9f04f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:03.640684 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3acc3-e10d-4905-9150-d5fedcc9f04f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:03.640980 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3acc3-e10d-4905-9150-d5fedcc9f04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:03.649172 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:03.669852 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-64e3acc3-e10d-4905-9150-d5fedcc9f04f None None] MFA Rules not processed for user `2a3cf28e0a29409aa7a0a0b424894805`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:03.671228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-64e3acc3-e10d-4905-9150-d5fedcc9f04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:03.743990 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1360/2749] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:03.749020 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dbad0-295c-4780-82a9-253679f58d75 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:03.810442 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dbad0-295c-4780-82a9-253679f58d75 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:03.815658 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27326b-3d43-423e-a502-41d1ea4fad56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:03.816276 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27326b-3d43-423e-a502-41d1ea4fad56 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:03.816558 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27326b-3d43-423e-a502-41d1ea4fad56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:03.816866 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27326b-3d43-423e-a502-41d1ea4fad56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:03.817532 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27326b-3d43-423e-a502-41d1ea4fad56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:03.819444 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27326b-3d43-423e-a502-41d1ea4fad56 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:03.933537 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1390/2750] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:18:03 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:18:03.937849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3acc3-e10d-4905-9150-d5fedcc9f04f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:03.948802 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3acc3-e10d-4905-9150-d5fedcc9f04f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:04.007697 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e8de3-8365-4d56-95dc-9ca13676258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:04.008321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e8de3-8365-4d56-95dc-9ca13676258c admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:04.008603 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e8de3-8365-4d56-95dc-9ca13676258c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:04.008924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e8de3-8365-4d56-95dc-9ca13676258c admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:04.009583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e8de3-8365-4d56-95dc-9ca13676258c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:04.011496 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e8de3-8365-4d56-95dc-9ca13676258c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:04.114748 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1361/2751] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:18:03 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:18:04.117924 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27326b-3d43-423e-a502-41d1ea4fad56 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:04.128311 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27326b-3d43-423e-a502-41d1ea4fad56 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:04.132947 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10dbb7-ff2d-4510-a416-5503d74d83a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:04.133561 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10dbb7-ff2d-4510-a416-5503d74d83a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:04.133847 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10dbb7-ff2d-4510-a416-5503d74d83a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:04.134125 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10dbb7-ff2d-4510-a416-5503d74d83a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:04.134850 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10dbb7-ff2d-4510-a416-5503d74d83a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:04.136536 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10dbb7-ff2d-4510-a416-5503d74d83a7 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:04.148212 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1391/2752] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:04.152455 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e8de3-8365-4d56-95dc-9ca13676258c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:04.163389 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e8de3-8365-4d56-95dc-9ca13676258c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:04.168019 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef6145-66fb-447d-8384-a3e75f4ff4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:04.168680 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef6145-66fb-447d-8384-a3e75f4ff4f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:04.168990 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef6145-66fb-447d-8384-a3e75f4ff4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:04.169328 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef6145-66fb-447d-8384-a3e75f4ff4f4 admin admin] PATH_INFO: `/v3/projects/411678aceedb4297ac883605a460f0bc/users/e1724bfac95d4ead8d78dd8cdc4a75bb/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:04.185590 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef6145-66fb-447d-8384-a3e75f4ff4f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=411678aceedb4297ac883605a460f0bc, user_id=e1724bfac95d4ead8d78dd8cdc4a75bb, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:04.188479 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef6145-66fb-447d-8384-a3e75f4ff4f4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:04.304138 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1362/2753] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:18:04 2022] PUT /identity/v3/projects/411678aceedb4297ac883605a460f0bc/users/e1724bfac95d4ead8d78dd8cdc4a75bb/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:04.308188 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10dbb7-ff2d-4510-a416-5503d74d83a7 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:04.321640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10dbb7-ff2d-4510-a416-5503d74d83a7 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:04.396500 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f64c6f-4bdf-4664-abb8-6af0c36e70cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:04.397102 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f64c6f-4bdf-4664-abb8-6af0c36e70cf admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:04.397391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f64c6f-4bdf-4664-abb8-6af0c36e70cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:04.398372 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f64c6f-4bdf-4664-abb8-6af0c36e70cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:04.398556 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f64c6f-4bdf-4664-abb8-6af0c36e70cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:04.400388 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f64c6f-4bdf-4664-abb8-6af0c36e70cf admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:04.411759 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1392/2754] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:04.415973 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef6145-66fb-447d-8384-a3e75f4ff4f4 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:04.427575 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef6145-66fb-447d-8384-a3e75f4ff4f4 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:04.432635 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63ae06-cba1-4d79-ae16-29726986d20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:04.433343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63ae06-cba1-4d79-ae16-29726986d20c admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:04.433632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63ae06-cba1-4d79-ae16-29726986d20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:04.433914 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63ae06-cba1-4d79-ae16-29726986d20c admin admin] PATH_INFO: `/v3/projects/411678aceedb4297ac883605a460f0bc/users/e1724bfac95d4ead8d78dd8cdc4a75bb/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:04.436015 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63ae06-cba1-4d79-ae16-29726986d20c admin admin] RBAC: Authorizing `identity:create_grant(project_id=411678aceedb4297ac883605a460f0bc, user_id=e1724bfac95d4ead8d78dd8cdc4a75bb, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:04.439332 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63ae06-cba1-4d79-ae16-29726986d20c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:04.450193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1363/2755] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:18:04 2022] PUT /identity/v3/projects/411678aceedb4297ac883605a460f0bc/users/e1724bfac95d4ead8d78dd8cdc4a75bb/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:04.462113 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890bfe4-3939-491f-b3b3-d5e6ff734120 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:04.462460 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890bfe4-3939-491f-b3b3-d5e6ff734120 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:04.462738 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890bfe4-3939-491f-b3b3-d5e6ff734120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:04.490544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6890bfe4-3939-491f-b3b3-d5e6ff734120 None None] MFA Rules not processed for user `e1724bfac95d4ead8d78dd8cdc4a75bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:04.491740 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6890bfe4-3939-491f-b3b3-d5e6ff734120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:04.545438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:04.565401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1393/2756] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:04.575784 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63ae06-cba1-4d79-ae16-29726986d20c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:04.577611 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2c63ae06-cba1-4d79-ae16-29726986d20c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:04.630648 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:04.635818 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63ae06-cba1-4d79-ae16-29726986d20c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:04.639966 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391aa02-e64f-4c32-9931-ae4e95177347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:04.640579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391aa02-e64f-4c32-9931-ae4e95177347 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:04.641008 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391aa02-e64f-4c32-9931-ae4e95177347 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:04.641344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391aa02-e64f-4c32-9931-ae4e95177347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:04.650914 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391aa02-e64f-4c32-9931-ae4e95177347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:04.652363 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391aa02-e64f-4c32-9931-ae4e95177347 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:04.662496 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1364/2757] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:18:05.879650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890bfe4-3939-491f-b3b3-d5e6ff734120 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:05.881221 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6890bfe4-3939-491f-b3b3-d5e6ff734120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:05.894561 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890bfe4-3939-491f-b3b3-d5e6ff734120 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:05.898618 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c73b4a-e439-4370-b0a8-cbd29d64c016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:05.899254 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c73b4a-e439-4370-b0a8-cbd29d64c016 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:05.899541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c73b4a-e439-4370-b0a8-cbd29d64c016 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:05.899819 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c73b4a-e439-4370-b0a8-cbd29d64c016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:05.914617 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391aa02-e64f-4c32-9931-ae4e95177347 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:05.916087 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5391aa02-e64f-4c32-9931-ae4e95177347 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:05.962498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c73b4a-e439-4370-b0a8-cbd29d64c016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:05.963962 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c73b4a-e439-4370-b0a8-cbd29d64c016 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:05.973619 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1394/2758] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:18:05.983217 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391aa02-e64f-4c32-9931-ae4e95177347 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:05.989163 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8e708-292c-402b-9403-dea72f952cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:05.989758 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8e708-292c-402b-9403-dea72f952cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:05.990045 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8e708-292c-402b-9403-dea72f952cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:05.990323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8e708-292c-402b-9403-dea72f952cb6 admin admin] PATH_INFO: `/v3/users/f089ba9709a044c3a7d2ca8a3813976d` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:05.991526 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8e708-292c-402b-9403-dea72f952cb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f089ba9709a044c3a7d2ca8a3813976d)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:05.993468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8e708-292c-402b-9403-dea72f952cb6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:06.408941 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-57f8e708-292c-402b-9403-dea72f952cb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f089ba9709a044c3a7d2ca8a3813976d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:06.409636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-57f8e708-292c-402b-9403-dea72f952cb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f089ba9709a044c3a7d2ca8a3813976d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:06.421523 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-57f8e708-292c-402b-9403-dea72f952cb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f089ba9709a044c3a7d2ca8a3813976d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:06.428260 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-57f8e708-292c-402b-9403-dea72f952cb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f089ba9709a044c3a7d2ca8a3813976d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:06.428933 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-57f8e708-292c-402b-9403-dea72f952cb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f089ba9709a044c3a7d2ca8a3813976d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:06.558519 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1365/2759] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:18:05 2022] DELETE /identity/v3/users/f089ba9709a044c3a7d2ca8a3813976d => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:18:06.565137 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c54a9-b296-4ed6-8147-fd3c964afa8f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:06.565424 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c54a9-b296-4ed6-8147-fd3c964afa8f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:06.565698 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c54a9-b296-4ed6-8147-fd3c964afa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:06.584479 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-186c54a9-b296-4ed6-8147-fd3c964afa8f None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:06.585741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-186c54a9-b296-4ed6-8147-fd3c964afa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:06.643961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1395/2760] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:06.653589 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8e708-292c-402b-9403-dea72f952cb6 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:06.655070 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-57f8e708-292c-402b-9403-dea72f952cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:06.713327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8e708-292c-402b-9403-dea72f952cb6 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:06.716945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ab352-ebe6-420b-a56a-616e2ca619e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:06.717552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ab352-ebe6-420b-a56a-616e2ca619e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:06.717832 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ab352-ebe6-420b-a56a-616e2ca619e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:06.718105 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ab352-ebe6-420b-a56a-616e2ca619e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:06.727221 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ab352-ebe6-420b-a56a-616e2ca619e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:06.728709 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ab352-ebe6-420b-a56a-616e2ca619e8 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:06.738965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1366/2761] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:18:07.171106 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c54a9-b296-4ed6-8147-fd3c964afa8f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:07.173412 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-186c54a9-b296-4ed6-8147-fd3c964afa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:07.185901 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c54a9-b296-4ed6-8147-fd3c964afa8f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:07.190613 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a972b9f-0d24-42dd-a16c-76f484280f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:07.191315 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a972b9f-0d24-42dd-a16c-76f484280f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:07.191601 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a972b9f-0d24-42dd-a16c-76f484280f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:07.192286 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a972b9f-0d24-42dd-a16c-76f484280f4b admin admin] PATH_INFO: `/v3/projects/7ed034ce1d16449dab92dd7ff5ab0b4a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:07.193090 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a972b9f-0d24-42dd-a16c-76f484280f4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed034ce1d16449dab92dd7ff5ab0b4a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:07.197687 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a972b9f-0d24-42dd-a16c-76f484280f4b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:07.303068 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6a972b9f-0d24-42dd-a16c-76f484280f4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed034ce1d16449dab92dd7ff5ab0b4a', 'request_id': 'req-6a972b9f-0d24-42dd-a16c-76f484280f4b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:07.435135 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6a972b9f-0d24-42dd-a16c-76f484280f4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed034ce1d16449dab92dd7ff5ab0b4a', 'request_id': 'req-6a972b9f-0d24-42dd-a16c-76f484280f4b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:07.441484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6a972b9f-0d24-42dd-a16c-76f484280f4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed034ce1d16449dab92dd7ff5ab0b4a', 'request_id': 'req-6a972b9f-0d24-42dd-a16c-76f484280f4b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:07.453798 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6a972b9f-0d24-42dd-a16c-76f484280f4b admin admin] The token cache is being invalidate because project 7ed034ce1d16449dab92dd7ff5ab0b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:18:07.454087 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6a972b9f-0d24-42dd-a16c-76f484280f4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:07.456794 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6a972b9f-0d24-42dd-a16c-76f484280f4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:07.456794 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1396/2762] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:18:07 2022] DELETE /identity/v3/projects/7ed034ce1d16449dab92dd7ff5ab0b4a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:07.460214 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ab352-ebe6-420b-a56a-616e2ca619e8 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:07.470864 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ab352-ebe6-420b-a56a-616e2ca619e8 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:07.478877 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:07.528570 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3bc05-e19f-4950-8d94-7c01e2ab7997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:07.529245 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3bc05-e19f-4950-8d94-7c01e2ab7997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:07.529531 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3bc05-e19f-4950-8d94-7c01e2ab7997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:07.529810 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3bc05-e19f-4950-8d94-7c01e2ab7997 admin admin] PATH_INFO: `/v3/users/16624ea59efe4480b0c3669ed7cbf117` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:07.530987 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3bc05-e19f-4950-8d94-7c01e2ab7997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16624ea59efe4480b0c3669ed7cbf117)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:07.533521 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3bc05-e19f-4950-8d94-7c01e2ab7997 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:07.699840 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-14f3bc05-e19f-4950-8d94-7c01e2ab7997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16624ea59efe4480b0c3669ed7cbf117'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:07.700554 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-14f3bc05-e19f-4950-8d94-7c01e2ab7997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16624ea59efe4480b0c3669ed7cbf117'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:07.713295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-14f3bc05-e19f-4950-8d94-7c01e2ab7997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16624ea59efe4480b0c3669ed7cbf117'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:07.722231 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-14f3bc05-e19f-4950-8d94-7c01e2ab7997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16624ea59efe4480b0c3669ed7cbf117'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:07.722909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-14f3bc05-e19f-4950-8d94-7c01e2ab7997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16624ea59efe4480b0c3669ed7cbf117'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:07.812001 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1367/2763] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:18:07 2022] DELETE /identity/v3/users/16624ea59efe4480b0c3669ed7cbf117 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:08.225713 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a972b9f-0d24-42dd-a16c-76f484280f4b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:08.227431 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6a972b9f-0d24-42dd-a16c-76f484280f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:08.243513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a972b9f-0d24-42dd-a16c-76f484280f4b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:08.256237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:08.305828 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8007fd-f433-4db4-b6c9-887d9b2261ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:08.306470 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8007fd-f433-4db4-b6c9-887d9b2261ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:08.306778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8007fd-f433-4db4-b6c9-887d9b2261ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:08.307183 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8007fd-f433-4db4-b6c9-887d9b2261ec admin admin] PATH_INFO: `/v3/projects/0c09f98c17ed40e6a6985121e7629dd4` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:08.308411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8007fd-f433-4db4-b6c9-887d9b2261ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c09f98c17ed40e6a6985121e7629dd4)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:08.310620 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8007fd-f433-4db4-b6c9-887d9b2261ec admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:08.524311 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2a8007fd-f433-4db4-b6c9-887d9b2261ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c09f98c17ed40e6a6985121e7629dd4', 'request_id': 'req-2a8007fd-f433-4db4-b6c9-887d9b2261ec'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:08.640833 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2a8007fd-f433-4db4-b6c9-887d9b2261ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c09f98c17ed40e6a6985121e7629dd4', 'request_id': 'req-2a8007fd-f433-4db4-b6c9-887d9b2261ec'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:08.646867 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2a8007fd-f433-4db4-b6c9-887d9b2261ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c09f98c17ed40e6a6985121e7629dd4', 'request_id': 'req-2a8007fd-f433-4db4-b6c9-887d9b2261ec'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:08.657926 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2a8007fd-f433-4db4-b6c9-887d9b2261ec admin admin] The token cache is being invalidate because project 0c09f98c17ed40e6a6985121e7629dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:18:08.658235 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2a8007fd-f433-4db4-b6c9-887d9b2261ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:08.658886 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2a8007fd-f433-4db4-b6c9-887d9b2261ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:08.660390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1397/2764] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:18:08 2022] DELETE /identity/v3/projects/0c09f98c17ed40e6a6985121e7629dd4 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:08.665351 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a20413-19e3-46ac-ab31-08688ee5ff57 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:08.665851 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a20413-19e3-46ac-ab31-08688ee5ff57 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:08.665950 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a20413-19e3-46ac-ab31-08688ee5ff57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:08.685870 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-88a20413-19e3-46ac-ab31-08688ee5ff57 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:08.687170 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-88a20413-19e3-46ac-ab31-08688ee5ff57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:08.746468 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1368/2765] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:08.754541 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c53b5f-2400-4d06-bea4-b1509c3b21b9 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:08.754834 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c53b5f-2400-4d06-bea4-b1509c3b21b9 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:08.755113 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c53b5f-2400-4d06-bea4-b1509c3b21b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:08.774780 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f4c53b5f-2400-4d06-bea4-b1509c3b21b9 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:08.775923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f4c53b5f-2400-4d06-bea4-b1509c3b21b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:08.784385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1398/2766] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:08.788589 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a20413-19e3-46ac-ab31-08688ee5ff57 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:08.798497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a20413-19e3-46ac-ab31-08688ee5ff57 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:08.803659 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e6756-5808-46c7-becc-6fa0a2b20a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:08.804279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e6756-5808-46c7-becc-6fa0a2b20a93 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:08.804596 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e6756-5808-46c7-becc-6fa0a2b20a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:08.804926 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e6756-5808-46c7-becc-6fa0a2b20a93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:08.805633 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e6756-5808-46c7-becc-6fa0a2b20a93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:18:08.805945 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e6756-5808-46c7-becc-6fa0a2b20a93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:08.807548 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e6756-5808-46c7-becc-6fa0a2b20a93 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:08.819513 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1369/2767] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:18:08.823800 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c53b5f-2400-4d06-bea4-b1509c3b21b9 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:08.833682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c53b5f-2400-4d06-bea4-b1509c3b21b9 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:08.838352 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff3e67-0ca5-4713-944c-4c47aebaeabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:08.838964 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff3e67-0ca5-4713-944c-4c47aebaeabb admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:08.839245 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff3e67-0ca5-4713-944c-4c47aebaeabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:08.839518 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff3e67-0ca5-4713-944c-4c47aebaeabb admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:08.840184 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff3e67-0ca5-4713-944c-4c47aebaeabb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:08.842115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff3e67-0ca5-4713-944c-4c47aebaeabb admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:08.922663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1399/2768] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:18:08 2022] POST /identity/v3/projects => generated 409 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:18:08.927344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e6756-5808-46c7-becc-6fa0a2b20a93 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:08.942924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e6756-5808-46c7-becc-6fa0a2b20a93 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:08.957868 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:09.002806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1c59b-e821-4a0a-b7db-2d2a3440fcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:09.003940 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1c59b-e821-4a0a-b7db-2d2a3440fcb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:09.004583 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1c59b-e821-4a0a-b7db-2d2a3440fcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:09.005126 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1c59b-e821-4a0a-b7db-2d2a3440fcb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:09.005900 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1c59b-e821-4a0a-b7db-2d2a3440fcb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:09.008115 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1c59b-e821-4a0a-b7db-2d2a3440fcb0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:09.120151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1370/2769] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:18:08 2022] POST /identity/v3/users => generated 305 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:18:09.123800 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff3e67-0ca5-4713-944c-4c47aebaeabb admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:09.134985 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff3e67-0ca5-4713-944c-4c47aebaeabb admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:09.139721 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3231ee-47e1-47ec-ae70-bb4352227a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:09.140366 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3231ee-47e1-47ec-ae70-bb4352227a04 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:09.140651 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3231ee-47e1-47ec-ae70-bb4352227a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:09.140954 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3231ee-47e1-47ec-ae70-bb4352227a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:09.141654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3231ee-47e1-47ec-ae70-bb4352227a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:09.143290 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3231ee-47e1-47ec-ae70-bb4352227a04 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:09.153442 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1400/2770] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:09.157638 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1c59b-e821-4a0a-b7db-2d2a3440fcb0 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:09.168226 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1c59b-e821-4a0a-b7db-2d2a3440fcb0 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:09.173716 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543575df-94a6-42bc-89f1-418fbe201061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:09.174321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543575df-94a6-42bc-89f1-418fbe201061 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:09.174600 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543575df-94a6-42bc-89f1-418fbe201061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:09.174872 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543575df-94a6-42bc-89f1-418fbe201061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:09.175562 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543575df-94a6-42bc-89f1-418fbe201061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:09.177219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543575df-94a6-42bc-89f1-418fbe201061 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:09.188546 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1371/2771] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:09.192873 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3231ee-47e1-47ec-ae70-bb4352227a04 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:09.204028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3231ee-47e1-47ec-ae70-bb4352227a04 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:09.210116 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1283d-6d20-4501-a137-7a291b6f9f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:09.210825 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1283d-6d20-4501-a137-7a291b6f9f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:09.211136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1283d-6d20-4501-a137-7a291b6f9f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:09.211408 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1283d-6d20-4501-a137-7a291b6f9f96 admin admin] PATH_INFO: `/v3/projects/a2a9a8321205411880b40a2fe13417f0/users/248b09f9799d4f848241e00e6163b515/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:09.226390 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1283d-6d20-4501-a137-7a291b6f9f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a9a8321205411880b40a2fe13417f0, user_id=248b09f9799d4f848241e00e6163b515, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:09.229177 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1283d-6d20-4501-a137-7a291b6f9f96 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:09.368430 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1401/2772] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:18:09 2022] PUT /identity/v3/projects/a2a9a8321205411880b40a2fe13417f0/users/248b09f9799d4f848241e00e6163b515/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:09.370066 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55c729-2869-46cd-bcee-6309ff64d6d9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:09.370354 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55c729-2869-46cd-bcee-6309ff64d6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:09.370714 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55c729-2869-46cd-bcee-6309ff64d6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:09.399493 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9d55c729-2869-46cd-bcee-6309ff64d6d9 None None] MFA Rules not processed for user `248b09f9799d4f848241e00e6163b515`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:09.400724 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9d55c729-2869-46cd-bcee-6309ff64d6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:09.464427 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1372/2773] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:09 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:09.469536 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1283d-6d20-4501-a137-7a291b6f9f96 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:09.512263 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:09.536543 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1283d-6d20-4501-a137-7a291b6f9f96 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:09.541339 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103fab8-1f89-4808-af50-6fb9112044c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:09.542145 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103fab8-1f89-4808-af50-6fb9112044c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:09.542463 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103fab8-1f89-4808-af50-6fb9112044c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:09.542882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103fab8-1f89-4808-af50-6fb9112044c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:09.543837 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103fab8-1f89-4808-af50-6fb9112044c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:09.546428 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103fab8-1f89-4808-af50-6fb9112044c6 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:09.677391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1402/2774] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:18:09 2022] POST /identity/v3/projects => generated 407 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:18:09.681084 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55c729-2869-46cd-bcee-6309ff64d6d9 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:09.692150 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55c729-2869-46cd-bcee-6309ff64d6d9 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:09.751286 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923eb48-3bbc-419e-a609-5cf543055527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:09.751914 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923eb48-3bbc-419e-a609-5cf543055527 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:09.752245 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923eb48-3bbc-419e-a609-5cf543055527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:09.752558 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923eb48-3bbc-419e-a609-5cf543055527 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:09.753291 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923eb48-3bbc-419e-a609-5cf543055527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:09.755103 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923eb48-3bbc-419e-a609-5cf543055527 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:09.836335 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1373/2775] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:18:09 2022] POST /identity/v3/users => generated 310 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:18:09.837464 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103fab8-1f89-4808-af50-6fb9112044c6 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:09.848842 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103fab8-1f89-4808-af50-6fb9112044c6 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:09.853733 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83a1b5-cd27-4f96-8ec3-c45c8f4282f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:09.854348 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83a1b5-cd27-4f96-8ec3-c45c8f4282f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:09.854639 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83a1b5-cd27-4f96-8ec3-c45c8f4282f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:09.854901 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83a1b5-cd27-4f96-8ec3-c45c8f4282f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:09.855592 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83a1b5-cd27-4f96-8ec3-c45c8f4282f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:09.857273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83a1b5-cd27-4f96-8ec3-c45c8f4282f1 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:09.868314 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1403/2776] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:09.872641 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923eb48-3bbc-419e-a609-5cf543055527 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:09.894708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923eb48-3bbc-419e-a609-5cf543055527 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:09.907539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e865ea7-8b82-47ad-b284-06b57c7990fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:09.908242 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e865ea7-8b82-47ad-b284-06b57c7990fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:09.908521 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e865ea7-8b82-47ad-b284-06b57c7990fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:09.908831 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e865ea7-8b82-47ad-b284-06b57c7990fc admin admin] PATH_INFO: `/v3/projects/d9e7929f68564462bc2ab7daee48568a/users/4df76efc0d8e433c897e853ecf4a4d4a/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:09.923049 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:09.926624 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e865ea7-8b82-47ad-b284-06b57c7990fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e7929f68564462bc2ab7daee48568a, user_id=4df76efc0d8e433c897e853ecf4a4d4a, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:09.929623 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e865ea7-8b82-47ad-b284-06b57c7990fc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:10.041319 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1374/2777] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:18:09 2022] PUT /identity/v3/projects/d9e7929f68564462bc2ab7daee48568a/users/4df76efc0d8e433c897e853ecf4a4d4a/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:10.045592 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83a1b5-cd27-4f96-8ec3-c45c8f4282f1 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:10.055827 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83a1b5-cd27-4f96-8ec3-c45c8f4282f1 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:10.112165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf17d16-50cd-4e27-bc75-0db70a53c6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:10.112703 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf17d16-50cd-4e27-bc75-0db70a53c6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:10.113012 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf17d16-50cd-4e27-bc75-0db70a53c6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:10.113367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf17d16-50cd-4e27-bc75-0db70a53c6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:10.114063 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf17d16-50cd-4e27-bc75-0db70a53c6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:10.115682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf17d16-50cd-4e27-bc75-0db70a53c6d2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:10.125426 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1404/2778] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:10.129758 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e865ea7-8b82-47ad-b284-06b57c7990fc admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:10.140148 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e865ea7-8b82-47ad-b284-06b57c7990fc admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:10.145383 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1f365-6fb4-4fb3-a3ba-c503ba6799ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:10.146043 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1f365-6fb4-4fb3-a3ba-c503ba6799ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:10.146328 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1f365-6fb4-4fb3-a3ba-c503ba6799ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:10.146601 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1f365-6fb4-4fb3-a3ba-c503ba6799ed admin admin] PATH_INFO: `/v3/projects/d9e7929f68564462bc2ab7daee48568a/users/4df76efc0d8e433c897e853ecf4a4d4a/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:10.148603 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1f365-6fb4-4fb3-a3ba-c503ba6799ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e7929f68564462bc2ab7daee48568a, user_id=4df76efc0d8e433c897e853ecf4a4d4a, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:10.151276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1f365-6fb4-4fb3-a3ba-c503ba6799ed admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:10.162322 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1375/2779] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:18:10 2022] PUT /identity/v3/projects/d9e7929f68564462bc2ab7daee48568a/users/4df76efc0d8e433c897e853ecf4a4d4a/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:10.173785 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7882b-2879-4a0e-adb1-a86914f29ca3 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:10.174066 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7882b-2879-4a0e-adb1-a86914f29ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:10.174590 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7882b-2879-4a0e-adb1-a86914f29ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:10.203812 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-38e7882b-2879-4a0e-adb1-a86914f29ca3 None None] MFA Rules not processed for user `4df76efc0d8e433c897e853ecf4a4d4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:10.205072 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-38e7882b-2879-4a0e-adb1-a86914f29ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:10.277459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1405/2780] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:10 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:10.288705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1f365-6fb4-4fb3-a3ba-c503ba6799ed admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:10.290470 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-54b1f365-6fb4-4fb3-a3ba-c503ba6799ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:10.352509 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1f365-6fb4-4fb3-a3ba-c503ba6799ed admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:10.356549 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea77ff-e188-48b0-bc39-3a78512037bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:10.357219 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea77ff-e188-48b0-bc39-3a78512037bc service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:10.357506 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea77ff-e188-48b0-bc39-3a78512037bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:10.357829 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea77ff-e188-48b0-bc39-3a78512037bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:10.368191 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea77ff-e188-48b0-bc39-3a78512037bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:10.369213 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea77ff-e188-48b0-bc39-3a78512037bc service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:10.380044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1376/2781] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:10 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:18:10.948640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7882b-2879-4a0e-adb1-a86914f29ca3 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:10.957437 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7882b-2879-4a0e-adb1-a86914f29ca3 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:10.961032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295adeac-d9ed-478a-95b2-cc4398907620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:10.961652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295adeac-d9ed-478a-95b2-cc4398907620 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:10.961931 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295adeac-d9ed-478a-95b2-cc4398907620 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:10.962203 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295adeac-d9ed-478a-95b2-cc4398907620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:11.010429 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:11.038453 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295adeac-d9ed-478a-95b2-cc4398907620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:11.039941 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295adeac-d9ed-478a-95b2-cc4398907620 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:11.049230 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1406/2782] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:10 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:18:12.849529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea77ff-e188-48b0-bc39-3a78512037bc service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:12.851006 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-58ea77ff-e188-48b0-bc39-3a78512037bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:12.862858 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea77ff-e188-48b0-bc39-3a78512037bc service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:12.866553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3bf52-954e-45f9-984e-a1709d8c92ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:12.867168 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3bf52-954e-45f9-984e-a1709d8c92ea service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:12.867453 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3bf52-954e-45f9-984e-a1709d8c92ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:12.867732 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3bf52-954e-45f9-984e-a1709d8c92ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:12.869483 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-93f3bf52-954e-45f9-984e-a1709d8c92ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:12.933780 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3bf52-954e-45f9-984e-a1709d8c92ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:12.935226 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3bf52-954e-45f9-984e-a1709d8c92ea service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:12.945336 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1377/2783] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:18:17.275781 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295adeac-d9ed-478a-95b2-cc4398907620 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:17.277287 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-295adeac-d9ed-478a-95b2-cc4398907620 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:17.343443 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295adeac-d9ed-478a-95b2-cc4398907620 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:17.348874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15931e-6b7a-483d-a949-d2880d908704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:17.349527 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15931e-6b7a-483d-a949-d2880d908704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:17.349812 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15931e-6b7a-483d-a949-d2880d908704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:17.350090 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15931e-6b7a-483d-a949-d2880d908704 admin admin] PATH_INFO: `/v3/users/163ce5cbd7064dfb97cf871a21e13e41` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:17.351417 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15931e-6b7a-483d-a949-d2880d908704 admin admin] RBAC: Authorizing `identity:delete_user(user_id=163ce5cbd7064dfb97cf871a21e13e41)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:17.353459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15931e-6b7a-483d-a949-d2880d908704 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:17.492933 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ce15931e-6b7a-483d-a949-d2880d908704 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '163ce5cbd7064dfb97cf871a21e13e41'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:17.581076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ce15931e-6b7a-483d-a949-d2880d908704 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '163ce5cbd7064dfb97cf871a21e13e41'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:17.593732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ce15931e-6b7a-483d-a949-d2880d908704 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '163ce5cbd7064dfb97cf871a21e13e41'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:17.601239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ce15931e-6b7a-483d-a949-d2880d908704 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '163ce5cbd7064dfb97cf871a21e13e41'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:17.601914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ce15931e-6b7a-483d-a949-d2880d908704 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '163ce5cbd7064dfb97cf871a21e13e41'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:17.607878 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1407/2784] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:18:17 2022] DELETE /identity/v3/users/163ce5cbd7064dfb97cf871a21e13e41 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:17.613327 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696a921-5560-436c-b6bb-6372e6f69647 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:17.614161 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696a921-5560-436c-b6bb-6372e6f69647 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:17.614161 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696a921-5560-436c-b6bb-6372e6f69647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:17.633840 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1696a921-5560-436c-b6bb-6372e6f69647 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:17.635203 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1696a921-5560-436c-b6bb-6372e6f69647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:17.700734 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1378/2785] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:17.711448 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15931e-6b7a-483d-a949-d2880d908704 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:17.713015 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ce15931e-6b7a-483d-a949-d2880d908704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:17.776065 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15931e-6b7a-483d-a949-d2880d908704 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:17.779802 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334086e2-e58c-4b81-83ed-5623f9c3dca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:17.780427 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334086e2-e58c-4b81-83ed-5623f9c3dca4 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:17.782218 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334086e2-e58c-4b81-83ed-5623f9c3dca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:17.782218 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334086e2-e58c-4b81-83ed-5623f9c3dca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:17.787772 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:17.791719 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334086e2-e58c-4b81-83ed-5623f9c3dca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:17.793221 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334086e2-e58c-4b81-83ed-5623f9c3dca4 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:17.804145 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1408/2786] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:18:18.253875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696a921-5560-436c-b6bb-6372e6f69647 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:18.255333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1696a921-5560-436c-b6bb-6372e6f69647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:18.269304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696a921-5560-436c-b6bb-6372e6f69647 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:18.274175 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9910117-e9a2-42aa-83a9-de33e6df9355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:18.274841 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9910117-e9a2-42aa-83a9-de33e6df9355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:18.275125 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9910117-e9a2-42aa-83a9-de33e6df9355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:18.275401 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9910117-e9a2-42aa-83a9-de33e6df9355 admin admin] PATH_INFO: `/v3/projects/9ffe2a44c1194c4a9598534bd08568d9` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:18.276581 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9910117-e9a2-42aa-83a9-de33e6df9355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ffe2a44c1194c4a9598534bd08568d9)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:18.280341 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9910117-e9a2-42aa-83a9-de33e6df9355 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:18.300676 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:18.422883 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a9910117-e9a2-42aa-83a9-de33e6df9355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ffe2a44c1194c4a9598534bd08568d9', 'request_id': 'req-a9910117-e9a2-42aa-83a9-de33e6df9355'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:18.428880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a9910117-e9a2-42aa-83a9-de33e6df9355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ffe2a44c1194c4a9598534bd08568d9', 'request_id': 'req-a9910117-e9a2-42aa-83a9-de33e6df9355'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:18.435059 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a9910117-e9a2-42aa-83a9-de33e6df9355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ffe2a44c1194c4a9598534bd08568d9', 'request_id': 'req-a9910117-e9a2-42aa-83a9-de33e6df9355'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:18.531848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a9910117-e9a2-42aa-83a9-de33e6df9355 admin admin] The token cache is being invalidate because project 9ffe2a44c1194c4a9598534bd08568d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:18:18.532084 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a9910117-e9a2-42aa-83a9-de33e6df9355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:18.532702 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a9910117-e9a2-42aa-83a9-de33e6df9355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:18.539170 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1379/2787] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:18:18 2022] DELETE /identity/v3/projects/9ffe2a44c1194c4a9598534bd08568d9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:18.539306 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334086e2-e58c-4b81-83ed-5623f9c3dca4 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:18.549238 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334086e2-e58c-4b81-83ed-5623f9c3dca4 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:18.607127 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094409e-986f-462c-9ccf-9e76638e2f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:18.607806 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094409e-986f-462c-9ccf-9e76638e2f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:18.608089 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094409e-986f-462c-9ccf-9e76638e2f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:18.608367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094409e-986f-462c-9ccf-9e76638e2f55 admin admin] PATH_INFO: `/v3/users/2a3cf28e0a29409aa7a0a0b424894805` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:18.609584 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094409e-986f-462c-9ccf-9e76638e2f55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a3cf28e0a29409aa7a0a0b424894805)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:18.612321 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094409e-986f-462c-9ccf-9e76638e2f55 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:18.869776 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-3094409e-986f-462c-9ccf-9e76638e2f55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a3cf28e0a29409aa7a0a0b424894805'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:18.987296 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-3094409e-986f-462c-9ccf-9e76638e2f55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a3cf28e0a29409aa7a0a0b424894805'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:18.999813 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-3094409e-986f-462c-9ccf-9e76638e2f55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a3cf28e0a29409aa7a0a0b424894805'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:19.006528 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-3094409e-986f-462c-9ccf-9e76638e2f55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a3cf28e0a29409aa7a0a0b424894805'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:19.007167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-3094409e-986f-462c-9ccf-9e76638e2f55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a3cf28e0a29409aa7a0a0b424894805'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:19.013051 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1409/2788] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:18:18 2022] DELETE /identity/v3/users/2a3cf28e0a29409aa7a0a0b424894805 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:18:19.402344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9910117-e9a2-42aa-83a9-de33e6df9355 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:19.402344 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a9910117-e9a2-42aa-83a9-de33e6df9355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:19.416823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9910117-e9a2-42aa-83a9-de33e6df9355 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:19.476116 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd55fbd-9d63-4952-8769-800fac562c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:19.476909 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd55fbd-9d63-4952-8769-800fac562c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:19.477192 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd55fbd-9d63-4952-8769-800fac562c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:19.477465 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd55fbd-9d63-4952-8769-800fac562c2a admin admin] PATH_INFO: `/v3/projects/13b126ceb54c4bfaa2320d0c1fb881d0` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:19.478721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd55fbd-9d63-4952-8769-800fac562c2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b126ceb54c4bfaa2320d0c1fb881d0)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:19.480715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd55fbd-9d63-4952-8769-800fac562c2a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:19.507487 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094409e-986f-462c-9ccf-9e76638e2f55 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:19.508078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3094409e-986f-462c-9ccf-9e76638e2f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:19.521759 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094409e-986f-462c-9ccf-9e76638e2f55 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:19.526303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592b796-0cf8-4e9f-8082-992b0fa41a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:19.526934 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592b796-0cf8-4e9f-8082-992b0fa41a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:19.527211 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592b796-0cf8-4e9f-8082-992b0fa41a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:19.527478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592b796-0cf8-4e9f-8082-992b0fa41a9a admin admin] PATH_INFO: `/v3/users/248b09f9799d4f848241e00e6163b515` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:19.528631 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592b796-0cf8-4e9f-8082-992b0fa41a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=248b09f9799d4f848241e00e6163b515)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:19.530711 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592b796-0cf8-4e9f-8082-992b0fa41a9a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:19.671340 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-acd55fbd-9d63-4952-8769-800fac562c2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b126ceb54c4bfaa2320d0c1fb881d0', 'request_id': 'req-acd55fbd-9d63-4952-8769-800fac562c2a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:19.677208 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-acd55fbd-9d63-4952-8769-800fac562c2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b126ceb54c4bfaa2320d0c1fb881d0', 'request_id': 'req-acd55fbd-9d63-4952-8769-800fac562c2a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:19.683672 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-acd55fbd-9d63-4952-8769-800fac562c2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b126ceb54c4bfaa2320d0c1fb881d0', 'request_id': 'req-acd55fbd-9d63-4952-8769-800fac562c2a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:19.766880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-3592b796-0cf8-4e9f-8082-992b0fa41a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '248b09f9799d4f848241e00e6163b515'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:19.769430 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-acd55fbd-9d63-4952-8769-800fac562c2a admin admin] The token cache is being invalidate because project 13b126ceb54c4bfaa2320d0c1fb881d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:18:19.769727 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-acd55fbd-9d63-4952-8769-800fac562c2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:19.770357 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-acd55fbd-9d63-4952-8769-800fac562c2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:19.771899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1380/2789] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:18:19 2022] DELETE /identity/v3/projects/13b126ceb54c4bfaa2320d0c1fb881d0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:19.775727 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd55fbd-9d63-4952-8769-800fac562c2a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:19.777090 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-acd55fbd-9d63-4952-8769-800fac562c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:19.812017 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:19.837917 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-3592b796-0cf8-4e9f-8082-992b0fa41a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '248b09f9799d4f848241e00e6163b515'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:19.841950 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd55fbd-9d63-4952-8769-800fac562c2a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:19.847033 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57b37b-b405-4445-95a4-5c4372e5b79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:19.848088 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57b37b-b405-4445-95a4-5c4372e5b79b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:19.848088 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57b37b-b405-4445-95a4-5c4372e5b79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:19.848301 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57b37b-b405-4445-95a4-5c4372e5b79b admin admin] PATH_INFO: `/v3/users/e1724bfac95d4ead8d78dd8cdc4a75bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:19.849017 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:19.849529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57b37b-b405-4445-95a4-5c4372e5b79b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1724bfac95d4ead8d78dd8cdc4a75bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:19.851380 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-3592b796-0cf8-4e9f-8082-992b0fa41a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '248b09f9799d4f848241e00e6163b515'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:19.851509 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57b37b-b405-4445-95a4-5c4372e5b79b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:19.858634 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-3592b796-0cf8-4e9f-8082-992b0fa41a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '248b09f9799d4f848241e00e6163b515'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:19.859401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-3592b796-0cf8-4e9f-8082-992b0fa41a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '248b09f9799d4f848241e00e6163b515'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:19.866219 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1410/2790] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:18:19 2022] DELETE /identity/v3/users/248b09f9799d4f848241e00e6163b515 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:18:19.870623 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f1394-5805-47f8-8fd3-697b9812cc57 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:19.870937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f1394-5805-47f8-8fd3-697b9812cc57 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:19.871275 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f1394-5805-47f8-8fd3-697b9812cc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:19.890575 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c62f1394-5805-47f8-8fd3-697b9812cc57 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:19.891779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c62f1394-5805-47f8-8fd3-697b9812cc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:19.952434 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1411/2791] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:18:19.962076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f1394-5805-47f8-8fd3-697b9812cc57 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:19.963461 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c62f1394-5805-47f8-8fd3-697b9812cc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:20.019484 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f1394-5805-47f8-8fd3-697b9812cc57 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:20.023165 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41039c4-080d-4e8d-ae0f-59d9334b7abc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:20.023791 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41039c4-080d-4e8d-ae0f-59d9334b7abc service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:20.024075 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41039c4-080d-4e8d-ae0f-59d9334b7abc service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:20.024354 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41039c4-080d-4e8d-ae0f-59d9334b7abc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:20.034239 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41039c4-080d-4e8d-ae0f-59d9334b7abc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:20.034881 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3b57b37b-b405-4445-95a4-5c4372e5b79b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1724bfac95d4ead8d78dd8cdc4a75bb'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:20.035545 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3b57b37b-b405-4445-95a4-5c4372e5b79b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1724bfac95d4ead8d78dd8cdc4a75bb'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:20.035696 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41039c4-080d-4e8d-ae0f-59d9334b7abc service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:20.045407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1412/2792] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:18:20.047754 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3b57b37b-b405-4445-95a4-5c4372e5b79b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1724bfac95d4ead8d78dd8cdc4a75bb'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:20.055149 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3b57b37b-b405-4445-95a4-5c4372e5b79b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1724bfac95d4ead8d78dd8cdc4a75bb'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:20.055888 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3b57b37b-b405-4445-95a4-5c4372e5b79b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1724bfac95d4ead8d78dd8cdc4a75bb'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:20.102148 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41039c4-080d-4e8d-ae0f-59d9334b7abc service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:20.103565 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b41039c4-080d-4e8d-ae0f-59d9334b7abc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:20.118775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41039c4-080d-4e8d-ae0f-59d9334b7abc service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:20.125082 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54aabc8-e1fb-4c5e-93c4-6138f227bc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:20.125738 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aabc8-e1fb-4c5e-93c4-6138f227bc6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:20.126027 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aabc8-e1fb-4c5e-93c4-6138f227bc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:20.126302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aabc8-e1fb-4c5e-93c4-6138f227bc6c admin admin] PATH_INFO: `/v3/users/481892300c9041aa9f53c0bfbb4ac226` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:20.127522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54aabc8-e1fb-4c5e-93c4-6138f227bc6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=481892300c9041aa9f53c0bfbb4ac226)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:20.129982 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54aabc8-e1fb-4c5e-93c4-6138f227bc6c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:20.193323 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1381/2793] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:18:19 2022] DELETE /identity/v3/users/e1724bfac95d4ead8d78dd8cdc4a75bb => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:18:20.305832 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a54aabc8-e1fb-4c5e-93c4-6138f227bc6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '481892300c9041aa9f53c0bfbb4ac226'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:20.372236 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a54aabc8-e1fb-4c5e-93c4-6138f227bc6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '481892300c9041aa9f53c0bfbb4ac226'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:20.386223 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a54aabc8-e1fb-4c5e-93c4-6138f227bc6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '481892300c9041aa9f53c0bfbb4ac226'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:20.393811 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a54aabc8-e1fb-4c5e-93c4-6138f227bc6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '481892300c9041aa9f53c0bfbb4ac226'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:20.394570 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a54aabc8-e1fb-4c5e-93c4-6138f227bc6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '481892300c9041aa9f53c0bfbb4ac226'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:20.396970 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:20.402514 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1413/2794] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:18:20 2022] DELETE /identity/v3/users/481892300c9041aa9f53c0bfbb4ac226 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:18:20.406848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df5ea1-5c37-42c8-9337-ca7c2a6c4fbf None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:20.407341 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df5ea1-5c37-42c8-9337-ca7c2a6c4fbf None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:20.407957 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df5ea1-5c37-42c8-9337-ca7c2a6c4fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:20.428009 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-64df5ea1-5c37-42c8-9337-ca7c2a6c4fbf None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:20.436908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-64df5ea1-5c37-42c8-9337-ca7c2a6c4fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:20.498554 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1382/2795] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:20.510534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54aabc8-e1fb-4c5e-93c4-6138f227bc6c admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:20.511988 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a54aabc8-e1fb-4c5e-93c4-6138f227bc6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:20.543244 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df5ea1-5c37-42c8-9337-ca7c2a6c4fbf None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:20.545117 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-64df5ea1-5c37-42c8-9337-ca7c2a6c4fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:20.565427 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df5ea1-5c37-42c8-9337-ca7c2a6c4fbf None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:20.571276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60ecf0-b98e-4a02-99ab-73d7780d6ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:20.571662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60ecf0-b98e-4a02-99ab-73d7780d6ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:20.572489 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60ecf0-b98e-4a02-99ab-73d7780d6ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:20.572489 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60ecf0-b98e-4a02-99ab-73d7780d6ed7 admin admin] PATH_INFO: `/v3/projects/a2a9a8321205411880b40a2fe13417f0` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:20.574056 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60ecf0-b98e-4a02-99ab-73d7780d6ed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a9a8321205411880b40a2fe13417f0)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:20.576120 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60ecf0-b98e-4a02-99ab-73d7780d6ed7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:20.600529 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54aabc8-e1fb-4c5e-93c4-6138f227bc6c admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:20.604447 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb10298-5c9c-451f-8d80-c9189561faff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:20.608803 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb10298-5c9c-451f-8d80-c9189561faff service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:20.608803 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb10298-5c9c-451f-8d80-c9189561faff service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:20.608803 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb10298-5c9c-451f-8d80-c9189561faff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:20.616432 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb10298-5c9c-451f-8d80-c9189561faff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:20.617948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb10298-5c9c-451f-8d80-c9189561faff service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:20.628663 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1414/2796] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:18:20.660097 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb10298-5c9c-451f-8d80-c9189561faff service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:20.661557 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ddb10298-5c9c-451f-8d80-c9189561faff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:20.680012 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb10298-5c9c-451f-8d80-c9189561faff service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:20.707534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:20.708981 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fa60ecf0-b98e-4a02-99ab-73d7780d6ed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a9a8321205411880b40a2fe13417f0', 'request_id': 'req-fa60ecf0-b98e-4a02-99ab-73d7780d6ed7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:20.715875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fa60ecf0-b98e-4a02-99ab-73d7780d6ed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a9a8321205411880b40a2fe13417f0', 'request_id': 'req-fa60ecf0-b98e-4a02-99ab-73d7780d6ed7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:20.723507 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fa60ecf0-b98e-4a02-99ab-73d7780d6ed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a9a8321205411880b40a2fe13417f0', 'request_id': 'req-fa60ecf0-b98e-4a02-99ab-73d7780d6ed7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:20.752198 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9293d5-2848-4a7c-b186-619c997e8f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:20.752825 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9293d5-2848-4a7c-b186-619c997e8f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:20.753116 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9293d5-2848-4a7c-b186-619c997e8f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:20.753398 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9293d5-2848-4a7c-b186-619c997e8f61 admin admin] PATH_INFO: `/v3/projects/411678aceedb4297ac883605a460f0bc` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:20.754604 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9293d5-2848-4a7c-b186-619c997e8f61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=411678aceedb4297ac883605a460f0bc)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:20.756741 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9293d5-2848-4a7c-b186-619c997e8f61 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:20.797881 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fa60ecf0-b98e-4a02-99ab-73d7780d6ed7 admin admin] The token cache is being invalidate because project a2a9a8321205411880b40a2fe13417f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:18:20.798708 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fa60ecf0-b98e-4a02-99ab-73d7780d6ed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:20.799316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fa60ecf0-b98e-4a02-99ab-73d7780d6ed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:20.800894 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1383/2797] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:18:20 2022] DELETE /identity/v3/projects/a2a9a8321205411880b40a2fe13417f0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:20.804647 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60ecf0-b98e-4a02-99ab-73d7780d6ed7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:20.805966 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fa60ecf0-b98e-4a02-99ab-73d7780d6ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:20.819644 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60ecf0-b98e-4a02-99ab-73d7780d6ed7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:20.824396 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f2918-7f39-4da5-bbf4-cd2cfca5e7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:20.825206 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f2918-7f39-4da5-bbf4-cd2cfca5e7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:20.825484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f2918-7f39-4da5-bbf4-cd2cfca5e7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:20.825763 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f2918-7f39-4da5-bbf4-cd2cfca5e7c9 admin admin] PATH_INFO: `/v3/users/4df76efc0d8e433c897e853ecf4a4d4a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:20.827013 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f2918-7f39-4da5-bbf4-cd2cfca5e7c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4df76efc0d8e433c897e853ecf4a4d4a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:20.829026 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f2918-7f39-4da5-bbf4-cd2cfca5e7c9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:20.863345 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-dd9293d5-2848-4a7c-b186-619c997e8f61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411678aceedb4297ac883605a460f0bc', 'request_id': 'req-dd9293d5-2848-4a7c-b186-619c997e8f61'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:20.912054 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-dd9293d5-2848-4a7c-b186-619c997e8f61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411678aceedb4297ac883605a460f0bc', 'request_id': 'req-dd9293d5-2848-4a7c-b186-619c997e8f61'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:20.918914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-dd9293d5-2848-4a7c-b186-619c997e8f61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411678aceedb4297ac883605a460f0bc', 'request_id': 'req-dd9293d5-2848-4a7c-b186-619c997e8f61'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:20.931356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-dd9293d5-2848-4a7c-b186-619c997e8f61 admin admin] The token cache is being invalidate because project 411678aceedb4297ac883605a460f0bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:18:20.931652 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-dd9293d5-2848-4a7c-b186-619c997e8f61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:20.932389 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-dd9293d5-2848-4a7c-b186-619c997e8f61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:20.933953 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1415/2798] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:18:20 2022] DELETE /identity/v3/projects/411678aceedb4297ac883605a460f0bc => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:18:20.940699 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aba42a-fb85-4b2d-8b38-f99ccd145fc7 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:20.941022 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aba42a-fb85-4b2d-8b38-f99ccd145fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:20.941302 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aba42a-fb85-4b2d-8b38-f99ccd145fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:20.960998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f1aba42a-fb85-4b2d-8b38-f99ccd145fc7 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:20.962215 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f1aba42a-fb85-4b2d-8b38-f99ccd145fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:21.006239 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f41f2918-7f39-4da5-bbf4-cd2cfca5e7c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4df76efc0d8e433c897e853ecf4a4d4a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:21.007006 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f41f2918-7f39-4da5-bbf4-cd2cfca5e7c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4df76efc0d8e433c897e853ecf4a4d4a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:21.023789 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f41f2918-7f39-4da5-bbf4-cd2cfca5e7c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4df76efc0d8e433c897e853ecf4a4d4a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:21.027630 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1416/2799] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:18:21.031360 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f41f2918-7f39-4da5-bbf4-cd2cfca5e7c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4df76efc0d8e433c897e853ecf4a4d4a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:21.032095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f41f2918-7f39-4da5-bbf4-cd2cfca5e7c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4df76efc0d8e433c897e853ecf4a4d4a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:21.036330 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f3962-4827-4fef-90ed-d7578de53b6a None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:21.036737 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f3962-4827-4fef-90ed-d7578de53b6a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:21.042569 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f3962-4827-4fef-90ed-d7578de53b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:21.057166 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b70f3962-4827-4fef-90ed-d7578de53b6a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:21.058353 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b70f3962-4827-4fef-90ed-d7578de53b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:21.061735 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:21.069044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1417/2800] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:18:21.073278 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f3962-4827-4fef-90ed-d7578de53b6a None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:21.082076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f3962-4827-4fef-90ed-d7578de53b6a None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:21.086956 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0d481-ed23-4e18-9969-839f18173cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:21.087772 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0d481-ed23-4e18-9969-839f18173cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:21.087904 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0d481-ed23-4e18-9969-839f18173cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:21.088119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0d481-ed23-4e18-9969-839f18173cf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:21.088833 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0d481-ed23-4e18-9969-839f18173cf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:18:21.089213 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0d481-ed23-4e18-9969-839f18173cf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:21.090732 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0d481-ed23-4e18-9969-839f18173cf7 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:21.106471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1418/2801] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:18:21.106471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0d481-ed23-4e18-9969-839f18173cf7 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:21.106471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-81a0d481-ed23-4e18-9969-839f18173cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:21.119749 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0d481-ed23-4e18-9969-839f18173cf7 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:21.124921 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1384/2802] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:18:20 2022] DELETE /identity/v3/users/4df76efc0d8e433c897e853ecf4a4d4a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:18:21.124921 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f2918-7f39-4da5-bbf4-cd2cfca5e7c9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:21.191519 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1e355-8ff7-4478-bf97-d7b8aeb3eaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:21.192175 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1e355-8ff7-4478-bf97-d7b8aeb3eaa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:21.192462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1e355-8ff7-4478-bf97-d7b8aeb3eaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:21.192779 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1e355-8ff7-4478-bf97-d7b8aeb3eaa3 admin admin] PATH_INFO: `/v3/projects/777fa66329e644bba31019b0ca4caf35` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:21.193957 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1e355-8ff7-4478-bf97-d7b8aeb3eaa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=777fa66329e644bba31019b0ca4caf35)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:21.194489 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f2918-7f39-4da5-bbf4-cd2cfca5e7c9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:21.195889 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1e355-8ff7-4478-bf97-d7b8aeb3eaa3 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:21.200305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9a5a1-afdd-4436-b36e-939688f8b637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:21.203439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9a5a1-afdd-4436-b36e-939688f8b637 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:21.203439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9a5a1-afdd-4436-b36e-939688f8b637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:21.203439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9a5a1-afdd-4436-b36e-939688f8b637 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:21.203439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9a5a1-afdd-4436-b36e-939688f8b637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:21.204550 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9a5a1-afdd-4436-b36e-939688f8b637 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:21.291478 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1385/2803] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:18:21 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:18:21.296724 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9a5a1-afdd-4436-b36e-939688f8b637 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:21.335188 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:21.363792 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-13a1e355-8ff7-4478-bf97-d7b8aeb3eaa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777fa66329e644bba31019b0ca4caf35', 'request_id': 'req-13a1e355-8ff7-4478-bf97-d7b8aeb3eaa3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:21.371559 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9a5a1-afdd-4436-b36e-939688f8b637 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:21.432191 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6519a7b-cdeb-4cc6-9268-59dd6d0c1a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:21.433042 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6519a7b-cdeb-4cc6-9268-59dd6d0c1a58 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:21.433335 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6519a7b-cdeb-4cc6-9268-59dd6d0c1a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:21.433614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6519a7b-cdeb-4cc6-9268-59dd6d0c1a58 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:21.434289 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6519a7b-cdeb-4cc6-9268-59dd6d0c1a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:21.436221 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6519a7b-cdeb-4cc6-9268-59dd6d0c1a58 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:21.438075 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-13a1e355-8ff7-4478-bf97-d7b8aeb3eaa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777fa66329e644bba31019b0ca4caf35', 'request_id': 'req-13a1e355-8ff7-4478-bf97-d7b8aeb3eaa3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:21.444782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-13a1e355-8ff7-4478-bf97-d7b8aeb3eaa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777fa66329e644bba31019b0ca4caf35', 'request_id': 'req-13a1e355-8ff7-4478-bf97-d7b8aeb3eaa3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:21.457346 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-13a1e355-8ff7-4478-bf97-d7b8aeb3eaa3 admin admin] The token cache is being invalidate because project 777fa66329e644bba31019b0ca4caf35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:18:21.457640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-13a1e355-8ff7-4478-bf97-d7b8aeb3eaa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:21.458334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-13a1e355-8ff7-4478-bf97-d7b8aeb3eaa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:21.459856 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1419/2804] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:18:21 2022] DELETE /identity/v3/projects/777fa66329e644bba31019b0ca4caf35 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:21.564516 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1386/2805] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:18:21 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:18:21.565693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1e355-8ff7-4478-bf97-d7b8aeb3eaa3 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:21.567153 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-13a1e355-8ff7-4478-bf97-d7b8aeb3eaa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:21.581448 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1e355-8ff7-4478-bf97-d7b8aeb3eaa3 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:21.586751 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af7030-b3ec-4613-91c9-fd0ee3993852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:21.587368 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af7030-b3ec-4613-91c9-fd0ee3993852 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:21.587673 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af7030-b3ec-4613-91c9-fd0ee3993852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:21.587948 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af7030-b3ec-4613-91c9-fd0ee3993852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:21.588660 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af7030-b3ec-4613-91c9-fd0ee3993852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:21.590320 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af7030-b3ec-4613-91c9-fd0ee3993852 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:21.606272 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1420/2806] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:21.606485 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6519a7b-cdeb-4cc6-9268-59dd6d0c1a58 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:21.607590 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c6519a7b-cdeb-4cc6-9268-59dd6d0c1a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:21.607734 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af7030-b3ec-4613-91c9-fd0ee3993852 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:21.621126 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6519a7b-cdeb-4cc6-9268-59dd6d0c1a58 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:21.628261 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af7030-b3ec-4613-91c9-fd0ee3993852 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:21.633908 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284edef-2f6d-4c2a-bc95-5593e11e8c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:21.634994 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284edef-2f6d-4c2a-bc95-5593e11e8c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:21.634994 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284edef-2f6d-4c2a-bc95-5593e11e8c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:21.635208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284edef-2f6d-4c2a-bc95-5593e11e8c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:21.635829 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284edef-2f6d-4c2a-bc95-5593e11e8c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:21.637534 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284edef-2f6d-4c2a-bc95-5593e11e8c8f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:21.642818 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144d724-9eec-40bd-bea6-2f64489dfcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:21.642818 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144d724-9eec-40bd-bea6-2f64489dfcec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:21.642818 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144d724-9eec-40bd-bea6-2f64489dfcec admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:21.642818 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144d724-9eec-40bd-bea6-2f64489dfcec admin admin] PATH_INFO: `/v3/projects/d9e7929f68564462bc2ab7daee48568a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:21.643636 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144d724-9eec-40bd-bea6-2f64489dfcec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9e7929f68564462bc2ab7daee48568a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:21.643818 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144d724-9eec-40bd-bea6-2f64489dfcec admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:21.654607 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1421/2807] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:21.655626 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284edef-2f6d-4c2a-bc95-5593e11e8c8f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:21.667910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284edef-2f6d-4c2a-bc95-5593e11e8c8f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:21.673620 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6f7f8-661a-486c-81c5-5ac96db31435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:21.674297 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6f7f8-661a-486c-81c5-5ac96db31435 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:21.674582 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6f7f8-661a-486c-81c5-5ac96db31435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:21.674860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6f7f8-661a-486c-81c5-5ac96db31435 admin admin] PATH_INFO: `/v3/projects/0b881a4801cc451a8b8fe98db8ec5467/users/81b94f9554b74e9e9ab8e040dc73c526/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:21.692406 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6f7f8-661a-486c-81c5-5ac96db31435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b881a4801cc451a8b8fe98db8ec5467, user_id=81b94f9554b74e9e9ab8e040dc73c526, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:21.695249 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6f7f8-661a-486c-81c5-5ac96db31435 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:21.801357 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:21.806820 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1422/2808] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:18:21 2022] PUT /identity/v3/projects/0b881a4801cc451a8b8fe98db8ec5467/users/81b94f9554b74e9e9ab8e040dc73c526/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:21.815164 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b144d724-9eec-40bd-bea6-2f64489dfcec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e7929f68564462bc2ab7daee48568a', 'request_id': 'req-b144d724-9eec-40bd-bea6-2f64489dfcec'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:21.821166 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b144d724-9eec-40bd-bea6-2f64489dfcec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e7929f68564462bc2ab7daee48568a', 'request_id': 'req-b144d724-9eec-40bd-bea6-2f64489dfcec'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:21.829000 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b144d724-9eec-40bd-bea6-2f64489dfcec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e7929f68564462bc2ab7daee48568a', 'request_id': 'req-b144d724-9eec-40bd-bea6-2f64489dfcec'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:21.875276 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e6fe1-fe36-4332-8832-b3323ab7eb16 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:21.876031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e6fe1-fe36-4332-8832-b3323ab7eb16 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:21.876031 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e6fe1-fe36-4332-8832-b3323ab7eb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:21.904459 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b65e6fe1-fe36-4332-8832-b3323ab7eb16 None None] MFA Rules not processed for user `81b94f9554b74e9e9ab8e040dc73c526`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:21.905717 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b65e6fe1-fe36-4332-8832-b3323ab7eb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:21.949602 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b144d724-9eec-40bd-bea6-2f64489dfcec admin admin] The token cache is being invalidate because project d9e7929f68564462bc2ab7daee48568a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:18:21.949924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b144d724-9eec-40bd-bea6-2f64489dfcec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:21.950533 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b144d724-9eec-40bd-bea6-2f64489dfcec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:21.952094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1387/2809] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:18:21 2022] DELETE /identity/v3/projects/d9e7929f68564462bc2ab7daee48568a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:21.957661 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2b861-696a-498e-b000-8d2d6b1af4a4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:21.957943 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2b861-696a-498e-b000-8d2d6b1af4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:21.958214 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2b861-696a-498e-b000-8d2d6b1af4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:21.969316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1423/2810] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:18:21.979083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7fd2b861-696a-498e-b000-8d2d6b1af4a4 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:21.979083 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7fd2b861-696a-498e-b000-8d2d6b1af4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:21.981310 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e6fe1-fe36-4332-8832-b3323ab7eb16 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:21.982650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b65e6fe1-fe36-4332-8832-b3323ab7eb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:22.027539 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:22.040033 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e6fe1-fe36-4332-8832-b3323ab7eb16 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:22.041182 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1388/2811] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:18:22.043786 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038d699-a47f-4e33-ba28-096d0354f6b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:22.044401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038d699-a47f-4e33-ba28-096d0354f6b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:22.044679 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038d699-a47f-4e33-ba28-096d0354f6b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:22.045016 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038d699-a47f-4e33-ba28-096d0354f6b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:22.048866 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c795a3-de82-4826-b815-eb119dbef353 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:22.049163 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c795a3-de82-4826-b815-eb119dbef353 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:22.049444 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c795a3-de82-4826-b815-eb119dbef353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:22.053839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038d699-a47f-4e33-ba28-096d0354f6b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:22.055272 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038d699-a47f-4e33-ba28-096d0354f6b1 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:22.064889 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1424/2812] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:18:22.069571 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-26c795a3-de82-4826-b815-eb119dbef353 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:22.070764 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-26c795a3-de82-4826-b815-eb119dbef353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:22.079176 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1389/2813] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:18:22.084078 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038d699-a47f-4e33-ba28-096d0354f6b1 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:22.094778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038d699-a47f-4e33-ba28-096d0354f6b1 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:22.099509 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d2057-b962-483a-b848-b6285b3ac0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:22.100120 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d2057-b962-483a-b848-b6285b3ac0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:22.100400 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d2057-b962-483a-b848-b6285b3ac0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:22.100671 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d2057-b962-483a-b848-b6285b3ac0d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:22.101401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d2057-b962-483a-b848-b6285b3ac0d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:18:22.101708 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d2057-b962-483a-b848-b6285b3ac0d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:22.103311 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d2057-b962-483a-b848-b6285b3ac0d5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:22.115410 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1425/2814] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:18:22.119973 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c795a3-de82-4826-b815-eb119dbef353 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:22.130212 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c795a3-de82-4826-b815-eb119dbef353 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:22.137031 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d27cfa-31b5-4777-9770-5af9f33598f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:22.137648 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d27cfa-31b5-4777-9770-5af9f33598f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:22.140135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d27cfa-31b5-4777-9770-5af9f33598f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:22.140135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d27cfa-31b5-4777-9770-5af9f33598f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:22.140135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d27cfa-31b5-4777-9770-5af9f33598f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:22.140982 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d27cfa-31b5-4777-9770-5af9f33598f8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:22.257339 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1390/2815] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:18:22 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:18:22.261626 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d2057-b962-483a-b848-b6285b3ac0d5 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:22.271719 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d2057-b962-483a-b848-b6285b3ac0d5 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:22.328021 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e31b93-1d1b-4fcd-b47d-e3fed53a7184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:22.328568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e31b93-1d1b-4fcd-b47d-e3fed53a7184 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:22.329006 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e31b93-1d1b-4fcd-b47d-e3fed53a7184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:22.329316 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e31b93-1d1b-4fcd-b47d-e3fed53a7184 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:22.329981 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e31b93-1d1b-4fcd-b47d-e3fed53a7184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:22.332032 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e31b93-1d1b-4fcd-b47d-e3fed53a7184 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:22.424199 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1426/2816] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:18:22 2022] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:18:22.428324 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d27cfa-31b5-4777-9770-5af9f33598f8 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:22.440135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d27cfa-31b5-4777-9770-5af9f33598f8 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:22.445175 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acc1d7-b029-4d20-81d3-2a09ee2d4ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:22.445791 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acc1d7-b029-4d20-81d3-2a09ee2d4ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:22.446075 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acc1d7-b029-4d20-81d3-2a09ee2d4ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:22.446350 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acc1d7-b029-4d20-81d3-2a09ee2d4ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:22.447043 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29acc1d7-b029-4d20-81d3-2a09ee2d4ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:22.448642 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29acc1d7-b029-4d20-81d3-2a09ee2d4ac7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:22.458985 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1391/2817] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:22.463048 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e31b93-1d1b-4fcd-b47d-e3fed53a7184 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:22.473274 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e31b93-1d1b-4fcd-b47d-e3fed53a7184 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:22.478009 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b585d-73bc-4d9b-810c-c27db5a4d138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:22.480237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b585d-73bc-4d9b-810c-c27db5a4d138 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:22.480237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b585d-73bc-4d9b-810c-c27db5a4d138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:22.480237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b585d-73bc-4d9b-810c-c27db5a4d138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:22.480237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b585d-73bc-4d9b-810c-c27db5a4d138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:22.481912 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b585d-73bc-4d9b-810c-c27db5a4d138 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:22.487024 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:22.496588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1427/2818] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:22.500924 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acc1d7-b029-4d20-81d3-2a09ee2d4ac7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:22.511907 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acc1d7-b029-4d20-81d3-2a09ee2d4ac7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:22.516497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ff478-f11c-4b5a-9c9c-c364d1352a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:22.517215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ff478-f11c-4b5a-9c9c-c364d1352a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:22.517518 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ff478-f11c-4b5a-9c9c-c364d1352a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:22.517783 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ff478-f11c-4b5a-9c9c-c364d1352a71 admin admin] PATH_INFO: `/v3/projects/c1ab633679f84e2998727dde53726784/users/51f2945c290645e48f227a902edb9d89/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:22.532086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ff478-f11c-4b5a-9c9c-c364d1352a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ab633679f84e2998727dde53726784, user_id=51f2945c290645e48f227a902edb9d89, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:22.534784 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ff478-f11c-4b5a-9c9c-c364d1352a71 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:22.611282 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1392/2819] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:18:22 2022] PUT /identity/v3/projects/c1ab633679f84e2998727dde53726784/users/51f2945c290645e48f227a902edb9d89/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:22.621724 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ffd91-c1f5-4827-8597-7a63985ff532 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:22.622020 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ffd91-c1f5-4827-8597-7a63985ff532 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:22.622303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ffd91-c1f5-4827-8597-7a63985ff532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:22.650344 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-2e6ffd91-c1f5-4827-8597-7a63985ff532 None None] MFA Rules not processed for user `51f2945c290645e48f227a902edb9d89`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:22.651583 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2e6ffd91-c1f5-4827-8597-7a63985ff532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:22.724353 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1428/2820] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:22.727580 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ff478-f11c-4b5a-9c9c-c364d1352a71 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:22.795101 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ff478-f11c-4b5a-9c9c-c364d1352a71 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:22.800935 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c37b7-4e4e-4cd7-b0f9-c797ea388408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:22.801570 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c37b7-4e4e-4cd7-b0f9-c797ea388408 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:22.801880 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c37b7-4e4e-4cd7-b0f9-c797ea388408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:22.802179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c37b7-4e4e-4cd7-b0f9-c797ea388408 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:22.802850 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c37b7-4e4e-4cd7-b0f9-c797ea388408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:22.804775 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c37b7-4e4e-4cd7-b0f9-c797ea388408 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:22.916651 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1393/2821] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:18:22 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:18:22.921247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ffd91-c1f5-4827-8597-7a63985ff532 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:22.932728 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ffd91-c1f5-4827-8597-7a63985ff532 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:22.993354 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafbfe1-cacf-4c4e-bcf7-b10245e2769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:22.993982 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafbfe1-cacf-4c4e-bcf7-b10245e2769f admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:22.994267 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafbfe1-cacf-4c4e-bcf7-b10245e2769f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:22.994581 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafbfe1-cacf-4c4e-bcf7-b10245e2769f admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:22.995244 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafbfe1-cacf-4c4e-bcf7-b10245e2769f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:22.997221 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafbfe1-cacf-4c4e-bcf7-b10245e2769f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:23.098369 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1429/2822] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:18:22 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:18:23.102591 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c37b7-4e4e-4cd7-b0f9-c797ea388408 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:23.113712 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c37b7-4e4e-4cd7-b0f9-c797ea388408 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:23.118292 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e77084-7487-44b4-a81d-b83b8549c712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:23.118989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e77084-7487-44b4-a81d-b83b8549c712 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:23.119221 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e77084-7487-44b4-a81d-b83b8549c712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:23.119489 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e77084-7487-44b4-a81d-b83b8549c712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:23.120175 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e77084-7487-44b4-a81d-b83b8549c712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:23.121807 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e77084-7487-44b4-a81d-b83b8549c712 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:23.132252 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1394/2823] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:23.136532 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafbfe1-cacf-4c4e-bcf7-b10245e2769f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:23.147290 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafbfe1-cacf-4c4e-bcf7-b10245e2769f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:23.151955 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec1b05-9edd-4171-bbd3-979c171032df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:23.152612 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec1b05-9edd-4171-bbd3-979c171032df admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:23.152941 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec1b05-9edd-4171-bbd3-979c171032df admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:23.153247 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec1b05-9edd-4171-bbd3-979c171032df admin admin] PATH_INFO: `/v3/projects/873e44242c5a474488a8afccd50071a7/users/388cfd3c8138449c90a98be0708c6a76/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:23.168920 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec1b05-9edd-4171-bbd3-979c171032df admin admin] RBAC: Authorizing `identity:create_grant(project_id=873e44242c5a474488a8afccd50071a7, user_id=388cfd3c8138449c90a98be0708c6a76, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:23.171560 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec1b05-9edd-4171-bbd3-979c171032df admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:23.240109 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1430/2824] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:18:23 2022] PUT /identity/v3/projects/873e44242c5a474488a8afccd50071a7/users/388cfd3c8138449c90a98be0708c6a76/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:18:23.244050 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e77084-7487-44b4-a81d-b83b8549c712 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:23.254644 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e77084-7487-44b4-a81d-b83b8549c712 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:23.312795 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5449a2-7f1a-4064-bb22-193cb066b6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:23.313433 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5449a2-7f1a-4064-bb22-193cb066b6cb admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:23.314348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5449a2-7f1a-4064-bb22-193cb066b6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:23.314517 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5449a2-7f1a-4064-bb22-193cb066b6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:23.315228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5449a2-7f1a-4064-bb22-193cb066b6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:23.317014 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5449a2-7f1a-4064-bb22-193cb066b6cb admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:23.322587 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:23.327549 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1395/2825] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:23.332591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec1b05-9edd-4171-bbd3-979c171032df admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:23.343337 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec1b05-9edd-4171-bbd3-979c171032df admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:23.348127 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dce42d-ef63-4b96-86fb-e6699b1cc282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:23.348826 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dce42d-ef63-4b96-86fb-e6699b1cc282 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:23.349113 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dce42d-ef63-4b96-86fb-e6699b1cc282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:23.349393 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dce42d-ef63-4b96-86fb-e6699b1cc282 admin admin] PATH_INFO: `/v3/projects/873e44242c5a474488a8afccd50071a7/users/388cfd3c8138449c90a98be0708c6a76/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:23.351478 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dce42d-ef63-4b96-86fb-e6699b1cc282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=873e44242c5a474488a8afccd50071a7, user_id=388cfd3c8138449c90a98be0708c6a76, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:23.354312 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dce42d-ef63-4b96-86fb-e6699b1cc282 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:23.365997 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1431/2826] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:18:23 2022] PUT /identity/v3/projects/873e44242c5a474488a8afccd50071a7/users/388cfd3c8138449c90a98be0708c6a76/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:23.432419 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0143f3-6e9e-4260-b3c7-75a8d3fccc64 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:23.432656 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0143f3-6e9e-4260-b3c7-75a8d3fccc64 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:23.432965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0143f3-6e9e-4260-b3c7-75a8d3fccc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:23.463110 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0d0143f3-6e9e-4260-b3c7-75a8d3fccc64 None None] MFA Rules not processed for user `388cfd3c8138449c90a98be0708c6a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:23.464401 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0d0143f3-6e9e-4260-b3c7-75a8d3fccc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:23.532061 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1396/2827] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:18:23.543696 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dce42d-ef63-4b96-86fb-e6699b1cc282 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:23.584738 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:23.598860 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dce42d-ef63-4b96-86fb-e6699b1cc282 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:23.602531 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a37da-1c7a-48db-9159-cbff486ce094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:23.603147 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a37da-1c7a-48db-9159-cbff486ce094 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:23.603431 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a37da-1c7a-48db-9159-cbff486ce094 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:23.603707 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a37da-1c7a-48db-9159-cbff486ce094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:23.613617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a37da-1c7a-48db-9159-cbff486ce094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:23.615076 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a37da-1c7a-48db-9159-cbff486ce094 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:23.624458 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1432/2828] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:18:24.758775 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0143f3-6e9e-4260-b3c7-75a8d3fccc64 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:24.822719 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0143f3-6e9e-4260-b3c7-75a8d3fccc64 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:24.827456 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48585d5-7703-492d-8207-9b1c5e278528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:24.828132 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48585d5-7703-492d-8207-9b1c5e278528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:24.828419 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48585d5-7703-492d-8207-9b1c5e278528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:24.828694 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48585d5-7703-492d-8207-9b1c5e278528 admin admin] PATH_INFO: `/v3/users/51f2945c290645e48f227a902edb9d89` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:24.829919 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48585d5-7703-492d-8207-9b1c5e278528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51f2945c290645e48f227a902edb9d89)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:24.831908 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48585d5-7703-492d-8207-9b1c5e278528 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:25.034621 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b48585d5-7703-492d-8207-9b1c5e278528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51f2945c290645e48f227a902edb9d89'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:25.037893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b48585d5-7703-492d-8207-9b1c5e278528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51f2945c290645e48f227a902edb9d89'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:25.052533 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b48585d5-7703-492d-8207-9b1c5e278528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51f2945c290645e48f227a902edb9d89'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:25.059573 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b48585d5-7703-492d-8207-9b1c5e278528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51f2945c290645e48f227a902edb9d89'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:25.060269 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b48585d5-7703-492d-8207-9b1c5e278528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51f2945c290645e48f227a902edb9d89'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:25.135119 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1397/2829] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:18:24 2022] DELETE /identity/v3/users/51f2945c290645e48f227a902edb9d89 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:25.139775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130012a-478b-49f3-aee6-16ab92675af2 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:25.140237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130012a-478b-49f3-aee6-16ab92675af2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:25.140490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130012a-478b-49f3-aee6-16ab92675af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:25.159798 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f130012a-478b-49f3-aee6-16ab92675af2 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:25.161049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f130012a-478b-49f3-aee6-16ab92675af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:25.222568 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1433/2830] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:25.233306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48585d5-7703-492d-8207-9b1c5e278528 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:25.233802 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b48585d5-7703-492d-8207-9b1c5e278528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:25.240571 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:25.290900 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48585d5-7703-492d-8207-9b1c5e278528 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:25.295674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4ed02-d50b-4828-a11b-c4e27c55042f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:25.296369 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4ed02-d50b-4828-a11b-c4e27c55042f service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:25.296775 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4ed02-d50b-4828-a11b-c4e27c55042f service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:25.297076 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4ed02-d50b-4828-a11b-c4e27c55042f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:25.306085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4ed02-d50b-4828-a11b-c4e27c55042f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:25.307574 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4ed02-d50b-4828-a11b-c4e27c55042f service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:25.318965 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1398/2831] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:18:25.784655 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130012a-478b-49f3-aee6-16ab92675af2 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:25.786188 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f130012a-478b-49f3-aee6-16ab92675af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:25.803687 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130012a-478b-49f3-aee6-16ab92675af2 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:25.811508 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e844f6-7843-40ff-95d6-e8430f8b4536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:25.812166 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e844f6-7843-40ff-95d6-e8430f8b4536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:25.812546 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e844f6-7843-40ff-95d6-e8430f8b4536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:25.812852 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e844f6-7843-40ff-95d6-e8430f8b4536 admin admin] PATH_INFO: `/v3/projects/c1ab633679f84e2998727dde53726784` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:25.814603 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e844f6-7843-40ff-95d6-e8430f8b4536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ab633679f84e2998727dde53726784)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:25.816518 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e844f6-7843-40ff-95d6-e8430f8b4536 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:25.920438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-08e844f6-7843-40ff-95d6-e8430f8b4536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ab633679f84e2998727dde53726784', 'request_id': 'req-08e844f6-7843-40ff-95d6-e8430f8b4536'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:25.977071 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-08e844f6-7843-40ff-95d6-e8430f8b4536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ab633679f84e2998727dde53726784', 'request_id': 'req-08e844f6-7843-40ff-95d6-e8430f8b4536'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:25.982890 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-08e844f6-7843-40ff-95d6-e8430f8b4536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ab633679f84e2998727dde53726784', 'request_id': 'req-08e844f6-7843-40ff-95d6-e8430f8b4536'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:25.994743 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-08e844f6-7843-40ff-95d6-e8430f8b4536 admin admin] The token cache is being invalidate because project c1ab633679f84e2998727dde53726784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:18:25.995041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-08e844f6-7843-40ff-95d6-e8430f8b4536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:25.995668 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-08e844f6-7843-40ff-95d6-e8430f8b4536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:25.997205 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1434/2832] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:18:25 2022] DELETE /identity/v3/projects/c1ab633679f84e2998727dde53726784 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:26.001962 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4ed02-d50b-4828-a11b-c4e27c55042f service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:26.011900 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4ed02-d50b-4828-a11b-c4e27c55042f service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:26.069005 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5162430-2690-4123-a218-383cff4ef6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:26.069648 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5162430-2690-4123-a218-383cff4ef6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:26.069931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5162430-2690-4123-a218-383cff4ef6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:26.070202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5162430-2690-4123-a218-383cff4ef6e8 admin admin] PATH_INFO: `/v3/users/388cfd3c8138449c90a98be0708c6a76` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:26.071352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5162430-2690-4123-a218-383cff4ef6e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=388cfd3c8138449c90a98be0708c6a76)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:26.073356 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5162430-2690-4123-a218-383cff4ef6e8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:26.301193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a5162430-2690-4123-a218-383cff4ef6e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '388cfd3c8138449c90a98be0708c6a76'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:26.301735 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a5162430-2690-4123-a218-383cff4ef6e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '388cfd3c8138449c90a98be0708c6a76'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:26.314915 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a5162430-2690-4123-a218-383cff4ef6e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '388cfd3c8138449c90a98be0708c6a76'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:26.321508 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a5162430-2690-4123-a218-383cff4ef6e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '388cfd3c8138449c90a98be0708c6a76'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:26.322201 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a5162430-2690-4123-a218-383cff4ef6e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '388cfd3c8138449c90a98be0708c6a76'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:26.413118 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1399/2833] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:18:26 2022] DELETE /identity/v3/users/388cfd3c8138449c90a98be0708c6a76 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:26.919609 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e844f6-7843-40ff-95d6-e8430f8b4536 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:26.925479 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-08e844f6-7843-40ff-95d6-e8430f8b4536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:26.935688 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e844f6-7843-40ff-95d6-e8430f8b4536 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:26.998193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2336a71-034a-4211-8806-bd1353627528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:26.999028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2336a71-034a-4211-8806-bd1353627528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:26.999423 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2336a71-034a-4211-8806-bd1353627528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:26.999583 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2336a71-034a-4211-8806-bd1353627528 admin admin] PATH_INFO: `/v3/projects/873e44242c5a474488a8afccd50071a7` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:27.000726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2336a71-034a-4211-8806-bd1353627528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=873e44242c5a474488a8afccd50071a7)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:27.002792 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2336a71-034a-4211-8806-bd1353627528 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:27.012650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:27.115578 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b2336a71-034a-4211-8806-bd1353627528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873e44242c5a474488a8afccd50071a7', 'request_id': 'req-b2336a71-034a-4211-8806-bd1353627528'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:27.209456 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b2336a71-034a-4211-8806-bd1353627528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873e44242c5a474488a8afccd50071a7', 'request_id': 'req-b2336a71-034a-4211-8806-bd1353627528'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:27.215635 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b2336a71-034a-4211-8806-bd1353627528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873e44242c5a474488a8afccd50071a7', 'request_id': 'req-b2336a71-034a-4211-8806-bd1353627528'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:27.227268 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b2336a71-034a-4211-8806-bd1353627528 admin admin] The token cache is being invalidate because project 873e44242c5a474488a8afccd50071a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:18:27.227562 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b2336a71-034a-4211-8806-bd1353627528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:27.228238 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b2336a71-034a-4211-8806-bd1353627528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:27.229778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1435/2834] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:18:26 2022] DELETE /identity/v3/projects/873e44242c5a474488a8afccd50071a7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:27.234629 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6574d43-6192-46e5-b36f-40e913f2b2ad None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:27.235098 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6574d43-6192-46e5-b36f-40e913f2b2ad None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:27.235243 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6574d43-6192-46e5-b36f-40e913f2b2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:27.255932 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a6574d43-6192-46e5-b36f-40e913f2b2ad None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:27.260096 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a6574d43-6192-46e5-b36f-40e913f2b2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:27.278271 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:27.327661 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1400/2835] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:27.328786 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bc429-e82d-4fa3-bec3-17c56f945a76 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:27.329153 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bc429-e82d-4fa3-bec3-17c56f945a76 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:27.329942 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bc429-e82d-4fa3-bec3-17c56f945a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:27.354070 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d87bc429-e82d-4fa3-bec3-17c56f945a76 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:27.356388 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d87bc429-e82d-4fa3-bec3-17c56f945a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:27.363671 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1436/2836] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:27.367975 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6574d43-6192-46e5-b36f-40e913f2b2ad None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:27.378233 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6574d43-6192-46e5-b36f-40e913f2b2ad None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:27.382921 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2836cc-2613-419a-b8d5-760069da1d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:27.383530 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2836cc-2613-419a-b8d5-760069da1d01 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:27.383816 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2836cc-2613-419a-b8d5-760069da1d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:27.384096 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2836cc-2613-419a-b8d5-760069da1d01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:27.384848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2836cc-2613-419a-b8d5-760069da1d01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:18:27.385131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2836cc-2613-419a-b8d5-760069da1d01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:27.386728 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2836cc-2613-419a-b8d5-760069da1d01 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:27.398249 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1401/2837] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:18:27.402710 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bc429-e82d-4fa3-bec3-17c56f945a76 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:27.412591 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bc429-e82d-4fa3-bec3-17c56f945a76 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:27.417274 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462abe7-fb6d-4722-b609-3bdac03e94f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:27.417890 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462abe7-fb6d-4722-b609-3bdac03e94f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:27.418174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462abe7-fb6d-4722-b609-3bdac03e94f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:27.418451 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462abe7-fb6d-4722-b609-3bdac03e94f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:27.419113 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462abe7-fb6d-4722-b609-3bdac03e94f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:27.421057 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462abe7-fb6d-4722-b609-3bdac03e94f3 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:27.502537 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1437/2838] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:18:27 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:18:27.504293 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2836cc-2613-419a-b8d5-760069da1d01 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:27.515586 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2836cc-2613-419a-b8d5-760069da1d01 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:27.573020 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb2424-59d4-4e90-a481-ce0090c3fa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:27.573634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb2424-59d4-4e90-a481-ce0090c3fa4e admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:27.573917 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb2424-59d4-4e90-a481-ce0090c3fa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:27.574193 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb2424-59d4-4e90-a481-ce0090c3fa4e admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:27.574890 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb2424-59d4-4e90-a481-ce0090c3fa4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:27.576892 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb2424-59d4-4e90-a481-ce0090c3fa4e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:27.657753 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1402/2839] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:18:27 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:18:27.661920 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462abe7-fb6d-4722-b609-3bdac03e94f3 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:27.672272 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462abe7-fb6d-4722-b609-3bdac03e94f3 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:27.678169 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507da92c-4aff-4bd3-8c15-23abbddae4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:27.678781 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507da92c-4aff-4bd3-8c15-23abbddae4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:27.679991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507da92c-4aff-4bd3-8c15-23abbddae4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:27.679991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507da92c-4aff-4bd3-8c15-23abbddae4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:27.679991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507da92c-4aff-4bd3-8c15-23abbddae4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:27.681666 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507da92c-4aff-4bd3-8c15-23abbddae4d3 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:27.692812 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1438/2840] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:27.696817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb2424-59d4-4e90-a481-ce0090c3fa4e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:27.706962 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb2424-59d4-4e90-a481-ce0090c3fa4e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:27.711490 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78d4cf-dff8-4b1c-ae88-20256300b25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:27.712089 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78d4cf-dff8-4b1c-ae88-20256300b25d admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:27.712368 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78d4cf-dff8-4b1c-ae88-20256300b25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:27.712640 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78d4cf-dff8-4b1c-ae88-20256300b25d admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:27.713360 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78d4cf-dff8-4b1c-ae88-20256300b25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:27.714936 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78d4cf-dff8-4b1c-ae88-20256300b25d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:27.729811 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1403/2841] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:18:27.734525 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507da92c-4aff-4bd3-8c15-23abbddae4d3 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:27.741883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507da92c-4aff-4bd3-8c15-23abbddae4d3 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:27.746556 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393f03e-1daa-4f27-bd2f-b11bc77e9db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:27.747226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393f03e-1daa-4f27-bd2f-b11bc77e9db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:27.747515 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393f03e-1daa-4f27-bd2f-b11bc77e9db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:27.747786 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393f03e-1daa-4f27-bd2f-b11bc77e9db7 admin admin] PATH_INFO: `/v3/projects/c3605b8034844ad3a6ecd8d1220fb75c/users/379b78f3ca4f4233a0a0bdd200ee3bf0/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:27.764198 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393f03e-1daa-4f27-bd2f-b11bc77e9db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3605b8034844ad3a6ecd8d1220fb75c, user_id=379b78f3ca4f4233a0a0bdd200ee3bf0, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:27.766893 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393f03e-1daa-4f27-bd2f-b11bc77e9db7 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:27.886307 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1439/2842] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:18:27 2022] PUT /identity/v3/projects/c3605b8034844ad3a6ecd8d1220fb75c/users/379b78f3ca4f4233a0a0bdd200ee3bf0/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:27.903868 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50590af8-5784-4a63-b04a-7dccdf35ca24 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:27.904159 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50590af8-5784-4a63-b04a-7dccdf35ca24 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:27.904439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50590af8-5784-4a63-b04a-7dccdf35ca24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:27.934022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-50590af8-5784-4a63-b04a-7dccdf35ca24 None None] MFA Rules not processed for user `379b78f3ca4f4233a0a0bdd200ee3bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:27.935423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-50590af8-5784-4a63-b04a-7dccdf35ca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:28.001305 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1404/2843] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:28.012041 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393f03e-1daa-4f27-bd2f-b11bc77e9db7 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:28.019477 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d393f03e-1daa-4f27-bd2f-b11bc77e9db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:28.070728 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393f03e-1daa-4f27-bd2f-b11bc77e9db7 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:28.074315 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1856d4-9c79-4125-964a-ae8129bfce87 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1837a832a0da4d698984ce62057b81f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:28.076812 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1856d4-9c79-4125-964a-ae8129bfce87 service glance] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:28.076812 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1856d4-9c79-4125-964a-ae8129bfce87 service glance] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:28.076812 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1856d4-9c79-4125-964a-ae8129bfce87 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:28.083894 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1856d4-9c79-4125-964a-ae8129bfce87 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:28.085373 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1856d4-9c79-4125-964a-ae8129bfce87 service glance] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:28.094258 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1440/2844] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:18:30.293994 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50590af8-5784-4a63-b04a-7dccdf35ca24 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:30.295560 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-50590af8-5784-4a63-b04a-7dccdf35ca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:30.322345 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:30.363845 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50590af8-5784-4a63-b04a-7dccdf35ca24 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:30.368608 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aafa03-42c3-4e40-86c7-6ce3480f3aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:30.369293 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aafa03-42c3-4e40-86c7-6ce3480f3aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:30.369579 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aafa03-42c3-4e40-86c7-6ce3480f3aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:30.369858 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aafa03-42c3-4e40-86c7-6ce3480f3aae admin admin] PATH_INFO: `/v3/users/81b94f9554b74e9e9ab8e040dc73c526` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:30.371030 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aafa03-42c3-4e40-86c7-6ce3480f3aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=81b94f9554b74e9e9ab8e040dc73c526)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:30.373014 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aafa03-42c3-4e40-86c7-6ce3480f3aae admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:30.596436 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a7aafa03-42c3-4e40-86c7-6ce3480f3aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81b94f9554b74e9e9ab8e040dc73c526'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:30.597116 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a7aafa03-42c3-4e40-86c7-6ce3480f3aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81b94f9554b74e9e9ab8e040dc73c526'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:30.609352 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a7aafa03-42c3-4e40-86c7-6ce3480f3aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81b94f9554b74e9e9ab8e040dc73c526'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:30.617356 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a7aafa03-42c3-4e40-86c7-6ce3480f3aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81b94f9554b74e9e9ab8e040dc73c526'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:30.618025 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a7aafa03-42c3-4e40-86c7-6ce3480f3aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81b94f9554b74e9e9ab8e040dc73c526'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:30.667870 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1405/2845] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:18:30 2022] DELETE /identity/v3/users/81b94f9554b74e9e9ab8e040dc73c526 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:30.673185 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4a603-83f0-4ba4-9cab-b8cba545029c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:30.673778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4a603-83f0-4ba4-9cab-b8cba545029c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:30.673937 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4a603-83f0-4ba4-9cab-b8cba545029c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:30.695268 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-54e4a603-83f0-4ba4-9cab-b8cba545029c None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:30.696521 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-54e4a603-83f0-4ba4-9cab-b8cba545029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:30.726238 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:30.757787 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1441/2846] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:30.767957 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aafa03-42c3-4e40-86c7-6ce3480f3aae admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:30.769442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a7aafa03-42c3-4e40-86c7-6ce3480f3aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:30.829279 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aafa03-42c3-4e40-86c7-6ce3480f3aae admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:30.834032 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10f93a-3128-4cc8-b8cb-32c74d3555de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:30.834869 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10f93a-3128-4cc8-b8cb-32c74d3555de service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:30.835155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10f93a-3128-4cc8-b8cb-32c74d3555de service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:30.835432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10f93a-3128-4cc8-b8cb-32c74d3555de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:30.845984 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10f93a-3128-4cc8-b8cb-32c74d3555de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:30.847525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10f93a-3128-4cc8-b8cb-32c74d3555de service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:30.857074 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1406/2847] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:18:31.299087 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4a603-83f0-4ba4-9cab-b8cba545029c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:31.300625 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-54e4a603-83f0-4ba4-9cab-b8cba545029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:31.315637 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4a603-83f0-4ba4-9cab-b8cba545029c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:31.323397 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c6e0d-4f6e-4e6a-9ee4-c20344498450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:31.323984 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c6e0d-4f6e-4e6a-9ee4-c20344498450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:31.324311 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c6e0d-4f6e-4e6a-9ee4-c20344498450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:31.324562 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c6e0d-4f6e-4e6a-9ee4-c20344498450 admin admin] PATH_INFO: `/v3/projects/0b881a4801cc451a8b8fe98db8ec5467` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:31.325812 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c6e0d-4f6e-4e6a-9ee4-c20344498450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b881a4801cc451a8b8fe98db8ec5467)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:31.327808 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c6e0d-4f6e-4e6a-9ee4-c20344498450 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:31.463987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b37c6e0d-4f6e-4e6a-9ee4-c20344498450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b881a4801cc451a8b8fe98db8ec5467', 'request_id': 'req-b37c6e0d-4f6e-4e6a-9ee4-c20344498450'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:31.559861 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b37c6e0d-4f6e-4e6a-9ee4-c20344498450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b881a4801cc451a8b8fe98db8ec5467', 'request_id': 'req-b37c6e0d-4f6e-4e6a-9ee4-c20344498450'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:31.566648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b37c6e0d-4f6e-4e6a-9ee4-c20344498450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b881a4801cc451a8b8fe98db8ec5467', 'request_id': 'req-b37c6e0d-4f6e-4e6a-9ee4-c20344498450'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:31.580744 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b37c6e0d-4f6e-4e6a-9ee4-c20344498450 admin admin] The token cache is being invalidate because project 0b881a4801cc451a8b8fe98db8ec5467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:18:31.581073 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b37c6e0d-4f6e-4e6a-9ee4-c20344498450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:31.581789 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b37c6e0d-4f6e-4e6a-9ee4-c20344498450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:31.583411 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1442/2848] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:18:31 2022] DELETE /identity/v3/projects/0b881a4801cc451a8b8fe98db8ec5467 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:31.588387 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2e35a-e548-4f84-9193-de2f99b1484a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:31.588876 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2e35a-e548-4f84-9193-de2f99b1484a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:31.588975 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2e35a-e548-4f84-9193-de2f99b1484a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:31.609528 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d8a2e35a-e548-4f84-9193-de2f99b1484a None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:31.611619 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d8a2e35a-e548-4f84-9193-de2f99b1484a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:31.651843 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:31.671114 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1407/2849] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:31.679555 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f7f9-41b6-4316-ab02-978ff5f02212 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:31.680067 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f7f9-41b6-4316-ab02-978ff5f02212 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:31.680280 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f7f9-41b6-4316-ab02-978ff5f02212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:31.700388 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-7e62f7f9-41b6-4316-ab02-978ff5f02212 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:31.701758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7e62f7f9-41b6-4316-ab02-978ff5f02212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:31.709982 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1443/2850] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:31.714555 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2e35a-e548-4f84-9193-de2f99b1484a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:31.724942 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2e35a-e548-4f84-9193-de2f99b1484a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:31.729543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd0a7e-8ee2-42ca-95a7-54699dfaba0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:31.730187 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd0a7e-8ee2-42ca-95a7-54699dfaba0e admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:31.730696 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd0a7e-8ee2-42ca-95a7-54699dfaba0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:31.731151 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd0a7e-8ee2-42ca-95a7-54699dfaba0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:31.732298 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd0a7e-8ee2-42ca-95a7-54699dfaba0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:18:31.732884 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd0a7e-8ee2-42ca-95a7-54699dfaba0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:31.734851 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd0a7e-8ee2-42ca-95a7-54699dfaba0e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:31.747399 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1408/2851] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:18:31.751927 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62f7f9-41b6-4316-ab02-978ff5f02212 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:31.761845 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62f7f9-41b6-4316-ab02-978ff5f02212 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:31.768448 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192c1a1-e4ed-4ae6-80a4-d4f0b37abade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:31.769287 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192c1a1-e4ed-4ae6-80a4-d4f0b37abade admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:31.769571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192c1a1-e4ed-4ae6-80a4-d4f0b37abade admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:31.771462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192c1a1-e4ed-4ae6-80a4-d4f0b37abade admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:31.771462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192c1a1-e4ed-4ae6-80a4-d4f0b37abade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:31.772518 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192c1a1-e4ed-4ae6-80a4-d4f0b37abade admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:31.866482 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1444/2852] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:18:31 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:18:31.870705 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd0a7e-8ee2-42ca-95a7-54699dfaba0e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:31.880955 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd0a7e-8ee2-42ca-95a7-54699dfaba0e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:31.937733 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e84fcf-d39b-4009-a422-08fa9618522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:31.938370 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e84fcf-d39b-4009-a422-08fa9618522b admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:31.938653 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e84fcf-d39b-4009-a422-08fa9618522b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:31.938931 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e84fcf-d39b-4009-a422-08fa9618522b admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:31.939603 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e84fcf-d39b-4009-a422-08fa9618522b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:31.941561 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e84fcf-d39b-4009-a422-08fa9618522b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:32.040955 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1409/2853] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:18:31 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:18:32.045067 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192c1a1-e4ed-4ae6-80a4-d4f0b37abade admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:32.055825 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192c1a1-e4ed-4ae6-80a4-d4f0b37abade admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:32.060535 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d08e8e-823f-4a19-8f00-b92ad5af2536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:32.061234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d08e8e-823f-4a19-8f00-b92ad5af2536 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:32.061518 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d08e8e-823f-4a19-8f00-b92ad5af2536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:32.061793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d08e8e-823f-4a19-8f00-b92ad5af2536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:32.062494 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d08e8e-823f-4a19-8f00-b92ad5af2536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:32.064116 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d08e8e-823f-4a19-8f00-b92ad5af2536 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:32.074895 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1445/2854] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:32.079757 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e84fcf-d39b-4009-a422-08fa9618522b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:32.090599 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e84fcf-d39b-4009-a422-08fa9618522b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:32.096097 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74837a50-b2a5-41a2-8142-7f053ebfa15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:32.096768 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74837a50-b2a5-41a2-8142-7f053ebfa15f admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:32.097084 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74837a50-b2a5-41a2-8142-7f053ebfa15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:32.097341 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74837a50-b2a5-41a2-8142-7f053ebfa15f admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:32.098047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74837a50-b2a5-41a2-8142-7f053ebfa15f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:32.099849 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74837a50-b2a5-41a2-8142-7f053ebfa15f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:32.111411 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1410/2855] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:32.116370 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d08e8e-823f-4a19-8f00-b92ad5af2536 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:32.126403 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d08e8e-823f-4a19-8f00-b92ad5af2536 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:32.130943 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9f1c7-6f4d-477f-a7d5-396530905955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:32.131600 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f1c7-6f4d-477f-a7d5-396530905955 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:32.131880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f1c7-6f4d-477f-a7d5-396530905955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:32.132155 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f1c7-6f4d-477f-a7d5-396530905955 admin admin] PATH_INFO: `/v3/projects/4301115e98a34cfc8b684acbc6f0d2c7/users/7f2568b3c7e144d58b2ed05211fe155d/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:32.147360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9f1c7-6f4d-477f-a7d5-396530905955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4301115e98a34cfc8b684acbc6f0d2c7, user_id=7f2568b3c7e144d58b2ed05211fe155d, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:32.150119 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9f1c7-6f4d-477f-a7d5-396530905955 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:32.257944 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1446/2856] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:18:32 2022] PUT /identity/v3/projects/4301115e98a34cfc8b684acbc6f0d2c7/users/7f2568b3c7e144d58b2ed05211fe155d/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:32.263135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d05e05-3c8f-4f86-9498-f8bc03db9879 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:32.263429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d05e05-3c8f-4f86-9498-f8bc03db9879 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:32.263739 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d05e05-3c8f-4f86-9498-f8bc03db9879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:32.284140 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-56d05e05-3c8f-4f86-9498-f8bc03db9879 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:32.285381 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-56d05e05-3c8f-4f86-9498-f8bc03db9879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:32.349901 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1411/2857] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:32.359735 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9f1c7-6f4d-477f-a7d5-396530905955 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:32.361855 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6cf9f1c7-6f4d-477f-a7d5-396530905955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:32.425170 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9f1c7-6f4d-477f-a7d5-396530905955 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:32.428824 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efba03f-14d1-4bf0-8670-11edcbde9cd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:32.429446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efba03f-14d1-4bf0-8670-11edcbde9cd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:32.429729 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efba03f-14d1-4bf0-8670-11edcbde9cd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:32.430006 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efba03f-14d1-4bf0-8670-11edcbde9cd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:32.437020 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:32.440234 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efba03f-14d1-4bf0-8670-11edcbde9cd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:32.441828 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efba03f-14d1-4bf0-8670-11edcbde9cd8 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:32.451556 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1447/2858] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:18:33.891863 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17057754-3b99-4113-a632-4220620457a4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:33.892383 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17057754-3b99-4113-a632-4220620457a4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:33.892508 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17057754-3b99-4113-a632-4220620457a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:33.921435 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-17057754-3b99-4113-a632-4220620457a4 None None] MFA Rules not processed for user `7f2568b3c7e144d58b2ed05211fe155d`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:33.923309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-17057754-3b99-4113-a632-4220620457a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:33.964146 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:33.989525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1412/2859] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:34.000485 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efba03f-14d1-4bf0-8670-11edcbde9cd8 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:34.002003 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3efba03f-14d1-4bf0-8670-11edcbde9cd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:34.063979 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efba03f-14d1-4bf0-8670-11edcbde9cd8 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:34.067501 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca9a50-71f9-4303-901f-2d125cb3ae00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be78ea573a674611807171c76f8003ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:34.068114 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca9a50-71f9-4303-901f-2d125cb3ae00 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:34.068394 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca9a50-71f9-4303-901f-2d125cb3ae00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:34.068670 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca9a50-71f9-4303-901f-2d125cb3ae00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:34.077396 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca9a50-71f9-4303-901f-2d125cb3ae00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:34.078878 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca9a50-71f9-4303-901f-2d125cb3ae00 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:34.087771 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1448/2860] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:18:36.941710 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3780a-46dd-469b-a9aa-abe985ccd992 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:36.942278 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3780a-46dd-469b-a9aa-abe985ccd992 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:36.942278 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3780a-46dd-469b-a9aa-abe985ccd992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:36.963435 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-28c3780a-46dd-469b-a9aa-abe985ccd992 None None] MFA Rules not processed for user `7f2568b3c7e144d58b2ed05211fe155d`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:36.964664 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-28c3780a-46dd-469b-a9aa-abe985ccd992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:36.972392 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1413/2861] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:37.208928 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca9a50-71f9-4303-901f-2d125cb3ae00 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:37.220265 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca9a50-71f9-4303-901f-2d125cb3ae00 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:37.226230 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4229c1-e3dc-4118-aed3-1127d20c165a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:37.227188 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4229c1-e3dc-4118-aed3-1127d20c165a service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:37.227582 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4229c1-e3dc-4118-aed3-1127d20c165a service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:37.227858 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4229c1-e3dc-4118-aed3-1127d20c165a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:37.229854 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6a4229c1-e3dc-4118-aed3-1127d20c165a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:37.242009 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4229c1-e3dc-4118-aed3-1127d20c165a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:37.243853 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4229c1-e3dc-4118-aed3-1127d20c165a service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:37.253464 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1449/2862] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:18:46.956646 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=12 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:47.249492 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=34 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:56.079075 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3780a-46dd-469b-a9aa-abe985ccd992 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:56.081271 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-28c3780a-46dd-469b-a9aa-abe985ccd992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:56.095544 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3780a-46dd-469b-a9aa-abe985ccd992 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:56.100295 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53555a4-2398-4e94-b772-d3a477b44407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:56.100971 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53555a4-2398-4e94-b772-d3a477b44407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:56.101257 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53555a4-2398-4e94-b772-d3a477b44407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:56.101536 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53555a4-2398-4e94-b772-d3a477b44407 admin admin] PATH_INFO: `/v3/users/379b78f3ca4f4233a0a0bdd200ee3bf0` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:56.102707 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53555a4-2398-4e94-b772-d3a477b44407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=379b78f3ca4f4233a0a0bdd200ee3bf0)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:56.104631 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53555a4-2398-4e94-b772-d3a477b44407 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:56.290879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e53555a4-2398-4e94-b772-d3a477b44407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '379b78f3ca4f4233a0a0bdd200ee3bf0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:56.291477 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e53555a4-2398-4e94-b772-d3a477b44407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '379b78f3ca4f4233a0a0bdd200ee3bf0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:56.303520 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e53555a4-2398-4e94-b772-d3a477b44407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '379b78f3ca4f4233a0a0bdd200ee3bf0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:56.310411 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e53555a4-2398-4e94-b772-d3a477b44407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '379b78f3ca4f4233a0a0bdd200ee3bf0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:56.311153 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e53555a4-2398-4e94-b772-d3a477b44407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '379b78f3ca4f4233a0a0bdd200ee3bf0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:56.411039 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1414/2863] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:18:56 2022] DELETE /identity/v3/users/379b78f3ca4f4233a0a0bdd200ee3bf0 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:56.418197 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ab291-d086-40d8-bd23-7f1a533f30ee None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:56.418701 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ab291-d086-40d8-bd23-7f1a533f30ee None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:56.418803 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ab291-d086-40d8-bd23-7f1a533f30ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:56.444544 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-140ab291-d086-40d8-bd23-7f1a533f30ee None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:56.446311 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-140ab291-d086-40d8-bd23-7f1a533f30ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:56.514124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1450/2864] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:56.524348 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53555a4-2398-4e94-b772-d3a477b44407 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:56.525792 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e53555a4-2398-4e94-b772-d3a477b44407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:56.583423 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53555a4-2398-4e94-b772-d3a477b44407 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:56.586956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e679f1-bbdf-4ba9-9f31-c07cdbc5549e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:56.587570 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e679f1-bbdf-4ba9-9f31-c07cdbc5549e service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:56.587851 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e679f1-bbdf-4ba9-9f31-c07cdbc5549e service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:56.588126 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e679f1-bbdf-4ba9-9f31-c07cdbc5549e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:56.597737 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e679f1-bbdf-4ba9-9f31-c07cdbc5549e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:56.599173 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e679f1-bbdf-4ba9-9f31-c07cdbc5549e service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:56.609139 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1415/2865] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:18:57.078495 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ab291-d086-40d8-bd23-7f1a533f30ee None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:57.082921 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-140ab291-d086-40d8-bd23-7f1a533f30ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:57.095131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ab291-d086-40d8-bd23-7f1a533f30ee None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:57.099875 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66b578-72ba-4f10-b5ba-9b4fa32cfe26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:57.105909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66b578-72ba-4f10-b5ba-9b4fa32cfe26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:57.105909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66b578-72ba-4f10-b5ba-9b4fa32cfe26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:57.105909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66b578-72ba-4f10-b5ba-9b4fa32cfe26 admin admin] PATH_INFO: `/v3/projects/c3605b8034844ad3a6ecd8d1220fb75c` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:57.105909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66b578-72ba-4f10-b5ba-9b4fa32cfe26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3605b8034844ad3a6ecd8d1220fb75c)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:57.105909 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66b578-72ba-4f10-b5ba-9b4fa32cfe26 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:57.228109 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-8d66b578-72ba-4f10-b5ba-9b4fa32cfe26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3605b8034844ad3a6ecd8d1220fb75c', 'request_id': 'req-8d66b578-72ba-4f10-b5ba-9b4fa32cfe26'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:57.308446 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-8d66b578-72ba-4f10-b5ba-9b4fa32cfe26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3605b8034844ad3a6ecd8d1220fb75c', 'request_id': 'req-8d66b578-72ba-4f10-b5ba-9b4fa32cfe26'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:57.315569 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-8d66b578-72ba-4f10-b5ba-9b4fa32cfe26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3605b8034844ad3a6ecd8d1220fb75c', 'request_id': 'req-8d66b578-72ba-4f10-b5ba-9b4fa32cfe26'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:57.328300 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-8d66b578-72ba-4f10-b5ba-9b4fa32cfe26 admin admin] The token cache is being invalidate because project c3605b8034844ad3a6ecd8d1220fb75c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:18:57.328691 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-8d66b578-72ba-4f10-b5ba-9b4fa32cfe26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:57.330333 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-8d66b578-72ba-4f10-b5ba-9b4fa32cfe26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:18:57.331975 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1451/2866] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:18:57 2022] DELETE /identity/v3/projects/c3605b8034844ad3a6ecd8d1220fb75c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:57.337147 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ab24f-0e07-4e05-ac89-102b6bd988cc None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:57.337645 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ab24f-0e07-4e05-ac89-102b6bd988cc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:57.337740 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ab24f-0e07-4e05-ac89-102b6bd988cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:57.361843 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-eb9ab24f-0e07-4e05-ac89-102b6bd988cc None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:57.363055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-eb9ab24f-0e07-4e05-ac89-102b6bd988cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:57.426556 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1416/2867] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:57.438622 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccc72a-ea02-4c3a-b448-265b4e95f367 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:57.438622 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccc72a-ea02-4c3a-b448-265b4e95f367 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:57.438622 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccc72a-ea02-4c3a-b448-265b4e95f367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:57.455204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-73ccc72a-ea02-4c3a-b448-265b4e95f367 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:57.456334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-73ccc72a-ea02-4c3a-b448-265b4e95f367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:57.464504 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1452/2868] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:57.468729 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ab24f-0e07-4e05-ac89-102b6bd988cc None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:57.478552 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ab24f-0e07-4e05-ac89-102b6bd988cc None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:57.483211 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15c235-282a-41a4-8dcd-ce1e39fe3859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:57.483848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15c235-282a-41a4-8dcd-ce1e39fe3859 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:57.484106 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15c235-282a-41a4-8dcd-ce1e39fe3859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:57.484375 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15c235-282a-41a4-8dcd-ce1e39fe3859 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:57.485376 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15c235-282a-41a4-8dcd-ce1e39fe3859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:18:57.486202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15c235-282a-41a4-8dcd-ce1e39fe3859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:57.487798 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15c235-282a-41a4-8dcd-ce1e39fe3859 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:57.500918 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1417/2869] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:18:57.505695 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccc72a-ea02-4c3a-b448-265b4e95f367 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:57.515327 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccc72a-ea02-4c3a-b448-265b4e95f367 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:57.520730 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a3010-16a9-48c0-94d5-71f75e870f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:57.521448 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a3010-16a9-48c0-94d5-71f75e870f8a admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:57.521733 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a3010-16a9-48c0-94d5-71f75e870f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:57.522011 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a3010-16a9-48c0-94d5-71f75e870f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:57.522675 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a3010-16a9-48c0-94d5-71f75e870f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:57.524637 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a3010-16a9-48c0-94d5-71f75e870f8a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:57.621883 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1453/2870] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:18:57 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:18:57.626133 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15c235-282a-41a4-8dcd-ce1e39fe3859 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:57.632074 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:57.638543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15c235-282a-41a4-8dcd-ce1e39fe3859 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:57.699691 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e79674-e45a-4834-9dfe-5d2ccd7c5041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:57.700697 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e79674-e45a-4834-9dfe-5d2ccd7c5041 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:57.700697 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e79674-e45a-4834-9dfe-5d2ccd7c5041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:57.700964 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e79674-e45a-4834-9dfe-5d2ccd7c5041 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:57.701651 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e79674-e45a-4834-9dfe-5d2ccd7c5041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:57.703575 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e79674-e45a-4834-9dfe-5d2ccd7c5041 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:57.800230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1418/2871] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:18:57 2022] POST /identity/v3/users => generated 283 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:18:57.804552 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a3010-16a9-48c0-94d5-71f75e870f8a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:57.817471 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a3010-16a9-48c0-94d5-71f75e870f8a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:57.826643 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642f60d-3043-4d7f-8bd3-aabf4ef8a903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:57.827393 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642f60d-3043-4d7f-8bd3-aabf4ef8a903 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:57.827656 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642f60d-3043-4d7f-8bd3-aabf4ef8a903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:57.827962 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642f60d-3043-4d7f-8bd3-aabf4ef8a903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:57.828709 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642f60d-3043-4d7f-8bd3-aabf4ef8a903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:57.830961 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642f60d-3043-4d7f-8bd3-aabf4ef8a903 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:57.844734 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1454/2872] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:57.848372 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e79674-e45a-4834-9dfe-5d2ccd7c5041 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:57.858788 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e79674-e45a-4834-9dfe-5d2ccd7c5041 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:57.864640 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda30de-34ae-4b3d-8d71-60dd9c4fe664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:57.865298 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda30de-34ae-4b3d-8d71-60dd9c4fe664 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:57.865581 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda30de-34ae-4b3d-8d71-60dd9c4fe664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:57.865858 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda30de-34ae-4b3d-8d71-60dd9c4fe664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:57.866553 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda30de-34ae-4b3d-8d71-60dd9c4fe664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:57.868245 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda30de-34ae-4b3d-8d71-60dd9c4fe664 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:57.883057 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1419/2873] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:18:57.884248 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642f60d-3043-4d7f-8bd3-aabf4ef8a903 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:57.894987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642f60d-3043-4d7f-8bd3-aabf4ef8a903 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:57.899617 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a4684-9865-4407-8c74-7184a941e7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:57.900283 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a4684-9865-4407-8c74-7184a941e7d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:57.900566 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a4684-9865-4407-8c74-7184a941e7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:57.900875 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a4684-9865-4407-8c74-7184a941e7d6 admin admin] PATH_INFO: `/v3/projects/441203d9ae214c72834e2e341d8e72dd/users/f66450d7a22d47ac84ef5209df99afe0/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:57.915709 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a4684-9865-4407-8c74-7184a941e7d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=441203d9ae214c72834e2e341d8e72dd, user_id=f66450d7a22d47ac84ef5209df99afe0, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:57.918425 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a4684-9865-4407-8c74-7184a941e7d6 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:58.011285 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1455/2874] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:18:57 2022] PUT /identity/v3/projects/441203d9ae214c72834e2e341d8e72dd/users/f66450d7a22d47ac84ef5209df99afe0/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:18:58.022342 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6a6c0-0f31-44c3-ae49-f77fd16074e8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:58.022625 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6a6c0-0f31-44c3-ae49-f77fd16074e8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:58.022896 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6a6c0-0f31-44c3-ae49-f77fd16074e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:58.051368 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-79e6a6c0-0f31-44c3-ae49-f77fd16074e8 None None] MFA Rules not processed for user `f66450d7a22d47ac84ef5209df99afe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:58.052577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-79e6a6c0-0f31-44c3-ae49-f77fd16074e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:58.120277 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1420/2875] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:18:58.132285 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a4684-9865-4407-8c74-7184a941e7d6 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:18:58.134040 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-719a4684-9865-4407-8c74-7184a941e7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:58.158039 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:58.193922 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a4684-9865-4407-8c74-7184a941e7d6 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:18:58.197588 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53598e50-d47c-491a-825d-038e9ca7b4dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1837a832a0da4d698984ce62057b81f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:18:58.198204 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53598e50-d47c-491a-825d-038e9ca7b4dd service glance] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:58.198490 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53598e50-d47c-491a-825d-038e9ca7b4dd service glance] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:58.198778 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53598e50-d47c-491a-825d-038e9ca7b4dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:58.207198 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53598e50-d47c-491a-825d-038e9ca7b4dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:18:58.208650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53598e50-d47c-491a-825d-038e9ca7b4dd service glance] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:18:58.217476 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1456/2876] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:18:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:18:59.457885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93d28b-3909-46bb-b981-a803b5ac0cf9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:18:59.458370 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93d28b-3909-46bb-b981-a803b5ac0cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:18:59.458485 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93d28b-3909-46bb-b981-a803b5ac0cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:18:59.476780 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6d93d28b-3909-46bb-b981-a803b5ac0cf9 None None] MFA Rules not processed for user `7f2568b3c7e144d58b2ed05211fe155d`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:18:59.478086 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6d93d28b-3909-46bb-b981-a803b5ac0cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:18:59.535311 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1421/2877] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:18:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:19:02.825821 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53598e50-d47c-491a-825d-038e9ca7b4dd service glance] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:02.827237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-53598e50-d47c-491a-825d-038e9ca7b4dd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:02.906531 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53598e50-d47c-491a-825d-038e9ca7b4dd service glance] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:02.912187 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159ffcd-567d-4a34-9d03-507364a8a90e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff43a72eaef462f86426ad3ceccd3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:02.912874 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159ffcd-567d-4a34-9d03-507364a8a90e service placement] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:02.913161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159ffcd-567d-4a34-9d03-507364a8a90e service placement] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:02.913438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159ffcd-567d-4a34-9d03-507364a8a90e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:02.915263 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8159ffcd-567d-4a34-9d03-507364a8a90e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:02.927882 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159ffcd-567d-4a34-9d03-507364a8a90e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:02.929561 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159ffcd-567d-4a34-9d03-507364a8a90e service placement] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:02.939846 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1457/2878] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:19:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:19:09.527981 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:12.935414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=49 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:26.365911 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92ede1-6674-4029-913f-ba7e414f427a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:26.368981 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92ede1-6674-4029-913f-ba7e414f427a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:26.368981 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92ede1-6674-4029-913f-ba7e414f427a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:26.386144 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-bd92ede1-6674-4029-913f-ba7e414f427a None None] MFA Rules not processed for user `1cbbfdda843a4ab98ff9cf0742513f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:19:26.387492 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bd92ede1-6674-4029-913f-ba7e414f427a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:26.445316 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1422/2879] 10.222.0.75 () {58 vars in 1009 bytes} [Thu Jul 28 18:19:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:19:26.491224 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159ffcd-567d-4a34-9d03-507364a8a90e service placement] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:26.492952 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8159ffcd-567d-4a34-9d03-507364a8a90e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:26.562315 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159ffcd-567d-4a34-9d03-507364a8a90e service placement] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:26.567404 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fe8d1-b788-4a1a-b69d-2fa8792d234e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77b4fcb974d48a0bda4852c8d304511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:26.568030 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fe8d1-b788-4a1a-b69d-2fa8792d234e service swift] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:26.568340 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fe8d1-b788-4a1a-b69d-2fa8792d234e service swift] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:26.568616 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fe8d1-b788-4a1a-b69d-2fa8792d234e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:26.576836 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fe8d1-b788-4a1a-b69d-2fa8792d234e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:26.578431 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fe8d1-b788-4a1a-b69d-2fa8792d234e service swift] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:26.586914 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1458/2880] 10.222.0.75 () {60 vars in 1384 bytes} [Thu Jul 28 18:19:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:19:36.438350 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=25 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:36.583794 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=32 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:38.236085 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92ede1-6674-4029-913f-ba7e414f427a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:38.304615 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92ede1-6674-4029-913f-ba7e414f427a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:38.309899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c2fa8-d414-49cb-846c-8f172c03a09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:38.310577 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c2fa8-d414-49cb-846c-8f172c03a09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:38.310861 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c2fa8-d414-49cb-846c-8f172c03a09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:38.311174 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c2fa8-d414-49cb-846c-8f172c03a09f admin admin] PATH_INFO: `/v3/users/f66450d7a22d47ac84ef5209df99afe0` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:38.312477 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c2fa8-d414-49cb-846c-8f172c03a09f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f66450d7a22d47ac84ef5209df99afe0)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:38.314471 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c2fa8-d414-49cb-846c-8f172c03a09f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:38.752964 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-484c2fa8-d414-49cb-846c-8f172c03a09f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f66450d7a22d47ac84ef5209df99afe0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:38.753752 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-484c2fa8-d414-49cb-846c-8f172c03a09f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f66450d7a22d47ac84ef5209df99afe0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:38.777823 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-484c2fa8-d414-49cb-846c-8f172c03a09f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f66450d7a22d47ac84ef5209df99afe0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:38.787350 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-484c2fa8-d414-49cb-846c-8f172c03a09f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f66450d7a22d47ac84ef5209df99afe0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:38.788369 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-484c2fa8-d414-49cb-846c-8f172c03a09f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f66450d7a22d47ac84ef5209df99afe0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:38.882720 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1423/2881] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:19:38 2022] DELETE /identity/v3/users/f66450d7a22d47ac84ef5209df99afe0 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:19:38.887118 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9751e61-0125-42b5-97e8-31b5c03cc88d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:38.887718 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9751e61-0125-42b5-97e8-31b5c03cc88d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:38.887718 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9751e61-0125-42b5-97e8-31b5c03cc88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:38.909392 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d9751e61-0125-42b5-97e8-31b5c03cc88d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:19:38.911160 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d9751e61-0125-42b5-97e8-31b5c03cc88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:38.997990 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1459/2882] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:19:39.009698 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c2fa8-d414-49cb-846c-8f172c03a09f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:39.012252 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-484c2fa8-d414-49cb-846c-8f172c03a09f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:39.085721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c2fa8-d414-49cb-846c-8f172c03a09f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:39.091885 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5896785-2a67-4e77-b9f5-d7a24fdaed39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:39.092527 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5896785-2a67-4e77-b9f5-d7a24fdaed39 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:39.092848 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5896785-2a67-4e77-b9f5-d7a24fdaed39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:39.093131 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5896785-2a67-4e77-b9f5-d7a24fdaed39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:39.104302 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5896785-2a67-4e77-b9f5-d7a24fdaed39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:39.105794 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5896785-2a67-4e77-b9f5-d7a24fdaed39 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:39.117609 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1424/2883] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:19:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:19:39.684813 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9751e61-0125-42b5-97e8-31b5c03cc88d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:39.686694 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d9751e61-0125-42b5-97e8-31b5c03cc88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:39.708595 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9751e61-0125-42b5-97e8-31b5c03cc88d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:39.725758 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315cc5e-1352-4f21-8597-b557e70cb0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:39.726627 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315cc5e-1352-4f21-8597-b557e70cb0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:39.726823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315cc5e-1352-4f21-8597-b557e70cb0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:39.727081 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315cc5e-1352-4f21-8597-b557e70cb0ae admin admin] PATH_INFO: `/v3/projects/441203d9ae214c72834e2e341d8e72dd` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:39.728285 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315cc5e-1352-4f21-8597-b557e70cb0ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=441203d9ae214c72834e2e341d8e72dd)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:39.730793 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315cc5e-1352-4f21-8597-b557e70cb0ae admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:39.864104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a315cc5e-1352-4f21-8597-b557e70cb0ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '441203d9ae214c72834e2e341d8e72dd', 'request_id': 'req-a315cc5e-1352-4f21-8597-b557e70cb0ae'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:39.933823 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a315cc5e-1352-4f21-8597-b557e70cb0ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '441203d9ae214c72834e2e341d8e72dd', 'request_id': 'req-a315cc5e-1352-4f21-8597-b557e70cb0ae'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:39.940813 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a315cc5e-1352-4f21-8597-b557e70cb0ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '441203d9ae214c72834e2e341d8e72dd', 'request_id': 'req-a315cc5e-1352-4f21-8597-b557e70cb0ae'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:39.953646 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a315cc5e-1352-4f21-8597-b557e70cb0ae admin admin] The token cache is being invalidate because project 441203d9ae214c72834e2e341d8e72dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:19:39.954033 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a315cc5e-1352-4f21-8597-b557e70cb0ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:39.954654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a315cc5e-1352-4f21-8597-b557e70cb0ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:39.956225 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1460/2884] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:19:39 2022] DELETE /identity/v3/projects/441203d9ae214c72834e2e341d8e72dd => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:19:46.699428 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99973aca-ee3b-4b9a-b30a-64379a29cf15 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:46.699925 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99973aca-ee3b-4b9a-b30a-64379a29cf15 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:46.700022 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99973aca-ee3b-4b9a-b30a-64379a29cf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:46.719407 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-99973aca-ee3b-4b9a-b30a-64379a29cf15 None None] MFA Rules not processed for user `1cbbfdda843a4ab98ff9cf0742513f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:19:46.720605 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-99973aca-ee3b-4b9a-b30a-64379a29cf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:46.738137 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:46.775886 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1425/2885] 10.222.0.75 () {58 vars in 967 bytes} [Thu Jul 28 18:19:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:19:46.788405 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315cc5e-1352-4f21-8597-b557e70cb0ae admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:46.789828 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a315cc5e-1352-4f21-8597-b557e70cb0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:46.859827 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315cc5e-1352-4f21-8597-b557e70cb0ae admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:46.864740 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b652ab-5d2f-486c-ad51-5a72e9d1a85e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77b4fcb974d48a0bda4852c8d304511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:46.865377 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b652ab-5d2f-486c-ad51-5a72e9d1a85e service swift] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:46.865658 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b652ab-5d2f-486c-ad51-5a72e9d1a85e service swift] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:46.865932 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b652ab-5d2f-486c-ad51-5a72e9d1a85e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:46.873931 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b652ab-5d2f-486c-ad51-5a72e9d1a85e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:46.875523 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b652ab-5d2f-486c-ad51-5a72e9d1a85e service swift] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:46.883954 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1461/2886] 10.222.0.75 () {60 vars in 1384 bytes} [Thu Jul 28 18:19:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:19:49.847049 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99973aca-ee3b-4b9a-b30a-64379a29cf15 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:49.848514 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-99973aca-ee3b-4b9a-b30a-64379a29cf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:49.920707 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99973aca-ee3b-4b9a-b30a-64379a29cf15 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:49.925816 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e93037-3d2f-45e4-badc-b999fe0c142d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff43a72eaef462f86426ad3ceccd3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:49.926447 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e93037-3d2f-45e4-badc-b999fe0c142d service placement] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:49.926729 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e93037-3d2f-45e4-badc-b999fe0c142d service placement] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:49.927003 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e93037-3d2f-45e4-badc-b999fe0c142d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:49.928805 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-92e93037-3d2f-45e4-badc-b999fe0c142d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:49.940313 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e93037-3d2f-45e4-badc-b999fe0c142d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:49.942418 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e93037-3d2f-45e4-badc-b999fe0c142d service placement] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:49.952549 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1426/2887] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:19:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:19:49.962264 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b652ab-5d2f-486c-ad51-5a72e9d1a85e service swift] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:49.963783 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a1b652ab-5d2f-486c-ad51-5a72e9d1a85e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:49.980028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:50.033765 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b652ab-5d2f-486c-ad51-5a72e9d1a85e service swift] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:50.038379 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50459655-7a76-411e-b93d-06c528239921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:50.039018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50459655-7a76-411e-b93d-06c528239921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:50.039303 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50459655-7a76-411e-b93d-06c528239921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:50.039580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50459655-7a76-411e-b93d-06c528239921 admin admin] PATH_INFO: `/v3/users/7f2568b3c7e144d58b2ed05211fe155d` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:50.040915 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50459655-7a76-411e-b93d-06c528239921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f2568b3c7e144d58b2ed05211fe155d)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:50.043522 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50459655-7a76-411e-b93d-06c528239921 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:50.231565 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-50459655-7a76-411e-b93d-06c528239921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f2568b3c7e144d58b2ed05211fe155d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:50.298228 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-50459655-7a76-411e-b93d-06c528239921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f2568b3c7e144d58b2ed05211fe155d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:50.311852 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-50459655-7a76-411e-b93d-06c528239921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f2568b3c7e144d58b2ed05211fe155d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:50.319549 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-50459655-7a76-411e-b93d-06c528239921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f2568b3c7e144d58b2ed05211fe155d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:50.320308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-50459655-7a76-411e-b93d-06c528239921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f2568b3c7e144d58b2ed05211fe155d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:50.326415 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1462/2888] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:19:49 2022] DELETE /identity/v3/users/7f2568b3c7e144d58b2ed05211fe155d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:19:50.574786 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e93037-3d2f-45e4-badc-b999fe0c142d service placement] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:50.590498 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e93037-3d2f-45e4-badc-b999fe0c142d service placement] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:50.645482 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff7cd8-d9ad-4b1e-9f88-88223a5b364c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:50.646125 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff7cd8-d9ad-4b1e-9f88-88223a5b364c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:50.646408 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff7cd8-d9ad-4b1e-9f88-88223a5b364c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:50.646684 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff7cd8-d9ad-4b1e-9f88-88223a5b364c admin admin] PATH_INFO: `/v3/projects/4301115e98a34cfc8b684acbc6f0d2c7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:50.647850 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff7cd8-d9ad-4b1e-9f88-88223a5b364c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4301115e98a34cfc8b684acbc6f0d2c7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:50.649795 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff7cd8-d9ad-4b1e-9f88-88223a5b364c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:50.778363 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2bff7cd8-d9ad-4b1e-9f88-88223a5b364c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4301115e98a34cfc8b684acbc6f0d2c7', 'request_id': 'req-2bff7cd8-d9ad-4b1e-9f88-88223a5b364c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:50.783895 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2bff7cd8-d9ad-4b1e-9f88-88223a5b364c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4301115e98a34cfc8b684acbc6f0d2c7', 'request_id': 'req-2bff7cd8-d9ad-4b1e-9f88-88223a5b364c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:50.785499 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:50.791239 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2bff7cd8-d9ad-4b1e-9f88-88223a5b364c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4301115e98a34cfc8b684acbc6f0d2c7', 'request_id': 'req-2bff7cd8-d9ad-4b1e-9f88-88223a5b364c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:50.861457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2bff7cd8-d9ad-4b1e-9f88-88223a5b364c admin admin] The token cache is being invalidate because project 4301115e98a34cfc8b684acbc6f0d2c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:19:50.862097 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2bff7cd8-d9ad-4b1e-9f88-88223a5b364c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:50.862396 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2bff7cd8-d9ad-4b1e-9f88-88223a5b364c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:50.864632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1427/2889] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:19:50 2022] DELETE /identity/v3/projects/4301115e98a34cfc8b684acbc6f0d2c7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:19:50.872143 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e592063-7a10-4f46-b543-170a804058bf None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:50.872438 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e592063-7a10-4f46-b543-170a804058bf None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:50.872715 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e592063-7a10-4f46-b543-170a804058bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:50.891889 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-9e592063-7a10-4f46-b543-170a804058bf None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:19:50.896235 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9e592063-7a10-4f46-b543-170a804058bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:50.951775 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1463/2890] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:19:50.960095 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dd0a6-d688-41c2-ba13-3366f1e2e237 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:50.960388 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dd0a6-d688-41c2-ba13-3366f1e2e237 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:50.960670 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dd0a6-d688-41c2-ba13-3366f1e2e237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:50.980873 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9a2dd0a6-d688-41c2-ba13-3366f1e2e237 None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:19:50.982171 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9a2dd0a6-d688-41c2-ba13-3366f1e2e237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:50.990331 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1428/2891] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:19:50.994561 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e592063-7a10-4f46-b543-170a804058bf None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:51.006245 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e592063-7a10-4f46-b543-170a804058bf None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:51.010800 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a68db-a0db-42bd-8614-ec60093f6fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:51.011409 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a68db-a0db-42bd-8614-ec60093f6fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:51.011692 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a68db-a0db-42bd-8614-ec60093f6fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:51.011967 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a68db-a0db-42bd-8614-ec60093f6fc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:51.012702 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a68db-a0db-42bd-8614-ec60093f6fc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:19:51.013063 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a68db-a0db-42bd-8614-ec60093f6fc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:51.014674 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a68db-a0db-42bd-8614-ec60093f6fc3 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:51.026682 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1464/2892] 10.222.0.75 () {58 vars in 1153 bytes} [Thu Jul 28 18:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:19:51.030855 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dd0a6-d688-41c2-ba13-3366f1e2e237 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:51.040706 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dd0a6-d688-41c2-ba13-3366f1e2e237 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:51.045576 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341ff65-ec6d-433f-ae65-00feee35f689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:51.046215 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341ff65-ec6d-433f-ae65-00feee35f689 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:51.046494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341ff65-ec6d-433f-ae65-00feee35f689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:51.046758 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341ff65-ec6d-433f-ae65-00feee35f689 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:51.047457 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341ff65-ec6d-433f-ae65-00feee35f689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:51.049400 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341ff65-ec6d-433f-ae65-00feee35f689 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:51.177098 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1429/2893] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:19:51 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:19:51.181231 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a68db-a0db-42bd-8614-ec60093f6fc3 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:51.191462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a68db-a0db-42bd-8614-ec60093f6fc3 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:51.208812 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:51.248167 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6c539-1899-480a-85e2-bb770270f49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:51.248872 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c539-1899-480a-85e2-bb770270f49e admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:51.252059 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c539-1899-480a-85e2-bb770270f49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:51.252059 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c539-1899-480a-85e2-bb770270f49e admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:51.252059 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6c539-1899-480a-85e2-bb770270f49e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:51.252059 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6c539-1899-480a-85e2-bb770270f49e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:51.342215 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1465/2894] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:19:51 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:19:51.346439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341ff65-ec6d-433f-ae65-00feee35f689 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:51.357274 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341ff65-ec6d-433f-ae65-00feee35f689 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:51.362137 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0063e2-992f-4f59-b3cc-75b7448ed892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:51.362764 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0063e2-992f-4f59-b3cc-75b7448ed892 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:51.363028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0063e2-992f-4f59-b3cc-75b7448ed892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:51.363301 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0063e2-992f-4f59-b3cc-75b7448ed892 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:51.363989 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0063e2-992f-4f59-b3cc-75b7448ed892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:51.365632 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0063e2-992f-4f59-b3cc-75b7448ed892 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:51.376154 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1430/2895] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:19:51.380840 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6c539-1899-480a-85e2-bb770270f49e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:51.391657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6c539-1899-480a-85e2-bb770270f49e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:51.397295 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edea75-a0c4-44ee-a832-fb17760defa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:51.397977 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edea75-a0c4-44ee-a832-fb17760defa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:51.398321 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edea75-a0c4-44ee-a832-fb17760defa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:51.398600 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edea75-a0c4-44ee-a832-fb17760defa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:51.399339 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edea75-a0c4-44ee-a832-fb17760defa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:51.401112 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edea75-a0c4-44ee-a832-fb17760defa0 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:51.412584 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1466/2896] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:19:51.416831 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0063e2-992f-4f59-b3cc-75b7448ed892 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:51.427504 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0063e2-992f-4f59-b3cc-75b7448ed892 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:51.432425 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea15f8-8438-4837-8a63-ccec10251c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:51.433157 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea15f8-8438-4837-8a63-ccec10251c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:51.433446 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea15f8-8438-4837-8a63-ccec10251c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:51.433726 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea15f8-8438-4837-8a63-ccec10251c5e admin admin] PATH_INFO: `/v3/projects/39e7a5ff30e8432abd185e97ba2a4577/users/451c6812166d4772881c69b7560952f3/roles/279c255613df457cb2d5d9904dd6f12a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:51.449064 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea15f8-8438-4837-8a63-ccec10251c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e7a5ff30e8432abd185e97ba2a4577, user_id=451c6812166d4772881c69b7560952f3, role_id=279c255613df457cb2d5d9904dd6f12a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:51.451748 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea15f8-8438-4837-8a63-ccec10251c5e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:51.516322 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1431/2897] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:19:51 2022] PUT /identity/v3/projects/39e7a5ff30e8432abd185e97ba2a4577/users/451c6812166d4772881c69b7560952f3/roles/279c255613df457cb2d5d9904dd6f12a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:19:51.522208 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beb751-ae18-4025-ab3b-f827c5ed554d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:51.522498 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beb751-ae18-4025-ab3b-f827c5ed554d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:51.522767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beb751-ae18-4025-ab3b-f827c5ed554d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:51.541921 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-89beb751-ae18-4025-ab3b-f827c5ed554d None None] MFA Rules not processed for user `f7723740b021455a9d6a17442f071bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:19:51.543332 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-89beb751-ae18-4025-ab3b-f827c5ed554d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:51.607193 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1467/2898] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:19:51.618045 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea15f8-8438-4837-8a63-ccec10251c5e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:51.619762 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-87ea15f8-8438-4837-8a63-ccec10251c5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:51.682260 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea15f8-8438-4837-8a63-ccec10251c5e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:51.686135 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8730f-b317-4bae-9e94-91e13110bb6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:51.686873 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8730f-b317-4bae-9e94-91e13110bb6b service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:51.687200 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8730f-b317-4bae-9e94-91e13110bb6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:51.687474 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8730f-b317-4bae-9e94-91e13110bb6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:51.697484 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8730f-b317-4bae-9e94-91e13110bb6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:51.699113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8730f-b317-4bae-9e94-91e13110bb6b service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:51.709299 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1432/2899] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:19:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:19:57.113227 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9048ef-2dc0-426c-96d8-a45fcb2ebac5 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:57.113802 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9048ef-2dc0-426c-96d8-a45fcb2ebac5 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:57.114308 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9048ef-2dc0-426c-96d8-a45fcb2ebac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:57.147978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-3d9048ef-2dc0-426c-96d8-a45fcb2ebac5 None None] MFA Rules not processed for user `451c6812166d4772881c69b7560952f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:19:57.149273 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3d9048ef-2dc0-426c-96d8-a45fcb2ebac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:57.219991 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1468/2900] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:19:57.226184 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8730f-b317-4bae-9e94-91e13110bb6b service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:57.239409 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8730f-b317-4bae-9e94-91e13110bb6b service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:57.244194 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea9a02-8935-417d-b07b-8b0a8d343982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:57.244887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea9a02-8935-417d-b07b-8b0a8d343982 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:57.245173 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea9a02-8935-417d-b07b-8b0a8d343982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:57.245446 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea9a02-8935-417d-b07b-8b0a8d343982 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:57.246138 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea9a02-8935-417d-b07b-8b0a8d343982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:57.248047 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea9a02-8935-417d-b07b-8b0a8d343982 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:57.409077 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1433/2901] 10.222.0.75 () {60 vars in 1153 bytes} [Thu Jul 28 18:19:57 2022] POST /identity/v3/projects => generated 371 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:19:57.413873 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9048ef-2dc0-426c-96d8-a45fcb2ebac5 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:57.424802 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9048ef-2dc0-426c-96d8-a45fcb2ebac5 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:57.451360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:57.483423 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae8ced-bdb5-4920-9ce3-b2c69fa8a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:57.484374 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8ced-bdb5-4920-9ce3-b2c69fa8a352 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:57.484654 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8ced-bdb5-4920-9ce3-b2c69fa8a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:57.484971 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8ced-bdb5-4920-9ce3-b2c69fa8a352 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:57.485702 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae8ced-bdb5-4920-9ce3-b2c69fa8a352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:57.487880 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae8ced-bdb5-4920-9ce3-b2c69fa8a352 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:57.621995 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1469/2902] 10.222.0.75 () {60 vars in 1144 bytes} [Thu Jul 28 18:19:57 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:19:57.626012 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea9a02-8935-417d-b07b-8b0a8d343982 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:57.636893 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea9a02-8935-417d-b07b-8b0a8d343982 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:57.641767 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeeaad6-68e1-4394-88e7-766c96448c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:57.647519 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeeaad6-68e1-4394-88e7-766c96448c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:57.647519 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeeaad6-68e1-4394-88e7-766c96448c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:57.647519 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeeaad6-68e1-4394-88e7-766c96448c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:57.647519 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeeaad6-68e1-4394-88e7-766c96448c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:57.647519 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeeaad6-68e1-4394-88e7-766c96448c19 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:57.657830 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1434/2903] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:19:57.663028 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae8ced-bdb5-4920-9ce3-b2c69fa8a352 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:57.678056 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae8ced-bdb5-4920-9ce3-b2c69fa8a352 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:57.683852 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8510d-75f8-488d-93fe-7c20cd56a530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:57.684547 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8510d-75f8-488d-93fe-7c20cd56a530 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:57.684862 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8510d-75f8-488d-93fe-7c20cd56a530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:57.685144 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8510d-75f8-488d-93fe-7c20cd56a530 admin admin] PATH_INFO: `/v3/projects/4bacea57f1474dafb2be756dd9f599c4/users/fda8d0fd81cb47398e58bc25cdfe72d8/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:57.702422 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8510d-75f8-488d-93fe-7c20cd56a530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bacea57f1474dafb2be756dd9f599c4, user_id=fda8d0fd81cb47398e58bc25cdfe72d8, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:57.705205 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8510d-75f8-488d-93fe-7c20cd56a530 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:57.770580 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1470/2904] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:19:57 2022] PUT /identity/v3/projects/4bacea57f1474dafb2be756dd9f599c4/users/fda8d0fd81cb47398e58bc25cdfe72d8/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:19:57.774497 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeeaad6-68e1-4394-88e7-766c96448c19 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:57.784586 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeeaad6-68e1-4394-88e7-766c96448c19 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:57.843199 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:57.853218 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039d764-4567-4f9c-8e07-781781ff5d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:57.860543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039d764-4567-4f9c-8e07-781781ff5d47 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:57.860543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039d764-4567-4f9c-8e07-781781ff5d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:57.860543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039d764-4567-4f9c-8e07-781781ff5d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:57.860543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039d764-4567-4f9c-8e07-781781ff5d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:57.860543 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039d764-4567-4f9c-8e07-781781ff5d47 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:57.867840 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1435/2905] 10.222.0.75 () {58 vars in 1122 bytes} [Thu Jul 28 18:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:19:57.871949 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8510d-75f8-488d-93fe-7c20cd56a530 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:57.885553 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8510d-75f8-488d-93fe-7c20cd56a530 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:57.891855 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e123b-d9ae-4b91-aebf-98ef8e22267b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:57.892769 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e123b-d9ae-4b91-aebf-98ef8e22267b admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:57.893030 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e123b-d9ae-4b91-aebf-98ef8e22267b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:57.893173 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e123b-d9ae-4b91-aebf-98ef8e22267b admin admin] PATH_INFO: `/v3/projects/4bacea57f1474dafb2be756dd9f599c4/users/fda8d0fd81cb47398e58bc25cdfe72d8/roles/d371062e071845ffa4570a76d40dff88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:57.895924 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e123b-d9ae-4b91-aebf-98ef8e22267b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bacea57f1474dafb2be756dd9f599c4, user_id=fda8d0fd81cb47398e58bc25cdfe72d8, role_id=d371062e071845ffa4570a76d40dff88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:57.899233 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e123b-d9ae-4b91-aebf-98ef8e22267b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:57.913773 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1471/2906] 10.222.0.75 () {60 vars in 1483 bytes} [Thu Jul 28 18:19:57 2022] PUT /identity/v3/projects/4bacea57f1474dafb2be756dd9f599c4/users/fda8d0fd81cb47398e58bc25cdfe72d8/roles/d371062e071845ffa4570a76d40dff88 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:20:03.984210 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b52a16-748a-4211-9d87-432942089df4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:20:03.985986 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b52a16-748a-4211-9d87-432942089df4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:20:03.985986 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b52a16-748a-4211-9d87-432942089df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:20:04.019661 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-85b52a16-748a-4211-9d87-432942089df4 None None] MFA Rules not processed for user `fda8d0fd81cb47398e58bc25cdfe72d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:20:04.021044 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-85b52a16-748a-4211-9d87-432942089df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:20:04.122555 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1436/2907] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:20:04.140647 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e123b-d9ae-4b91-aebf-98ef8e22267b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:20:04.142868 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-582e123b-d9ae-4b91-aebf-98ef8e22267b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:20:04.227947 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e123b-d9ae-4b91-aebf-98ef8e22267b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:20:04.234005 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1d3f5-6e4b-4ee0-a7c1-b2157f2cd487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:20:04.234665 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1d3f5-6e4b-4ee0-a7c1-b2157f2cd487 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:20:04.234949 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1d3f5-6e4b-4ee0-a7c1-b2157f2cd487 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:20:04.235226 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1d3f5-6e4b-4ee0-a7c1-b2157f2cd487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:20:04.297383 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1d3f5-6e4b-4ee0-a7c1-b2157f2cd487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:20:04.300180 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1d3f5-6e4b-4ee0-a7c1-b2157f2cd487 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:20:04.310061 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1472/2908] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:20:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:20:07.074045 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d59cdd-097d-4360-a6d6-d742ed492b19 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:20:07.074617 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d59cdd-097d-4360-a6d6-d742ed492b19 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:20:07.074617 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d59cdd-097d-4360-a6d6-d742ed492b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:20:07.098232 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c1d59cdd-097d-4360-a6d6-d742ed492b19 None None] MFA Rules not processed for user `451c6812166d4772881c69b7560952f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:20:07.099538 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c1d59cdd-097d-4360-a6d6-d742ed492b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:20:07.130630 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1437/2909] 10.222.0.75 () {58 vars in 958 bytes} [Thu Jul 28 18:20:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:20:14.305295 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=87,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:20:17.091976 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=42 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:20:29.498563 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1d3f5-6e4b-4ee0-a7c1-b2157f2cd487 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:20:29.511696 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1d3f5-6e4b-4ee0-a7c1-b2157f2cd487 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:20:29.518231 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12d07d-7b54-4350-a8df-a310267b26ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:20:29.519018 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12d07d-7b54-4350-a8df-a310267b26ea service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:20:29.519393 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12d07d-7b54-4350-a8df-a310267b26ea service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:20:29.519571 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12d07d-7b54-4350-a8df-a310267b26ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:20:29.522115 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7d12d07d-7b54-4350-a8df-a310267b26ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:20:29.536131 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12d07d-7b54-4350-a8df-a310267b26ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:20:29.538263 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12d07d-7b54-4350-a8df-a310267b26ea service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:20:29.550665 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1473/2910] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:20:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:20:38.767113 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd5934-e53b-4113-b0c3-21801243fae9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:20:38.767634 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd5934-e53b-4113-b0c3-21801243fae9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:20:38.767739 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd5934-e53b-4113-b0c3-21801243fae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:20:38.787429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-49fd5934-e53b-4113-b0c3-21801243fae9 None None] MFA Rules not processed for user `1cbbfdda843a4ab98ff9cf0742513f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:20:38.788674 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-49fd5934-e53b-4113-b0c3-21801243fae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:20:38.844721 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1438/2911] 10.222.0.75 () {58 vars in 967 bytes} [Thu Jul 28 18:20:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:20:38.866841 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12d07d-7b54-4350-a8df-a310267b26ea service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:20:38.868364 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7d12d07d-7b54-4350-a8df-a310267b26ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:20:38.937132 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12d07d-7b54-4350-a8df-a310267b26ea service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:20:38.942998 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ff5ff-350f-4827-a054-e9e34ebbc020 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77b4fcb974d48a0bda4852c8d304511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:20:38.943618 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff5ff-350f-4827-a054-e9e34ebbc020 service swift] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:20:38.943897 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff5ff-350f-4827-a054-e9e34ebbc020 service swift] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:20:38.944168 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff5ff-350f-4827-a054-e9e34ebbc020 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:20:38.952599 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ff5ff-350f-4827-a054-e9e34ebbc020 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:20:38.954232 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ff5ff-350f-4827-a054-e9e34ebbc020 service swift] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:20:38.962356 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1474/2912] 10.222.0.75 () {60 vars in 1384 bytes} [Thu Jul 28 18:20:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:20:48.095429 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd5934-e53b-4113-b0c3-21801243fae9 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:20:48.096997 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-49fd5934-e53b-4113-b0c3-21801243fae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:20:48.165641 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd5934-e53b-4113-b0c3-21801243fae9 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:20:48.170256 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7d98c-1c68-4e68-abaa-6e71e7329743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:20:48.192081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7d98c-1c68-4e68-abaa-6e71e7329743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:20:48.192081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7d98c-1c68-4e68-abaa-6e71e7329743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:20:48.192081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7d98c-1c68-4e68-abaa-6e71e7329743 admin admin] PATH_INFO: `/v3/users/ab1b2e30663a474b979a0f95bf8dd2ec` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:20:48.192081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7d98c-1c68-4e68-abaa-6e71e7329743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1b2e30663a474b979a0f95bf8dd2ec)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:20:48.192081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7d98c-1c68-4e68-abaa-6e71e7329743 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:20:48.371878 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c1b7d98c-1c68-4e68-abaa-6e71e7329743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1b2e30663a474b979a0f95bf8dd2ec'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:20:48.372544 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c1b7d98c-1c68-4e68-abaa-6e71e7329743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1b2e30663a474b979a0f95bf8dd2ec'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:20:48.385588 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c1b7d98c-1c68-4e68-abaa-6e71e7329743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1b2e30663a474b979a0f95bf8dd2ec'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:20:48.393018 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c1b7d98c-1c68-4e68-abaa-6e71e7329743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1b2e30663a474b979a0f95bf8dd2ec'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:20:48.393806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c1b7d98c-1c68-4e68-abaa-6e71e7329743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1b2e30663a474b979a0f95bf8dd2ec'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:20:48.485942 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1439/2913] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:20:48 2022] DELETE /identity/v3/users/ab1b2e30663a474b979a0f95bf8dd2ec => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:20:48.659365 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ff5ff-350f-4827-a054-e9e34ebbc020 service swift] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:20:48.715923 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ff5ff-350f-4827-a054-e9e34ebbc020 service swift] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:20:48.763651 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc814d88-af89-4551-9118-cd7b1479c064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:20:48.764268 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc814d88-af89-4551-9118-cd7b1479c064 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:20:48.764548 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc814d88-af89-4551-9118-cd7b1479c064 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:20:48.764861 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc814d88-af89-4551-9118-cd7b1479c064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:20:48.766669 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-cc814d88-af89-4551-9118-cd7b1479c064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:20:48.802369 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7d98c-1c68-4e68-abaa-6e71e7329743 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:20:48.803080 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c1b7d98c-1c68-4e68-abaa-6e71e7329743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:20:48.816092 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:20:48.836093 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc814d88-af89-4551-9118-cd7b1479c064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:20:48.837849 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc814d88-af89-4551-9118-cd7b1479c064 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:20:48.848017 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:20:48.848309 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1475/2914] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:20:48 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:20:48.887230 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7d98c-1c68-4e68-abaa-6e71e7329743 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:20:48.892379 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed34e5-b4ff-403f-993d-33b9d7e18a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:20:48.893045 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed34e5-b4ff-403f-993d-33b9d7e18a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:20:48.893334 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed34e5-b4ff-403f-993d-33b9d7e18a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:20:48.893614 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed34e5-b4ff-403f-993d-33b9d7e18a80 admin admin] PATH_INFO: `/v3/projects/61d7df64d6bb4e4f9297417643789ad3` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:20:48.894794 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed34e5-b4ff-403f-993d-33b9d7e18a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d7df64d6bb4e4f9297417643789ad3)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:20:48.897586 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed34e5-b4ff-403f-993d-33b9d7e18a80 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:20:49.046390 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a7ed34e5-b4ff-403f-993d-33b9d7e18a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d7df64d6bb4e4f9297417643789ad3', 'request_id': 'req-a7ed34e5-b4ff-403f-993d-33b9d7e18a80'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:20:49.052582 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a7ed34e5-b4ff-403f-993d-33b9d7e18a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d7df64d6bb4e4f9297417643789ad3', 'request_id': 'req-a7ed34e5-b4ff-403f-993d-33b9d7e18a80'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:20:49.059074 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a7ed34e5-b4ff-403f-993d-33b9d7e18a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d7df64d6bb4e4f9297417643789ad3', 'request_id': 'req-a7ed34e5-b4ff-403f-993d-33b9d7e18a80'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:20:49.154155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a7ed34e5-b4ff-403f-993d-33b9d7e18a80 admin admin] The token cache is being invalidate because project 61d7df64d6bb4e4f9297417643789ad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:20:49.154817 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a7ed34e5-b4ff-403f-993d-33b9d7e18a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:20:49.155079 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a7ed34e5-b4ff-403f-993d-33b9d7e18a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:20:49.156612 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1440/2915] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:20:48 2022] DELETE /identity/v3/projects/61d7df64d6bb4e4f9297417643789ad3 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:20:49.160771 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc814d88-af89-4551-9118-cd7b1479c064 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:20:49.171474 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc814d88-af89-4551-9118-cd7b1479c064 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:20:49.233291 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331455e-a212-48fb-92d5-408ffd060fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:20:49.234104 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331455e-a212-48fb-92d5-408ffd060fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:20:49.234407 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331455e-a212-48fb-92d5-408ffd060fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:20:49.234670 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331455e-a212-48fb-92d5-408ffd060fb9 admin admin] PATH_INFO: `/v3/users/18ffd16bc989457e9a5d4db51b5ac0f2` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:20:49.235862 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331455e-a212-48fb-92d5-408ffd060fb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ffd16bc989457e9a5d4db51b5ac0f2)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:20:49.237870 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331455e-a212-48fb-92d5-408ffd060fb9 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:20:49.459692 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2331455e-a212-48fb-92d5-408ffd060fb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ffd16bc989457e9a5d4db51b5ac0f2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:20:49.531450 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2331455e-a212-48fb-92d5-408ffd060fb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ffd16bc989457e9a5d4db51b5ac0f2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:20:49.546049 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2331455e-a212-48fb-92d5-408ffd060fb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ffd16bc989457e9a5d4db51b5ac0f2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:20:49.554403 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2331455e-a212-48fb-92d5-408ffd060fb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ffd16bc989457e9a5d4db51b5ac0f2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:20:49.555221 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2331455e-a212-48fb-92d5-408ffd060fb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ffd16bc989457e9a5d4db51b5ac0f2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:20:49.561903 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1476/2916] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:20:49 2022] DELETE /identity/v3/users/18ffd16bc989457e9a5d4db51b5ac0f2 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:20:49.850410 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed34e5-b4ff-403f-993d-33b9d7e18a80 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:20:49.852367 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a7ed34e5-b4ff-403f-993d-33b9d7e18a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:20:49.873025 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed34e5-b4ff-403f-993d-33b9d7e18a80 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:20:49.932162 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750d3e1-0219-42c3-9415-2e088ed96760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:20:49.932891 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750d3e1-0219-42c3-9415-2e088ed96760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:20:49.933179 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750d3e1-0219-42c3-9415-2e088ed96760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:20:49.939771 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750d3e1-0219-42c3-9415-2e088ed96760 admin admin] PATH_INFO: `/v3/projects/6cf8a0a8ef36418cb5a637e437641855` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:20:49.939771 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750d3e1-0219-42c3-9415-2e088ed96760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf8a0a8ef36418cb5a637e437641855)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:20:49.939771 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750d3e1-0219-42c3-9415-2e088ed96760 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:20:50.047703 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7750d3e1-0219-42c3-9415-2e088ed96760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf8a0a8ef36418cb5a637e437641855', 'request_id': 'req-7750d3e1-0219-42c3-9415-2e088ed96760'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:20:50.052706 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:20:50.053913 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7750d3e1-0219-42c3-9415-2e088ed96760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf8a0a8ef36418cb5a637e437641855', 'request_id': 'req-7750d3e1-0219-42c3-9415-2e088ed96760'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:20:50.060127 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7750d3e1-0219-42c3-9415-2e088ed96760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf8a0a8ef36418cb5a637e437641855', 'request_id': 'req-7750d3e1-0219-42c3-9415-2e088ed96760'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:20:50.149002 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7750d3e1-0219-42c3-9415-2e088ed96760 admin admin] The token cache is being invalidate because project 6cf8a0a8ef36418cb5a637e437641855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:20:50.149321 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7750d3e1-0219-42c3-9415-2e088ed96760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:20:50.149956 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-7750d3e1-0219-42c3-9415-2e088ed96760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:20:50.151477 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1441/2917] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:20:49 2022] DELETE /identity/v3/projects/6cf8a0a8ef36418cb5a637e437641855 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:20:59.558094 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=61,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:21:00.328814 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=5,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:22:15.826002 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331455e-a212-48fb-92d5-408ffd060fb9 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:22:15.827456 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2331455e-a212-48fb-92d5-408ffd060fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:22:15.884965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331455e-a212-48fb-92d5-408ffd060fb9 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:22:15.931749 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbffb56-b5ac-48a9-8dea-20925140074d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:22:15.932367 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbffb56-b5ac-48a9-8dea-20925140074d service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:22:15.932653 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbffb56-b5ac-48a9-8dea-20925140074d service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:22:15.932965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbffb56-b5ac-48a9-8dea-20925140074d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:22:15.934767 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-dbbffb56-b5ac-48a9-8dea-20925140074d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:22:15.944836 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbffb56-b5ac-48a9-8dea-20925140074d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:22:15.946301 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbffb56-b5ac-48a9-8dea-20925140074d service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:22:15.954696 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1477/2918] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:22:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:22:25.950754 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=46 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:23:28.086081 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750d3e1-0219-42c3-9415-2e088ed96760 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:23:28.087494 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7750d3e1-0219-42c3-9415-2e088ed96760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:23:28.133567 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750d3e1-0219-42c3-9415-2e088ed96760 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:23:28.137343 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e390df7-f0c3-4ae9-8c9c-d2dcd8997608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:23:28.137967 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e390df7-f0c3-4ae9-8c9c-d2dcd8997608 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:23:28.138249 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e390df7-f0c3-4ae9-8c9c-d2dcd8997608 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:23:28.138525 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e390df7-f0c3-4ae9-8c9c-d2dcd8997608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:23:28.140873 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8e390df7-f0c3-4ae9-8c9c-d2dcd8997608 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:23:28.232743 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e390df7-f0c3-4ae9-8c9c-d2dcd8997608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:23:28.234255 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e390df7-f0c3-4ae9-8c9c-d2dcd8997608 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:23:28.245442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1442/2919] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:23:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:23:29.425626 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbffb56-b5ac-48a9-8dea-20925140074d service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:23:29.427044 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-dbbffb56-b5ac-48a9-8dea-20925140074d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:23:29.467230 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbffb56-b5ac-48a9-8dea-20925140074d service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:23:29.471503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f71285-06a1-41fd-95f1-44e76b8d0ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:23:29.472126 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f71285-06a1-41fd-95f1-44e76b8d0ccd service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:23:29.472409 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f71285-06a1-41fd-95f1-44e76b8d0ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:23:29.472681 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f71285-06a1-41fd-95f1-44e76b8d0ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:23:29.474479 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-52f71285-06a1-41fd-95f1-44e76b8d0ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:23:29.488987 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f71285-06a1-41fd-95f1-44e76b8d0ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:23:29.490462 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f71285-06a1-41fd-95f1-44e76b8d0ccd service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:23:29.501414 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1478/2920] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:23:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:23:38.240466 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=56 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:23:39.496548 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=19 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:23:47.263686 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e390df7-f0c3-4ae9-8c9c-d2dcd8997608 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:23:47.273489 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e390df7-f0c3-4ae9-8c9c-d2dcd8997608 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:23:47.277157 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc42f3-cf21-4521-8622-c54898d823f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:23:47.277773 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc42f3-cf21-4521-8622-c54898d823f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:23:47.278055 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc42f3-cf21-4521-8622-c54898d823f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:23:47.278329 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc42f3-cf21-4521-8622-c54898d823f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:23:47.280116 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-efbc42f3-cf21-4521-8622-c54898d823f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:23:47.289784 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc42f3-cf21-4521-8622-c54898d823f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:23:47.291202 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc42f3-cf21-4521-8622-c54898d823f5 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:23:47.299248 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1443/2921] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:23:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:23:48.710385 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e2f1a-e0f7-4b3a-a4e1-91472a5dc798 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:23:48.711493 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e2f1a-e0f7-4b3a-a4e1-91472a5dc798 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:23:48.711493 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e2f1a-e0f7-4b3a-a4e1-91472a5dc798 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:23:48.713174 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1479/2922] 10.222.0.75 () {54 vars in 921 bytes} [Thu Jul 28 18:23:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:23:48.718713 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c5e88-be12-4983-849f-6f01c7006ac7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:23:48.719177 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c5e88-be12-4983-849f-6f01c7006ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:23:48.719276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c5e88-be12-4983-849f-6f01c7006ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:23:48.758555 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-477c5e88-be12-4983-849f-6f01c7006ac7 None None] MFA Rules not processed for user `d0e56603b8704cb2b5587313c67254a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:23:48.759747 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-477c5e88-be12-4983-849f-6f01c7006ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:23:48.766542 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1444/2923] 10.222.0.75 () {58 vars in 1018 bytes} [Thu Jul 28 18:23:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:23:48.778864 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e2f1a-e0f7-4b3a-a4e1-91472a5dc798 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:23:48.790513 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e2f1a-e0f7-4b3a-a4e1-91472a5dc798 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:23:48.793958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb447a-e572-4fbf-bb9c-3ca216849ddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:23:48.794562 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb447a-e572-4fbf-bb9c-3ca216849ddb service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:23:48.794839 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb447a-e572-4fbf-bb9c-3ca216849ddb service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:23:48.795112 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb447a-e572-4fbf-bb9c-3ca216849ddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:23:48.802491 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb447a-e572-4fbf-bb9c-3ca216849ddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:23:48.803932 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb447a-e572-4fbf-bb9c-3ca216849ddb service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:23:48.820711 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1480/2924] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:23:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:23:49.915801 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5bf7b-235e-4860-bf99-4d43a526ad58 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:23:49.916309 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5bf7b-235e-4860-bf99-4d43a526ad58 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:23:49.916439 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5bf7b-235e-4860-bf99-4d43a526ad58 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:23:49.917917 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1445/2925] 10.222.0.75 () {54 vars in 921 bytes} [Thu Jul 28 18:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:23:49.923189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b045b-dca1-4aea-9ab1-316436a22207 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:23:49.923657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b045b-dca1-4aea-9ab1-316436a22207 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:23:49.923890 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b045b-dca1-4aea-9ab1-316436a22207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:23:49.963334 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-ea5b045b-dca1-4aea-9ab1-316436a22207 None None] MFA Rules not processed for user `c456a787159844feb7eabfd1e527e46e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:23:49.964556 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ea5b045b-dca1-4aea-9ab1-316436a22207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:23:49.974080 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1481/2926] 10.222.0.75 () {58 vars in 1018 bytes} [Thu Jul 28 18:23:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:23:49.984971 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5bf7b-235e-4860-bf99-4d43a526ad58 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:23:49.998654 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5bf7b-235e-4860-bf99-4d43a526ad58 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:23:50.002268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee5cdd-31f8-4da2-9620-4f8312877f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:23:50.002887 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee5cdd-31f8-4da2-9620-4f8312877f40 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:23:50.003171 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee5cdd-31f8-4da2-9620-4f8312877f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:23:50.003447 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee5cdd-31f8-4da2-9620-4f8312877f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:23:50.014879 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee5cdd-31f8-4da2-9620-4f8312877f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:23:50.016355 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee5cdd-31f8-4da2-9620-4f8312877f40 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:23:50.027662 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1446/2927] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:23:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:23:50.089978 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b045b-dca1-4aea-9ab1-316436a22207 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:23:50.091589 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ea5b045b-dca1-4aea-9ab1-316436a22207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:23:50.101018 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee5cdd-31f8-4da2-9620-4f8312877f40 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:23:50.102778 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e4ee5cdd-31f8-4da2-9620-4f8312877f40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:23:50.119048 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee5cdd-31f8-4da2-9620-4f8312877f40 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:23:50.125256 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2d254-5959-4119-a977-84c45242e46a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:23:50.125882 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2d254-5959-4119-a977-84c45242e46a service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:23:50.126171 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2d254-5959-4119-a977-84c45242e46a service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:23:50.126449 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2d254-5959-4119-a977-84c45242e46a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:23:50.128306 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-85e2d254-5959-4119-a977-84c45242e46a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:23:50.141336 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2d254-5959-4119-a977-84c45242e46a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:23:50.142969 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2d254-5959-4119-a977-84c45242e46a service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:23:50.154107 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1447/2928] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:23:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:23:50.203124 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b045b-dca1-4aea-9ab1-316436a22207 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:23:50.208621 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b0e99-7368-4835-ae3d-0a47ff6aa639 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff43a72eaef462f86426ad3ceccd3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:23:50.209293 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b0e99-7368-4835-ae3d-0a47ff6aa639 service placement] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:23:50.209576 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b0e99-7368-4835-ae3d-0a47ff6aa639 service placement] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:23:50.209990 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b0e99-7368-4835-ae3d-0a47ff6aa639 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:23:50.211782 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-101b0e99-7368-4835-ae3d-0a47ff6aa639 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:23:50.228666 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b0e99-7368-4835-ae3d-0a47ff6aa639 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:23:50.230958 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b0e99-7368-4835-ae3d-0a47ff6aa639 service placement] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:23:50.242576 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1482/2929] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:23:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:24:00.149771 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=27 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:24:00.237965 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=56 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:24:15.329247 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2d254-5959-4119-a977-84c45242e46a service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:24:15.341635 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2d254-5959-4119-a977-84c45242e46a service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:24:15.346782 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a0403-62c0-4833-bca3-59e5e4520607 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff43a72eaef462f86426ad3ceccd3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:24:15.347400 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a0403-62c0-4833-bca3-59e5e4520607 service placement] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:24:15.347683 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a0403-62c0-4833-bca3-59e5e4520607 service placement] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:24:15.347960 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a0403-62c0-4833-bca3-59e5e4520607 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:24:15.349800 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0f2a0403-62c0-4833-bca3-59e5e4520607 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:24:15.362028 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a0403-62c0-4833-bca3-59e5e4520607 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:24:15.365937 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a0403-62c0-4833-bca3-59e5e4520607 service placement] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:24:15.374077 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1448/2930] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:24:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:24:25.369748 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=6 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:25:55.231391 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b0e99-7368-4835-ae3d-0a47ff6aa639 service placement] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:25:55.249952 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b0e99-7368-4835-ae3d-0a47ff6aa639 service placement] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:25:55.253539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f5cc4-2d78-492c-bead-58caf2f64644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:25:55.254428 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f5cc4-2d78-492c-bead-58caf2f64644 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:25:55.254709 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f5cc4-2d78-492c-bead-58caf2f64644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:25:55.255480 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f5cc4-2d78-492c-bead-58caf2f64644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:25:55.257240 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0b7f5cc4-2d78-492c-bead-58caf2f64644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:25:55.315069 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f5cc4-2d78-492c-bead-58caf2f64644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:25:55.316524 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f5cc4-2d78-492c-bead-58caf2f64644 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:25:55.326328 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1483/2931] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:25:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:25:56.266145 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a0403-62c0-4833-bca3-59e5e4520607 service placement] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:25:56.303806 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a0403-62c0-4833-bca3-59e5e4520607 service placement] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:25:56.310355 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4967e-1047-48b8-b1ce-dd15d0127a78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c456a787159844feb7eabfd1e527e46e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:25:56.310922 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4967e-1047-48b8-b1ce-dd15d0127a78 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:25:56.311206 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4967e-1047-48b8-b1ce-dd15d0127a78 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:25:56.311482 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4967e-1047-48b8-b1ce-dd15d0127a78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:25:56.313387 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e7b4967e-1047-48b8-b1ce-dd15d0127a78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:25:56.347676 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4967e-1047-48b8-b1ce-dd15d0127a78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:25:56.349770 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4967e-1047-48b8-b1ce-dd15d0127a78 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:25:56.361284 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1449/2932] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:25:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:26:01.649755 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f5cc4-2d78-492c-bead-58caf2f64644 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:26:01.658640 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f5cc4-2d78-492c-bead-58caf2f64644 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:26:01.662237 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9a5e2-7628-4235-bec0-d3d30c60033a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e56603b8704cb2b5587313c67254a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:26:01.662910 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9a5e2-7628-4235-bec0-d3d30c60033a service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:26:01.663189 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9a5e2-7628-4235-bec0-d3d30c60033a service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:26:01.663464 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9a5e2-7628-4235-bec0-d3d30c60033a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:26:01.665493 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b7f9a5e2-7628-4235-bec0-d3d30c60033a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:26:01.755052 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9a5e2-7628-4235-bec0-d3d30c60033a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:26:01.757161 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9a5e2-7628-4235-bec0-d3d30c60033a service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:26:01.775657 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1484/2933] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:26:05.319467 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4967e-1047-48b8-b1ce-dd15d0127a78 service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:26:05.320992 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e7b4967e-1047-48b8-b1ce-dd15d0127a78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:26:05.340460 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4967e-1047-48b8-b1ce-dd15d0127a78 service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:26:05.346796 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b14170-6a82-4d80-890d-6d21b098ea13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff43a72eaef462f86426ad3ceccd3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:26:05.348015 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b14170-6a82-4d80-890d-6d21b098ea13 service placement] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:26:05.348475 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b14170-6a82-4d80-890d-6d21b098ea13 service placement] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:26:05.348964 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b14170-6a82-4d80-890d-6d21b098ea13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:26:05.351155 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-36b14170-6a82-4d80-890d-6d21b098ea13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:26:05.367875 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b14170-6a82-4d80-890d-6d21b098ea13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:26:05.369671 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b14170-6a82-4d80-890d-6d21b098ea13 service placement] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:26:05.382308 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1450/2934] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:26:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:26:09.022831 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9a5e2-7628-4235-bec0-d3d30c60033a service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:26:09.034523 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9a5e2-7628-4235-bec0-d3d30c60033a service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:26:09.040357 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b41dda-bea7-4cf8-973f-b211d0a6bfe2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff43a72eaef462f86426ad3ceccd3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:26:09.041023 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b41dda-bea7-4cf8-973f-b211d0a6bfe2 service placement] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:26:09.041421 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b41dda-bea7-4cf8-973f-b211d0a6bfe2 service placement] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:26:09.041705 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b41dda-bea7-4cf8-973f-b211d0a6bfe2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:26:09.043693 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-49b41dda-bea7-4cf8-973f-b211d0a6bfe2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:26:09.057022 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b41dda-bea7-4cf8-973f-b211d0a6bfe2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:26:09.058884 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b41dda-bea7-4cf8-973f-b211d0a6bfe2 service placement] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:26:09.069605 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1485/2935] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:26:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:26:09.155940 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b14170-6a82-4d80-890d-6d21b098ea13 service placement] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:26:09.157534 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-36b14170-6a82-4d80-890d-6d21b098ea13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:26:09.175872 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b14170-6a82-4d80-890d-6d21b098ea13 service placement] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:26:09.180930 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a552acf-c167-45e9-a958-e1112189ca90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:26:09.181569 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a552acf-c167-45e9-a958-e1112189ca90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:26:09.181854 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a552acf-c167-45e9-a958-e1112189ca90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:26:09.182130 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a552acf-c167-45e9-a958-e1112189ca90 admin admin] PATH_INFO: `/v3/users/451c6812166d4772881c69b7560952f3` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:26:09.183304 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a552acf-c167-45e9-a958-e1112189ca90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=451c6812166d4772881c69b7560952f3)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:26:09.185235 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a552acf-c167-45e9-a958-e1112189ca90 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:26:09.431420 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6a552acf-c167-45e9-a958-e1112189ca90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451c6812166d4772881c69b7560952f3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:26:09.432088 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6a552acf-c167-45e9-a958-e1112189ca90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451c6812166d4772881c69b7560952f3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:26:09.445425 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6a552acf-c167-45e9-a958-e1112189ca90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451c6812166d4772881c69b7560952f3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:26:09.452432 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6a552acf-c167-45e9-a958-e1112189ca90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451c6812166d4772881c69b7560952f3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:26:09.453072 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6a552acf-c167-45e9-a958-e1112189ca90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451c6812166d4772881c69b7560952f3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:26:09.532285 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1451/2936] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:26:09 2022] DELETE /identity/v3/users/451c6812166d4772881c69b7560952f3 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:26:09.769136 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b41dda-bea7-4cf8-973f-b211d0a6bfe2 service placement] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:26:09.779597 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b41dda-bea7-4cf8-973f-b211d0a6bfe2 service placement] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:26:09.835873 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:26:09.852650 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc9108-ddc4-48d9-bd35-6b0654e11d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:26:09.853360 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc9108-ddc4-48d9-bd35-6b0654e11d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:26:09.853648 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc9108-ddc4-48d9-bd35-6b0654e11d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:26:09.853928 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc9108-ddc4-48d9-bd35-6b0654e11d5e admin admin] PATH_INFO: `/v3/projects/39e7a5ff30e8432abd185e97ba2a4577` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:26:09.855087 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc9108-ddc4-48d9-bd35-6b0654e11d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39e7a5ff30e8432abd185e97ba2a4577)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:26:09.857118 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc9108-ddc4-48d9-bd35-6b0654e11d5e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:26:09.972868 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-23bc9108-ddc4-48d9-bd35-6b0654e11d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39e7a5ff30e8432abd185e97ba2a4577', 'request_id': 'req-23bc9108-ddc4-48d9-bd35-6b0654e11d5e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:26:10.109726 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-23bc9108-ddc4-48d9-bd35-6b0654e11d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39e7a5ff30e8432abd185e97ba2a4577', 'request_id': 'req-23bc9108-ddc4-48d9-bd35-6b0654e11d5e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:26:10.117199 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-23bc9108-ddc4-48d9-bd35-6b0654e11d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39e7a5ff30e8432abd185e97ba2a4577', 'request_id': 'req-23bc9108-ddc4-48d9-bd35-6b0654e11d5e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:26:10.128951 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-23bc9108-ddc4-48d9-bd35-6b0654e11d5e admin admin] The token cache is being invalidate because project 39e7a5ff30e8432abd185e97ba2a4577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:26:10.133043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-23bc9108-ddc4-48d9-bd35-6b0654e11d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:26:10.133043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-23bc9108-ddc4-48d9-bd35-6b0654e11d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:26:10.133043 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1486/2937] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:26:09 2022] DELETE /identity/v3/projects/39e7a5ff30e8432abd185e97ba2a4577 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:26:10.135513 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a552acf-c167-45e9-a958-e1112189ca90 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:26:10.136977 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6a552acf-c167-45e9-a958-e1112189ca90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:26:10.152464 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a552acf-c167-45e9-a958-e1112189ca90 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:26:10.211899 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39924e2-e9dd-4f1f-b345-903161c96000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:26:10.212601 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39924e2-e9dd-4f1f-b345-903161c96000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:26:10.212859 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39924e2-e9dd-4f1f-b345-903161c96000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:26:10.213141 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39924e2-e9dd-4f1f-b345-903161c96000 admin admin] PATH_INFO: `/v3/users/fda8d0fd81cb47398e58bc25cdfe72d8` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:26:10.214333 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39924e2-e9dd-4f1f-b345-903161c96000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda8d0fd81cb47398e58bc25cdfe72d8)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:26:10.216263 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39924e2-e9dd-4f1f-b345-903161c96000 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:26:10.238915 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:26:10.438793 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a39924e2-e9dd-4f1f-b345-903161c96000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda8d0fd81cb47398e58bc25cdfe72d8'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:26:10.439444 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a39924e2-e9dd-4f1f-b345-903161c96000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda8d0fd81cb47398e58bc25cdfe72d8'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:26:10.451287 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a39924e2-e9dd-4f1f-b345-903161c96000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda8d0fd81cb47398e58bc25cdfe72d8'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:26:10.458091 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a39924e2-e9dd-4f1f-b345-903161c96000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda8d0fd81cb47398e58bc25cdfe72d8'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:26:10.459276 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a39924e2-e9dd-4f1f-b345-903161c96000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda8d0fd81cb47398e58bc25cdfe72d8'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:26:10.526529 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1452/2938] 10.222.0.75 () {58 vars in 1224 bytes} [Thu Jul 28 18:26:10 2022] DELETE /identity/v3/users/fda8d0fd81cb47398e58bc25cdfe72d8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:26:10.773485 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc9108-ddc4-48d9-bd35-6b0654e11d5e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:26:10.775013 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-23bc9108-ddc4-48d9-bd35-6b0654e11d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:26:10.788436 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc9108-ddc4-48d9-bd35-6b0654e11d5e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:26:10.851198 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a4d55-a279-4431-805a-27f5f7dc014c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7723740b021455a9d6a17442f071bca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee435a1a9d946639c722d848ce39bd1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:26:10.851847 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a4d55-a279-4431-805a-27f5f7dc014c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:26:10.852129 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a4d55-a279-4431-805a-27f5f7dc014c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:26:10.852401 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a4d55-a279-4431-805a-27f5f7dc014c admin admin] PATH_INFO: `/v3/projects/4bacea57f1474dafb2be756dd9f599c4` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:26:10.853604 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a4d55-a279-4431-805a-27f5f7dc014c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bacea57f1474dafb2be756dd9f599c4)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:26:10.855539 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a4d55-a279-4431-805a-27f5f7dc014c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:26:10.966709 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a01a4d55-a279-4431-805a-27f5f7dc014c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bacea57f1474dafb2be756dd9f599c4', 'request_id': 'req-a01a4d55-a279-4431-805a-27f5f7dc014c'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:26:11.006503 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a01a4d55-a279-4431-805a-27f5f7dc014c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bacea57f1474dafb2be756dd9f599c4', 'request_id': 'req-a01a4d55-a279-4431-805a-27f5f7dc014c'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:26:11.012168 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a01a4d55-a279-4431-805a-27f5f7dc014c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bacea57f1474dafb2be756dd9f599c4', 'request_id': 'req-a01a4d55-a279-4431-805a-27f5f7dc014c'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:26:11.023405 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a01a4d55-a279-4431-805a-27f5f7dc014c admin admin] The token cache is being invalidate because project 4bacea57f1474dafb2be756dd9f599c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:26:11.023695 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a01a4d55-a279-4431-805a-27f5f7dc014c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:26:11.024345 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a01a4d55-a279-4431-805a-27f5f7dc014c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:26:11.025966 dv-cinder-837543-7-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1487/2939] 10.222.0.75 () {58 vars in 1233 bytes} [Thu Jul 28 18:26:10 2022] DELETE /identity/v3/projects/4bacea57f1474dafb2be756dd9f599c4 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:26:20.531442 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:26:21.020359 dv-cinder-837543-7-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:29:20.312415 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39924e2-e9dd-4f1f-b345-903161c96000 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:29:20.314038 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a39924e2-e9dd-4f1f-b345-903161c96000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:29:20.384651 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39924e2-e9dd-4f1f-b345-903161c96000 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:29:20.443094 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9959df-9e36-44f8-9c8a-218d1cc7bbd3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cff43a72eaef462f86426ad3ceccd3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883ec0c5aa374fbfbfc08eda6c626cfc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:29:20.443715 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9959df-9e36-44f8-9c8a-218d1cc7bbd3 service placement] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:29:20.443994 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9959df-9e36-44f8-9c8a-218d1cc7bbd3 service placement] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:29:20.444268 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9959df-9e36-44f8-9c8a-218d1cc7bbd3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:29:20.446043 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6b9959df-9e36-44f8-9c8a-218d1cc7bbd3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:29:20.457196 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9959df-9e36-44f8-9c8a-218d1cc7bbd3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:29:20.458753 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9959df-9e36-44f8-9c8a-218d1cc7bbd3 service placement] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:29:20.469405 dv-cinder-837543-7-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1453/2940] 10.222.0.75 () {60 vars in 1365 bytes} [Thu Jul 28 18:29:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:29:30.464228 dv-cinder-837543-7-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=58 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}